-- Logs begin at Thu 2022-08-11 10:09:10 UTC, end at Thu 2022-08-11 11:28:15 UTC. -- Aug 11 10:42:01.568441 dv-cinder-820027-17-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 11 10:42:01.582247 dv-cinder-820027-17-smb devstack@keystone.service[81626]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 11 10:42:01.582247 dv-cinder-820027-17-smb devstack@keystone.service[81626]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 11 10:42:01 2022] *** Aug 11 10:42:01.582247 dv-cinder-820027-17-smb devstack@keystone.service[81626]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 11 10:42:01.582247 dv-cinder-820027-17-smb devstack@keystone.service[81626]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 11 10:42:01.582247 dv-cinder-820027-17-smb devstack@keystone.service[81626]: nodename: dv-cinder-820027-17-smb Aug 11 10:42:01.582247 dv-cinder-820027-17-smb devstack@keystone.service[81626]: machine: x86_64 Aug 11 10:42:01.582247 dv-cinder-820027-17-smb devstack@keystone.service[81626]: clock source: unix Aug 11 10:42:01.582247 dv-cinder-820027-17-smb devstack@keystone.service[81626]: pcre jit disabled Aug 11 10:42:01.582247 dv-cinder-820027-17-smb devstack@keystone.service[81626]: detected number of CPU cores: 4 Aug 11 10:42:01.582247 dv-cinder-820027-17-smb devstack@keystone.service[81626]: current working directory: / Aug 11 10:42:01.582247 dv-cinder-820027-17-smb devstack@keystone.service[81626]: detected binary path: /usr/bin/uwsgi-core Aug 11 10:42:01.582247 dv-cinder-820027-17-smb devstack@keystone.service[81626]: your processes number limit is 47680 Aug 11 10:42:01.582247 dv-cinder-820027-17-smb devstack@keystone.service[81626]: your memory page size is 4096 bytes Aug 11 10:42:01.582247 dv-cinder-820027-17-smb devstack@keystone.service[81626]: detected max file descriptor number: 2048 Aug 11 10:42:01.582247 dv-cinder-820027-17-smb devstack@keystone.service[81626]: lock engine: pthread robust mutexes Aug 11 10:42:01.582247 dv-cinder-820027-17-smb devstack@keystone.service[81626]: thunder lock: enabled Aug 11 10:42:01.582247 dv-cinder-820027-17-smb devstack@keystone.service[81626]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 11 10:42:01.582247 dv-cinder-820027-17-smb devstack@keystone.service[81626]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 11 10:42:01.618904 dv-cinder-820027-17-smb devstack@keystone.service[81626]: Python main interpreter initialized at 0x5607a60249c0 Aug 11 10:42:01.618904 dv-cinder-820027-17-smb devstack@keystone.service[81626]: python threads support enabled Aug 11 10:42:01.618904 dv-cinder-820027-17-smb devstack@keystone.service[81626]: your server socket listen backlog is limited to 100 connections Aug 11 10:42:01.618904 dv-cinder-820027-17-smb devstack@keystone.service[81626]: your mercy for graceful operations on workers is 90 seconds Aug 11 10:42:01.619230 dv-cinder-820027-17-smb devstack@keystone.service[81626]: mapped 403077 bytes (393 KB) for 2 cores Aug 11 10:42:01.619327 dv-cinder-820027-17-smb devstack@keystone.service[81626]: *** Operational MODE: preforking *** Aug 11 10:42:01.619597 dv-cinder-820027-17-smb devstack@keystone.service[81626]: *** uWSGI is running in multiple interpreter mode *** Aug 11 10:42:01.619597 dv-cinder-820027-17-smb devstack@keystone.service[81626]: spawned uWSGI master process (pid: 81626) Aug 11 10:42:01.619792 dv-cinder-820027-17-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 11 10:42:01.621711 dv-cinder-820027-17-smb devstack@keystone.service[81626]: spawned uWSGI worker 1 (pid: 81638, cores: 1) Aug 11 10:42:01.621711 dv-cinder-820027-17-smb devstack@keystone.service[81626]: spawned uWSGI worker 2 (pid: 81639, cores: 1) Aug 11 10:42:01.621711 dv-cinder-820027-17-smb devstack@keystone.service[81626]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 11 10:42:07.160331 dv-cinder-820027-17-smb devstack@keystone.service[81638]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 10:42:07.160331 dv-cinder-820027-17-smb devstack@keystone.service[81638]: from cryptography.utils import int_from_bytes Aug 11 10:42:07.161098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 10:42:07.161098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: from cryptography.utils import int_from_bytes Aug 11 10:42:07.194336 dv-cinder-820027-17-smb devstack@keystone.service[81639]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 10:42:07.194336 dv-cinder-820027-17-smb devstack@keystone.service[81639]: from cryptography.utils import int_from_bytes Aug 11 10:42:07.194881 dv-cinder-820027-17-smb devstack@keystone.service[81639]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 10:42:07.194881 dv-cinder-820027-17-smb devstack@keystone.service[81639]: from cryptography.utils import int_from_bytes Aug 11 10:42:07.209967 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 11 10:42:07.210159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 11 10:42:07.210347 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] command line args: [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 11 10:42:07.210625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 11 10:42:07.210854 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ================================================================================ {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 11 10:42:07.211154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] admin_token = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.211462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] config_dir = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.211689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.211887 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] config_source = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.212094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] debug = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.212310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.213741 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.213741 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.213741 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.213741 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.214017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.214017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] log_config_append = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.214194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.214385 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] log_dir = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.214588 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] log_file = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.214905 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.215216 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.215522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.215817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.215995 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.216184 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.216448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.216726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.217003 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.217290 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.217577 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.217865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.218163 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.218466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.218865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.219512 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.219714 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] publish_errors = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.220091 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.220388 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.220599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.220907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.221206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.221500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] standard_threads = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.221788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.222093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.222299 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.222504 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] use_journal = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.222708 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] use_json = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.222933 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] use_stderr = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.223137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] use_syslog = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.223424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.223737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.224034 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.224389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.224702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.225046 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.225393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.225843 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.226189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.226442 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.226691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.226966 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.227204 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.227452 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.227687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.227936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.228185 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.228422 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.228678 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.228932 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.229176 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.229412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.229666 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.229927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.230179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.230428 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.230658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.230909 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.231146 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.231381 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.231635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.231884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.232115 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.232344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.232591 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.232840 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.233076 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.233324 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.233554 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.233788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.234022 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.234505 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.234732 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.235166 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.235501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.235780 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.236034 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.236267 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.236505 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.236738 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.236978 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.237214 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.237467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.237700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.237939 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.238175 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.238413 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.238649 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.238913 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.239147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.239397 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.239632 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.239869 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.240102 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.240361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.240596 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.240826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.241068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.241306 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.241494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 11 10:42:07.241573 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.241692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 11 10:42:07.241801 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.241884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] command line args: [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 11 10:42:07.242051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.242134 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 11 10:42:07.242288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ================================================================================ {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 11 10:42:07.242370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.242522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.242604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] admin_token = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.242770 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.242850 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] config_dir = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.242976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.243063 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.243156 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] config_source = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.243241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.243333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] debug = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.243483 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.243560 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.243719 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.243875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.243949 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.244074 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.244190 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.244302 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.244414 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.244536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.244649 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] list_limit = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.244766 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.244878 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] log_config_append = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.244995 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.245113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.245113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] log_dir = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.245334 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.245445 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] log_file = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.245556 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.245667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.245778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.245896 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.246008 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.246128 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.246241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.246352 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.246466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.246585 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.246585 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.246827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.246952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.247071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.247184 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.247313 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.247428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.247540 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.247651 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.247761 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.247880 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.247993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.248133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.248258 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.248357 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.248451 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.248555 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.248652 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.248652 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.248844 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.248939 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.248939 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.249123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.249123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] publish_errors = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.249305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.249425 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.249546 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.249650 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.249773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.249888 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.249989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.external = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.250100 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.250212 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.250325 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.250325 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] standard_threads = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.251098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.251217 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.251331 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.251445 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.251566 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.password = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.251680 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.251680 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] use_journal = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.251888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.token = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.252005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] use_json = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.252005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] use_stderr = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.252232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.252346 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] use_syslog = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.252458 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.252570 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:42:07.252682 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.252794 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.252914 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.253027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.253140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.253253 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.253365 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.253488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.253610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.253729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.253843 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.253951 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.254052 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.254163 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.254286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.254400 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.254512 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.254626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.254738 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.254878 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.254993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.255107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.255226 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.255339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.255451 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.255563 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.255688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.255802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.255915 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.256046 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.256180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.256292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.256589 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.256716 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.256829 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.256942 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.257065 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.257180 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.257306 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.257432 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.257432 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.257646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.257764 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.257878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.257878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.258098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.258213 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.258325 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.258438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.258552 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.258665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.258810 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.258810 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.259028 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.259142 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.259255 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.259367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.259488 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.259603 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.259716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.259836 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.259950 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.260064 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.260184 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.260299 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.260411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.260524 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.260637 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.260749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.260870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.260991 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.261105 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.261228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.261342 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.261456 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.261576 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.261691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.261804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.261923 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.262042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.262157 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.262279 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.262393 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.262506 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.262619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.262738 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.262866 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.262993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.263109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.263223 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.263343 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.263457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.263570 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.263691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.263806 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.263919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.264033 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.264136 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.264230 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.264358 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.264473 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.264611 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.264735 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.264735 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.264958 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.265073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.265186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.265307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.265422 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.265546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.265661 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.265774 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.265887 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.266096 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.266728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.266889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.267004 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.267118 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.267248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.267366 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.267480 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.267480 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.267694 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.267811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.267934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.268056 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.268180 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.268297 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.268417 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.268533 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.268647 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.268769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.268885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.268999 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.269113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.269227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.269342 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.269464 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.269580 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.269699 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.269814 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.269928 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.270050 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.270244 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.270363 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.270477 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.270591 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.270705 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.270835 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.270962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.271078 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.271192 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.271306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.271422 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.271535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.271657 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.271773 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.271886 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.272005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.272120 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.272241 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.272357 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.272472 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.272597 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.272718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.272833 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.272955 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.273070 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.273183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.273297 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.273410 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.273525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.273647 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.273769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.273884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.273997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.274111 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.274224 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.274349 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.274465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.274580 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.274694 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.274847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.274963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.275089 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.275205 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.275319 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.275432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.275547 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.275661 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.275783 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.275783 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.275998 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.275998 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.276211 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.276211 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.276464 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.276581 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.276696 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.276809 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.276923 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.277036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.277210 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.277328 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.277443 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.277443 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.277658 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.277658 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] auth.external = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.277888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.278003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.278117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.278117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.278329 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.278444 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.278566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.278680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.278808 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] auth.password = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.278924 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.279038 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] auth.token = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.279038 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.279263 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.279378 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.279500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.279615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.279728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.279843 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.279964 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.280080 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.280193 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.280307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.280420 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.280533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.280657 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.280773 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] credential.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.280887 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.281001 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.281114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.281228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.281349 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.281464 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.281578 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.281739 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.281858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.281972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.282096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.282218 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.282334 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.282447 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.282567 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.282682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.282849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.282968 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.283088 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.283202 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.283316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.283430 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.283552 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.283667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.283780 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.283894 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.284009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.284130 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.284245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.284358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.284472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] role.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.284585 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.284699 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] role.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.284861 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.284986 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.285108 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.285223 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.285337 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.285450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.285573 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.285573 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.285789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.285903 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.286016 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.286131 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.286252 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.286369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.286483 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.286596 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.286710 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.286838 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.286964 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.287081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.287194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.287314 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.287440 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.287555 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.287680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.287797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.287910 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.288030 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.288146 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.288260 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.288260 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.288483 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.288596 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.288709 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.288823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.288937 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.289059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.289174 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.289288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.289401 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.289639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.289760 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.289884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.290006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.290121 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.290121 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.290336 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.290449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.290571 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.290687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.290814 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.290814 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.291029 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.291155 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.291271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.291386 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.291500 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.291613 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.291726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.291848 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.291963 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.292076 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.292190 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.292310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.292425 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.292425 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.292712 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.292816 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.292929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.293042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.293156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] token.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.293281 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.293404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.293519 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.293633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.293746 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.293860 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.293981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.294096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.294210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.294324 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.294438 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.294551 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.294673 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.294833 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.294950 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.295064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.295178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.295291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.295416 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.295534 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.295648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.295762 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.295876 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.295989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.296111 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.296225 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.296339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.296453 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.296568 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.296682 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.296802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.296917 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.297031 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.297145 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.297293 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.297414 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.connection = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.297540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.297670 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.297794 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.297909 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.298022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.298136 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.298251 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.298377 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.298493 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.298606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.298721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.298853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.298967 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.299093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.299209 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.299209 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.299422 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.299422 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.299635 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.299758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.299872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.299986 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.300100 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.300214 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.300327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.300448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.300564 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.300677 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.300792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.300905 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.301019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.301140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.301256 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.301369 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.301489 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.301604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.301718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.301841 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 11 10:42:07.301957 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.301957 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.301957 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.301957 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.301957 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.301957 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.301957 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.301957 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.301957 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.302926 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.302926 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.302926 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.302926 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.302926 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.303451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.303451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.303669 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.303820 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.304051 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.304281 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.304515 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.304758 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.304995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.305222 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.305455 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.305689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.305933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.306175 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.306405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.306650 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.306918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.307150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.307393 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.307624 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.307858 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.308089 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] role.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.308333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] role.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.308559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.308800 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.309043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.309285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.309527 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.309767 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.310013 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.310252 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.310493 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.310719 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.310985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.311229 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.311470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.311711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.312109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.312342 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.312587 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.312832 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.313627 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.313876 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.314110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.314470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.314720 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.314981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.315211 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.315442 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.315669 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.315916 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.316168 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.316412 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.317103 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.317343 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.317573 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.317808 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] token.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.318043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.318289 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.318523 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.318810 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.319043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.319277 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.319517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.319756 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.320000 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.320231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.320473 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.320704 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.320947 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.321191 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.321417 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.321656 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.321953 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.322210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.connection = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.322452 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.322699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.322959 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.323197 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.323429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.323661 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.323893 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.324124 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.324364 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.324597 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.324837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.325068 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.325311 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.325544 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.325783 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.326008 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.326243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.326472 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:42:07.326638 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81639) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 11 10:42:07.330097 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.330325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.330549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.340123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.351427 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.351657 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.351882 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.361796 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.368228 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.368463 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.380270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.380499 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.420801 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.421964 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.471692 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.471925 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.472948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.473183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.536223 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.536428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.536536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.536620 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.536698 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.536774 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.536850 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.536958 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.537054 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.537172 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.537258 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.537385 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.560158 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.560389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.560478 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.560616 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.560699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.560842 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.560934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.561062 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.561145 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.561274 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.561365 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.561483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.561567 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.561696 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.572976 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.573319 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.585779 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.585923 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.586008 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.586142 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.586222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.586296 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.586428 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.586513 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.586648 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.586730 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.586879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.586971 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.587088 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81639) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.587170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 11 10:42:07.604257 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.604465 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 11 10:42:07.604731 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.604831 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.604961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 11 10:42:07.605039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 11 10:42:07.605240 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.605322 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.605469 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 11 10:42:07.605552 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.605737 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.605818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.605991 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.606072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.606243 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.606501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.617673 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.617949 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.618202 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.618300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.618479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.618562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.618747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.619060 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.625385 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.626023 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.628665 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.628950 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.629198 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.629280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.629486 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.629568 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.629759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.629840 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.630018 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.630108 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.630283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.630365 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.630549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.630631 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.630841 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.630937 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.631110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.631191 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.631371 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.631451 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.631640 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.631907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.654842 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.655183 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.656318 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.656696 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.656848 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.656984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.661252 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.661535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.661619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.661826 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.661945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.662134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.668360 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.668645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.668770 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.669060 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.673276 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.673743 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.673892 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.674025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.674186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.674304 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.674472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.674596 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.674766 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.674895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.675069 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.675169 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.675367 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.675446 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.675643 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.675916 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.691448 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.691725 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.691863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.692146 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.695685 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.696092 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.698849 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.699143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.699268 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.699566 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.703497 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.704558 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.707354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.707785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.710476 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.710795 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.710969 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.711085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.711271 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.711364 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.711561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.711649 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.711857 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.711946 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.712141 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.712424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.727941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.728226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.728421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.728503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.728711 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.728792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.728980 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.729242 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.736432 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.737642 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.737981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.738254 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.739248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.739529 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.741075 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.741365 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.741660 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.741947 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.742223 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.742326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.742609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.742941 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.743242 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.743525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.753769 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.754047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.754324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.754598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.754903 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.755176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.755258 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.755444 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.755525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.755758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.756043 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.756324 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.756600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.756877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.772305 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.773905 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.775259 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.776888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.778170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.779768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.779864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.781277 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.781417 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.781903 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.782189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.783112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.783401 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.783688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.788676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.790089 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.790227 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.791731 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.793139 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.793428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.793723 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.793998 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.794650 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.794970 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.795265 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.795544 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.802534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.802848 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.803346 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.804112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.804404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.804689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.810192 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81639) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.810477 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.810776 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.811055 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.811327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.811605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.811754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 11 10:42:07.811878 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.812043 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.812152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.812330 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.812526 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.812610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.812797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.813485 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.813999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.814089 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.814166 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.814240 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.814313 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.814386 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.814459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81639) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.814583 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.814883 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.815160 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.815430 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.815697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.815960 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 11 10:42:07.847874 dv-cinder-820027-17-smb devstack@keystone.service[81639]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5607a60249c0 pid: 81639 (default app) Aug 11 10:42:07.849229 dv-cinder-820027-17-smb devstack@keystone.service[81638]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5607a60249c0 pid: 81638 (default app) Aug 11 10:42:07.851118 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16f1d1-c5bd-4613-97e4-77042cca8162 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:07.851406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16f1d1-c5bd-4613-97e4-77042cca8162 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:07.851679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16f1d1-c5bd-4613-97e4-77042cca8162 None None] PATH_INFO: `/v3` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:07.855900 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Thu Aug 11 10:42:07 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:16.428720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d7741-8e48-4a31-8a3b-2561ed616900 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:16.429278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d7741-8e48-4a31-8a3b-2561ed616900 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:16.429278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d7741-8e48-4a31-8a3b-2561ed616900 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:16.433660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:42:16.439663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c612a-795f-4a54-be9b-006a321cadeb None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:16.440046 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c612a-795f-4a54-be9b-006a321cadeb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:16.440216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c612a-795f-4a54-be9b-006a321cadeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:16.511852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: INFO dbcounter [None req-2b5c612a-795f-4a54-be9b-006a321cadeb None None] Registered counter for database keystone Aug 11 10:42:16.533999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG oslo_db.sqlalchemy.engines [None req-2b5c612a-795f-4a54-be9b-006a321cadeb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81639) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 10:42:16.540145 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writer thread running {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 10:42:16.732682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG passlib.handlers.bcrypt [None req-2b5c612a-795f-4a54-be9b-006a321cadeb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81639) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 11 10:42:16.733352 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG passlib.handlers.bcrypt [None req-2b5c612a-795f-4a54-be9b-006a321cadeb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81639) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 11 10:42:16.792558 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-2b5c612a-795f-4a54-be9b-006a321cadeb None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:16.794170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2b5c612a-795f-4a54-be9b-006a321cadeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:16.933721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 11 10:42:16.970029 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d7741-8e48-4a31-8a3b-2561ed616900 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:17.042467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: INFO dbcounter [None req-435d7741-8e48-4a31-8a3b-2561ed616900 None None] Registered counter for database keystone Aug 11 10:42:17.062874 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG oslo_db.sqlalchemy.engines [None req-435d7741-8e48-4a31-8a3b-2561ed616900 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 10:42:17.069358 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writer thread running {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 10:42:17.188906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d7741-8e48-4a31-8a3b-2561ed616900 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:17.193250 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954c7e0-917e-4025-a21e-c44730e00278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:17.193886 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954c7e0-917e-4025-a21e-c44730e00278 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:17.194170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954c7e0-917e-4025-a21e-c44730e00278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:17.194441 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954c7e0-917e-4025-a21e-c44730e00278 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:17.205096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954c7e0-917e-4025-a21e-c44730e00278 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:17.262306 dv-cinder-820027-17-smb devstack@keystone.service[81638]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c954c7e0-917e-4025-a21e-c44730e00278 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 11 10:42:17.262655 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954c7e0-917e-4025-a21e-c44730e00278 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:17.273592 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Thu Aug 11 10:42:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 11 10:42:17.279697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c612a-795f-4a54-be9b-006a321cadeb None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:17.295629 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c612a-795f-4a54-be9b-006a321cadeb None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:17.301027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db46dfe-4982-4921-b4f2-241f01b4ecf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:17.302144 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db46dfe-4982-4921-b4f2-241f01b4ecf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:17.302431 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db46dfe-4982-4921-b4f2-241f01b4ecf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:17.302710 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db46dfe-4982-4921-b4f2-241f01b4ecf0 admin admin] PATH_INFO: `/v3/projects/d6947801fa7c4cca9da48801b7ffc014` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:17.304194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db46dfe-4982-4921-b4f2-241f01b4ecf0 admin admin] RBAC: Authorizing `identity:get_project(project_id=d6947801fa7c4cca9da48801b7ffc014)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:17.355581 dv-cinder-820027-17-smb devstack@keystone.service[81639]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8db46dfe-4982-4921-b4f2-241f01b4ecf0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 11 10:42:17.355967 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db46dfe-4982-4921-b4f2-241f01b4ecf0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:17.361596 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Thu Aug 11 10:42:17 2022] GET /identity/v3/projects/d6947801fa7c4cca9da48801b7ffc014 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:19.358011 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47d7c2-44d3-462b-8727-659f118b3ba3 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:19.358522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47d7c2-44d3-462b-8727-659f118b3ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:19.358619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47d7c2-44d3-462b-8727-659f118b3ba3 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:19.362972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:19.368236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e265c6-679b-4484-8448-9f6671a5a672 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:19.368605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e265c6-679b-4484-8448-9f6671a5a672 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:19.368778 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e265c6-679b-4484-8448-9f6671a5a672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:19.389933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f8e265c6-679b-4484-8448-9f6671a5a672 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:19.392114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f8e265c6-679b-4484-8448-9f6671a5a672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:19.399831 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 11 10:42:19.421522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47d7c2-44d3-462b-8727-659f118b3ba3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:19.433702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47d7c2-44d3-462b-8727-659f118b3ba3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:19.438556 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9bb14-159e-4ef5-8986-e3269da4a472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:19.439179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9bb14-159e-4ef5-8986-e3269da4a472 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:19.439465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9bb14-159e-4ef5-8986-e3269da4a472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:19.439739 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9bb14-159e-4ef5-8986-e3269da4a472 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:19.447424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9bb14-159e-4ef5-8986-e3269da4a472 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:19.449207 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9bb14-159e-4ef5-8986-e3269da4a472 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:19.458060 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Thu Aug 11 10:42:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 10:42:19.463366 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e265c6-679b-4484-8448-9f6671a5a672 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:19.472905 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e265c6-679b-4484-8448-9f6671a5a672 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:19.477299 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99658c-aa2b-4b84-b421-ed77e3e958d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:19.478023 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99658c-aa2b-4b84-b421-ed77e3e958d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:19.478304 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99658c-aa2b-4b84-b421-ed77e3e958d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:19.478576 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99658c-aa2b-4b84-b421-ed77e3e958d2 admin admin] PATH_INFO: `/v3/users/94631e4d22874dba849ec3d0cdff5210` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:19.479927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99658c-aa2b-4b84-b421-ed77e3e958d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=94631e4d22874dba849ec3d0cdff5210)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:19.481722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99658c-aa2b-4b84-b421-ed77e3e958d2 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:19.483255 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Thu Aug 11 10:42:19 2022] GET /identity/v3/users/94631e4d22874dba849ec3d0cdff5210 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:21.534731 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf2f70-42ae-4f28-b771-fe788c92a6d5 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:21.535312 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf2f70-42ae-4f28-b771-fe788c92a6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:21.535405 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf2f70-42ae-4f28-b771-fe788c92a6d5 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:21.536740 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:42:21.542018 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b705a-2b9f-4a91-a6f7-dbb2434af970 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:21.542429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b705a-2b9f-4a91-a6f7-dbb2434af970 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:21.542689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b705a-2b9f-4a91-a6f7-dbb2434af970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:21.560588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-6d6b705a-2b9f-4a91-a6f7-dbb2434af970 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:21.561765 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6d6b705a-2b9f-4a91-a6f7-dbb2434af970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:21.573117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81876a-da42-4cd1-8952-b795e1a2ed99 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:21.573408 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81876a-da42-4cd1-8952-b795e1a2ed99 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:21.573680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81876a-da42-4cd1-8952-b795e1a2ed99 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:21.575007 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:42:21.580559 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4ea9a-32b4-43b0-9db0-75b3ccf4d62f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:21.580847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4ea9a-32b4-43b0-9db0-75b3ccf4d62f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:21.581118 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4ea9a-32b4-43b0-9db0-75b3ccf4d62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:21.623701 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG passlib.handlers.bcrypt [None req-ece4ea9a-32b4-43b0-9db0-75b3ccf4d62f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81638) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 11 10:42:21.624131 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG passlib.handlers.bcrypt [None req-ece4ea9a-32b4-43b0-9db0-75b3ccf4d62f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81638) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 11 10:42:21.643777 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:21.666647 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b705a-2b9f-4a91-a6f7-dbb2434af970 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:21.670080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ece4ea9a-32b4-43b0-9db0-75b3ccf4d62f None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:21.671738 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ece4ea9a-32b4-43b0-9db0-75b3ccf4d62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:21.691270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:21.771309 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:42:21.772231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b705a-2b9f-4a91-a6f7-dbb2434af970 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:21.792871 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4ea9a-32b4-43b0-9db0-75b3ccf4d62f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:21.806006 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8b6b0-edbc-49b1-b038-406ada3d8ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:21.806647 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8b6b0-edbc-49b1-b038-406ada3d8ceb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:21.806966 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8b6b0-edbc-49b1-b038-406ada3d8ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:21.807245 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8b6b0-edbc-49b1-b038-406ada3d8ceb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:21.819051 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8b6b0-edbc-49b1-b038-406ada3d8ceb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:21.827726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-d7a8b6b0-edbc-49b1-b038-406ada3d8ceb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:42:21.827726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:21.827726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:21.827726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:21.827726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:21.827726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:21.827726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:21.827726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:21.827726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:21.827726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:21.827726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:21.827726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:21.827726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:21.827726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:21.827726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:21.827726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:21.829280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:21.829280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:21.829280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:21.829280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:21.829280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:21.829280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:21.829280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:21.829280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:21.829280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:21.829280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:21.829280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:21.829280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:21.829280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:21.829280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:21.829280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:21.829280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:21.830148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:21.830148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:21.830148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:21.830148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:21.830148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:21.830148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:21.830148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:21.830148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:21.830148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:21.830148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:21.830148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:42:21.830148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:42:21.830148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 7/14] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:42:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:42:21.835819 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8b6b0-edbc-49b1-b038-406ada3d8ceb None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:21.894715 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4ea9a-32b4-43b0-9db0-75b3ccf4d62f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:21.897015 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:21.916553 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:21.931560 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd574a2-c8fb-4421-9d2c-7d9a3db9c752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:21.932501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd574a2-c8fb-4421-9d2c-7d9a3db9c752 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:21.932801 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd574a2-c8fb-4421-9d2c-7d9a3db9c752 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:21.933079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd574a2-c8fb-4421-9d2c-7d9a3db9c752 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:21.934363 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8b6b0-edbc-49b1-b038-406ada3d8ceb None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:21.967323 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d86bc-eb42-41e5-b2ad-0ebb682b7cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:21.967938 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d86bc-eb42-41e5-b2ad-0ebb682b7cae None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:21.968397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d86bc-eb42-41e5-b2ad-0ebb682b7cae None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:21.968909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d86bc-eb42-41e5-b2ad-0ebb682b7cae None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:21.969587 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d86bc-eb42-41e5-b2ad-0ebb682b7cae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:21.970300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d86bc-eb42-41e5-b2ad-0ebb682b7cae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:21.971719 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d86bc-eb42-41e5-b2ad-0ebb682b7cae None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:21.983139 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 8/15] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:42:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:21.989653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d86bc-eb42-41e5-b2ad-0ebb682b7cae None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:22.001904 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd574a2-c8fb-4421-9d2c-7d9a3db9c752 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:22.003628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd574a2-c8fb-4421-9d2c-7d9a3db9c752 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:22.111441 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 8/16] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:42:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 10:42:22.117393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd574a2-c8fb-4421-9d2c-7d9a3db9c752 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:22.121640 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:22.196830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d86bc-eb42-41e5-b2ad-0ebb682b7cae None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:22.220148 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd574a2-c8fb-4421-9d2c-7d9a3db9c752 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:22.230651 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674d96b-032b-4258-801d-b9177a0feb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:22.231298 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674d96b-032b-4258-801d-b9177a0feb97 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:22.231577 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674d96b-032b-4258-801d-b9177a0feb97 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:22.231848 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674d96b-032b-4258-801d-b9177a0feb97 None admin] PATH_INFO: `/v3/users/94631e4d22874dba849ec3d0cdff5210` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:22.232974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674d96b-032b-4258-801d-b9177a0feb97 None admin] RBAC: Authorizing `identity:get_user(user_id=94631e4d22874dba849ec3d0cdff5210)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:22.234734 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674d96b-032b-4258-801d-b9177a0feb97 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:22.236298 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 9/17] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:21 2022] GET /identity/v3/users/94631e4d22874dba849ec3d0cdff5210 => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:22.241845 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674d96b-032b-4258-801d-b9177a0feb97 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:22.253759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b3941-e218-4442-b048-cd64eefe4d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:22.254619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b3941-e218-4442-b048-cd64eefe4d95 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:22.254941 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b3941-e218-4442-b048-cd64eefe4d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:22.255221 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b3941-e218-4442-b048-cd64eefe4d95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:22.256725 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:22.274111 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b3941-e218-4442-b048-cd64eefe4d95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:22.275633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b3941-e218-4442-b048-cd64eefe4d95 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:22.293600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-142b3941-e218-4442-b048-cd64eefe4d95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:42:22.293600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:22.293600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:22.293600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:22.293600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:22.293600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:22.293600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:22.293600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:22.293600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:22.293600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:22.293600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:22.293600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:22.293600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:42:22.293600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:42:22.293600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:42:22.293600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:42:22.294470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:22.294470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:22.294470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:22.294470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:22.294470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:22.294470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:22.294470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:22.294470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:22.294470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:22.294470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:22.294470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:22.294470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:22.294470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:22.294470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:22.294470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:22.294470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:22.294470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:42:22.295278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:42:22.295278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:42:22.295278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:42:22.295278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 9/18] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:42:22.300594 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b3941-e218-4442-b048-cd64eefe4d95 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:22.344993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674d96b-032b-4258-801d-b9177a0feb97 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:22.356083 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:22.378725 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13866542-bc6c-4827-98ec-b4f755d7a29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:22.379335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13866542-bc6c-4827-98ec-b4f755d7a29c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:22.379613 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13866542-bc6c-4827-98ec-b4f755d7a29c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:22.379884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13866542-bc6c-4827-98ec-b4f755d7a29c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:22.381001 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13866542-bc6c-4827-98ec-b4f755d7a29c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:22.382450 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13866542-bc6c-4827-98ec-b4f755d7a29c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:22.384019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 10/19] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:42:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:22.389736 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13866542-bc6c-4827-98ec-b4f755d7a29c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:22.399382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b3941-e218-4442-b048-cd64eefe4d95 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:22.433261 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dcfc4-39cb-4de9-a8d1-76ab7686266d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:22.433869 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dcfc4-39cb-4de9-a8d1-76ab7686266d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:22.434147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dcfc4-39cb-4de9-a8d1-76ab7686266d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:22.434419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dcfc4-39cb-4de9-a8d1-76ab7686266d None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:22.435093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dcfc4-39cb-4de9-a8d1-76ab7686266d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:22.435397 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dcfc4-39cb-4de9-a8d1-76ab7686266d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:22.436775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39dcfc4-39cb-4de9-a8d1-76ab7686266d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:22.454996 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 10/20] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:22.472792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:22.493099 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13866542-bc6c-4827-98ec-b4f755d7a29c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:22.529715 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c96b24-a417-44dc-bffc-a71b17726baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:22.530334 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c96b24-a417-44dc-bffc-a71b17726baf None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:22.530611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c96b24-a417-44dc-bffc-a71b17726baf None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:22.530919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c96b24-a417-44dc-bffc-a71b17726baf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:22.531748 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c96b24-a417-44dc-bffc-a71b17726baf None admin] RBAC: Adding query filter params (role.id=00c6de5dd6cd4267ba05941ddb91e6ad, scope.domain.id=default, user.id=94631e4d22874dba849ec3d0cdff5210) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:22.532055 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c96b24-a417-44dc-bffc-a71b17726baf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:22.533552 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c96b24-a417-44dc-bffc-a71b17726baf None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:22.540940 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 11/21] 10.222.0.43 () {56 vars in 1322 bytes} [Thu Aug 11 10:42:22 2022] GET /identity/v3/role_assignments?user.id=94631e4d22874dba849ec3d0cdff5210&scope.domain.id=default&role.id=00c6de5dd6cd4267ba05941ddb91e6ad => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:24.853638 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed65d2c-0058-45ee-b2fb-5e9709072291 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:24.854683 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed65d2c-0058-45ee-b2fb-5e9709072291 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:24.855231 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed65d2c-0058-45ee-b2fb-5e9709072291 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:24.857081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 11/22] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:24.862698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf6cba-edcc-4fe9-b482-fd56e3cbbc79 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:24.863536 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf6cba-edcc-4fe9-b482-fd56e3cbbc79 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:24.864044 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf6cba-edcc-4fe9-b482-fd56e3cbbc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:24.883446 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-37cf6cba-edcc-4fe9-b482-fd56e3cbbc79 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:24.884960 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-37cf6cba-edcc-4fe9-b482-fd56e3cbbc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:24.977476 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 12/23] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:25.011316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed65d2c-0058-45ee-b2fb-5e9709072291 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:25.158484 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3ad3c-c8cd-4def-9aa5-71267148f1a5 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:25.159168 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3ad3c-c8cd-4def-9aa5-71267148f1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:25.159651 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3ad3c-c8cd-4def-9aa5-71267148f1a5 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:25.161660 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:25.166985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d497591-ab64-4e02-9f93-f425fa628caf None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:25.167564 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d497591-ab64-4e02-9f93-f425fa628caf None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:25.168040 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d497591-ab64-4e02-9f93-f425fa628caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:25.173220 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed65d2c-0058-45ee-b2fb-5e9709072291 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:25.194704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:25.197360 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4d497591-ab64-4e02-9f93-f425fa628caf None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:25.198826 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4d497591-ab64-4e02-9f93-f425fa628caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:25.229940 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07220d-86e2-4073-b337-ab6d21eed6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:25.230593 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07220d-86e2-4073-b337-ab6d21eed6eb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:25.232817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07220d-86e2-4073-b337-ab6d21eed6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:25.233101 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07220d-86e2-4073-b337-ab6d21eed6eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:25.253078 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07220d-86e2-4073-b337-ab6d21eed6eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:25.326295 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 14/25] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:42:25.327613 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b4519-1ee1-445f-82d9-4274e5602398 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:25.328001 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b4519-1ee1-445f-82d9-4274e5602398 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:25.328277 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b4519-1ee1-445f-82d9-4274e5602398 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:25.329528 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 15/26] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:25.335784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf69e68-e45c-4d80-a301-b2a8adb6a700 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:25.336219 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf69e68-e45c-4d80-a301-b2a8adb6a700 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:25.336597 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf69e68-e45c-4d80-a301-b2a8adb6a700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:25.358085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:25.367882 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-bcf69e68-e45c-4d80-a301-b2a8adb6a700 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:25.390041 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-bcf69e68-e45c-4d80-a301-b2a8adb6a700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:25.391474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-7d07220d-86e2-4073-b337-ab6d21eed6eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:42:25.391474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:25.391474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:25.391474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:25.391474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:25.391474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:25.391474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:25.391474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:25.391474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:25.391474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:25.391474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:25.391474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:25.391474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:25.391474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:25.391474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:25.391474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:25.392270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:25.392270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:25.392270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:25.392270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:25.392270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:25.392270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:25.392270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:25.392270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:25.392270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:25.392270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:25.392270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:25.392270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:25.392270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:25.392270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:25.392270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:25.392270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:25.392997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:25.392997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:25.392997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:25.392997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:25.392997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:25.392997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:25.392997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:25.392997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:25.392997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:25.392997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:25.392997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:42:25.392997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:42:25.392997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 12/27] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:42:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:42:25.393680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07220d-86e2-4073-b337-ab6d21eed6eb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:25.497726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 16/28] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:42:25.498749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf69e68-e45c-4d80-a301-b2a8adb6a700 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:25.516621 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07220d-86e2-4073-b337-ab6d21eed6eb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:25.561286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9724c7-07c3-4f4f-91a0-0e03e2cefac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:25.561904 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9724c7-07c3-4f4f-91a0-0e03e2cefac6 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:25.562804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9724c7-07c3-4f4f-91a0-0e03e2cefac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:25.563094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9724c7-07c3-4f4f-91a0-0e03e2cefac6 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:25.564029 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9724c7-07c3-4f4f-91a0-0e03e2cefac6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:25.566041 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9724c7-07c3-4f4f-91a0-0e03e2cefac6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:25.628744 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf69e68-e45c-4d80-a301-b2a8adb6a700 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:25.666022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4174bc8-9a96-4cbb-8b33-7d1877017c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:25.666883 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4174bc8-9a96-4cbb-8b33-7d1877017c5e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:25.667308 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4174bc8-9a96-4cbb-8b33-7d1877017c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:25.667784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4174bc8-9a96-4cbb-8b33-7d1877017c5e None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:25.668651 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4174bc8-9a96-4cbb-8b33-7d1877017c5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:25.669106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4174bc8-9a96-4cbb-8b33-7d1877017c5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:25.670784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4174bc8-9a96-4cbb-8b33-7d1877017c5e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:25.672704 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:25.680533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 17/29] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:42:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:25.681749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bf50c-7c4b-4b09-9e9c-1421a87f810a None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:25.682098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bf50c-7c4b-4b09-9e9c-1421a87f810a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:25.682548 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bf50c-7c4b-4b09-9e9c-1421a87f810a None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:25.683785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 18/30] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:25.688980 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bf50c-7c4b-4b09-9e9c-1421a87f810a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:25.802862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bf50c-7c4b-4b09-9e9c-1421a87f810a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:25.829203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 13/31] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Aug 11 10:42:25 2022] POST /identity/v3/roles => generated 225 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:42:25.830286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9724c7-07c3-4f4f-91a0-0e03e2cefac6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:25.846735 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fcc1a-008d-4dcf-85b3-889443de26ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:25.848250 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fcc1a-008d-4dcf-85b3-889443de26ca None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:25.848761 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fcc1a-008d-4dcf-85b3-889443de26ca None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:25.849514 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fcc1a-008d-4dcf-85b3-889443de26ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:25.867141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fcc1a-008d-4dcf-85b3-889443de26ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:25.870362 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fcc1a-008d-4dcf-85b3-889443de26ca None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:25.878288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:25.894389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-3c8fcc1a-008d-4dcf-85b3-889443de26ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:42:25.894389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:25.894389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:25.894389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:25.894389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:25.894389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:25.894389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:25.894389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:25.894389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:25.894389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:25.894389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:25.894389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:25.894389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:42:25.894389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:42:25.894389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:42:25.894389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:42:25.895335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:25.895335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:25.895335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:25.895335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:25.895335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:25.895335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:25.895335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:25.895335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:25.895335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:25.895335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:25.895335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:25.895335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:25.895335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:25.895335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:25.895335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:25.895335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:25.895335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:42:25.896111 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:42:25.896111 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:42:25.896111 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:42:25.897792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 19/32] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:42:25.903623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825af10-15b3-4e3f-af4d-398293c7078a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:25.904180 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825af10-15b3-4e3f-af4d-398293c7078a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:25.904661 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825af10-15b3-4e3f-af4d-398293c7078a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:25.939995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f825af10-15b3-4e3f-af4d-398293c7078a None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:25.941210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f825af10-15b3-4e3f-af4d-398293c7078a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:25.961311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9724c7-07c3-4f4f-91a0-0e03e2cefac6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:26.009019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f159708-e7a2-4667-bf8e-f6927cda029f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:26.009910 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f159708-e7a2-4667-bf8e-f6927cda029f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:26.010327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f159708-e7a2-4667-bf8e-f6927cda029f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:26.010686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f159708-e7a2-4667-bf8e-f6927cda029f None admin] PATH_INFO: `/v3/users/94631e4d22874dba849ec3d0cdff5210` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:26.012615 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f159708-e7a2-4667-bf8e-f6927cda029f None admin] RBAC: Authorizing `identity:get_user(user_id=94631e4d22874dba849ec3d0cdff5210)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:26.014362 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f159708-e7a2-4667-bf8e-f6927cda029f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:26.016604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 14/33] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:25 2022] GET /identity/v3/users/94631e4d22874dba849ec3d0cdff5210 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:26.017146 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f159708-e7a2-4667-bf8e-f6927cda029f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:26.066346 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:26.093150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 20/34] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:26.099529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825af10-15b3-4e3f-af4d-398293c7078a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:26.139188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f159708-e7a2-4667-bf8e-f6927cda029f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:26.142481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:26.177046 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45138e10-b2ce-4764-b8d6-0285b481ad38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:26.177863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45138e10-b2ce-4764-b8d6-0285b481ad38 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:26.178446 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45138e10-b2ce-4764-b8d6-0285b481ad38 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:26.178598 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45138e10-b2ce-4764-b8d6-0285b481ad38 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:26.179391 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45138e10-b2ce-4764-b8d6-0285b481ad38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:26.179799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45138e10-b2ce-4764-b8d6-0285b481ad38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:26.181304 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45138e10-b2ce-4764-b8d6-0285b481ad38 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:26.196547 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 15/35] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:26.197545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45138e10-b2ce-4764-b8d6-0285b481ad38 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:26.245165 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825af10-15b3-4e3f-af4d-398293c7078a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:26.291706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891b547-171f-448a-b3b1-15a2c8711858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:26.292358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891b547-171f-448a-b3b1-15a2c8711858 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:26.292638 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891b547-171f-448a-b3b1-15a2c8711858 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:26.293013 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891b547-171f-448a-b3b1-15a2c8711858 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:26.294233 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891b547-171f-448a-b3b1-15a2c8711858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:26.295939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891b547-171f-448a-b3b1-15a2c8711858 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:26.299166 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 21/36] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:42:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:26.300109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891b547-171f-448a-b3b1-15a2c8711858 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:26.314007 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45138e10-b2ce-4764-b8d6-0285b481ad38 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:26.349749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3f6f0-7e67-4e90-bb65-03285d8535e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:26.350364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3f6f0-7e67-4e90-bb65-03285d8535e1 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:26.350644 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3f6f0-7e67-4e90-bb65-03285d8535e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:26.350947 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3f6f0-7e67-4e90-bb65-03285d8535e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:26.351616 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3f6f0-7e67-4e90-bb65-03285d8535e1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:26.352993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3f6f0-7e67-4e90-bb65-03285d8535e1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:26.356594 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:26.410926 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891b547-171f-448a-b3b1-15a2c8711858 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:26.428134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 16/37] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Aug 11 10:42:26 2022] POST /identity/v3/roles => generated 219 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:42:26.429918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59642ee5-b0fe-43d3-974d-21c1a6826c79 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:26.430250 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59642ee5-b0fe-43d3-974d-21c1a6826c79 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:26.430602 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59642ee5-b0fe-43d3-974d-21c1a6826c79 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:26.436055 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 17/38] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:26.436055 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59642ee5-b0fe-43d3-974d-21c1a6826c79 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:26.459953 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1ab8e-ca1e-446a-96d6-728e136ff87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:26.462666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1ab8e-ca1e-446a-96d6-728e136ff87e None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:26.462666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1ab8e-ca1e-446a-96d6-728e136ff87e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:26.462666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1ab8e-ca1e-446a-96d6-728e136ff87e None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:26.462666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1ab8e-ca1e-446a-96d6-728e136ff87e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:26.463316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1ab8e-ca1e-446a-96d6-728e136ff87e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:26.466479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:26.549332 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59642ee5-b0fe-43d3-974d-21c1a6826c79 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:26.585476 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609221ab-80e1-416c-850d-358a33c100ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:26.586310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609221ab-80e1-416c-850d-358a33c100ec None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:26.586600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609221ab-80e1-416c-850d-358a33c100ec None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:26.586912 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609221ab-80e1-416c-850d-358a33c100ec None admin] PATH_INFO: `/v3/domains/default/users/94631e4d22874dba849ec3d0cdff5210/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:26.589151 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609221ab-80e1-416c-850d-358a33c100ec None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=94631e4d22874dba849ec3d0cdff5210, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:26.590633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609221ab-80e1-416c-850d-358a33c100ec None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:26.687064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 18/39] 10.222.0.43 () {58 vars in 1361 bytes} [Thu Aug 11 10:42:26 2022] PUT /identity/v3/domains/default/users/94631e4d22874dba849ec3d0cdff5210/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:42:26.689227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c993500-581f-4209-9010-031422f4d2b3 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:26.689524 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c993500-581f-4209-9010-031422f4d2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:26.689809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c993500-581f-4209-9010-031422f4d2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:26.697228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 22/40] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Aug 11 10:42:26 2022] POST /identity/v3/projects => generated 301 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:42:26.698586 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91030440-09f0-48f1-a129-c6783b47c639 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:26.698919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91030440-09f0-48f1-a129-c6783b47c639 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:26.699205 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91030440-09f0-48f1-a129-c6783b47c639 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:26.702083 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 23/41] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:26.707707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58148b8c-176c-46ab-8f91-69f9c7c839d1 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:26.708026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58148b8c-176c-46ab-8f91-69f9c7c839d1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:26.708274 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58148b8c-176c-46ab-8f91-69f9c7c839d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:26.734788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-58148b8c-176c-46ab-8f91-69f9c7c839d1 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:26.735175 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6c993500-581f-4209-9010-031422f4d2b3 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:26.736524 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-58148b8c-176c-46ab-8f91-69f9c7c839d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:26.737312 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6c993500-581f-4209-9010-031422f4d2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:26.823319 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 24/42] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:42:26.842791 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 19/43] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:26.849450 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58148b8c-176c-46ab-8f91-69f9c7c839d1 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:26.868523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c993500-581f-4209-9010-031422f4d2b3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:26.883687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:26.888168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:26.981305 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58148b8c-176c-46ab-8f91-69f9c7c839d1 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:26.992484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c993500-581f-4209-9010-031422f4d2b3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:27.020666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32316b-a7ec-4b08-bedb-915b834e1213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:27.021385 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32316b-a7ec-4b08-bedb-915b834e1213 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:27.021732 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32316b-a7ec-4b08-bedb-915b834e1213 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:27.022093 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32316b-a7ec-4b08-bedb-915b834e1213 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:27.022877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32316b-a7ec-4b08-bedb-915b834e1213 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:27.024484 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32316b-a7ec-4b08-bedb-915b834e1213 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:27.033888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380a6e7-1e01-46f5-9015-f01c070af159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:27.034544 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380a6e7-1e01-46f5-9015-f01c070af159 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:27.034848 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380a6e7-1e01-46f5-9015-f01c070af159 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:27.035125 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380a6e7-1e01-46f5-9015-f01c070af159 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:27.036772 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380a6e7-1e01-46f5-9015-f01c070af159 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:27.038289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380a6e7-1e01-46f5-9015-f01c070af159 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:27.039963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 20/44] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:42:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:27.045616 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380a6e7-1e01-46f5-9015-f01c070af159 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:27.100372 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 25/45] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Aug 11 10:42:26 2022] POST /identity/v3/roles => generated 223 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:42:27.138905 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:27.158960 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380a6e7-1e01-46f5-9015-f01c070af159 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:27.197888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac75df9-73fd-4226-b8f2-e5fc3e8254e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:27.198720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac75df9-73fd-4226-b8f2-e5fc3e8254e4 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:27.198835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac75df9-73fd-4226-b8f2-e5fc3e8254e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:27.199099 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac75df9-73fd-4226-b8f2-e5fc3e8254e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:27.199759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac75df9-73fd-4226-b8f2-e5fc3e8254e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:27.201233 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac75df9-73fd-4226-b8f2-e5fc3e8254e4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:27.278948 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 21/46] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Aug 11 10:42:27 2022] POST /identity/v3/projects => generated 312 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:42:28.753854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334d2fc-0df7-4773-a8f4-a724882e7e38 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:28.754367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334d2fc-0df7-4773-a8f4-a724882e7e38 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:28.754450 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334d2fc-0df7-4773-a8f4-a724882e7e38 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:28.755787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 26/47] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:28.760982 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736ebc7-cbc9-4e29-a763-d60358afa0ed None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:28.761352 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736ebc7-cbc9-4e29-a763-d60358afa0ed None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:28.761686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b736ebc7-cbc9-4e29-a763-d60358afa0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:28.779891 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b736ebc7-cbc9-4e29-a763-d60358afa0ed None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:28.781416 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b736ebc7-cbc9-4e29-a763-d60358afa0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:28.847159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 22/48] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:28.870009 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334d2fc-0df7-4773-a8f4-a724882e7e38 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:28.957897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:28.971169 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334d2fc-0df7-4773-a8f4-a724882e7e38 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:29.005362 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8f94f-7e14-4e41-bedd-23b2970e3f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:29.005900 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8f94f-7e14-4e41-bedd-23b2970e3f24 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:29.006178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8f94f-7e14-4e41-bedd-23b2970e3f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:29.006449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8f94f-7e14-4e41-bedd-23b2970e3f24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:29.016565 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8f94f-7e14-4e41-bedd-23b2970e3f24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:29.021280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-84b8f94f-7e14-4e41-bedd-23b2970e3f24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:42:29.021280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:29.021280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:29.021280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:29.021280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:29.021280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:29.021280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:29.021280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:29.021280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:29.021280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:29.021280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:29.021280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:29.021280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:29.021280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:29.021280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:29.021280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:29.022107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:29.022107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:29.022107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:29.022107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:29.022107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:29.022107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:29.022107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:29.022107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:29.022107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:29.022107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:29.022107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:29.022107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:29.022107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:29.022107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:29.022107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:29.022107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:29.022889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:29.022889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:29.022889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:29.022889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:29.022889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:29.022889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:29.022889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:29.022889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:29.022889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:29.022889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:29.022889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:42:29.022889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:42:29.022889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 27/49] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:42:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:42:29.029866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736ebc7-cbc9-4e29-a763-d60358afa0ed None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:29.092764 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:29.132058 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b736ebc7-cbc9-4e29-a763-d60358afa0ed None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:29.166834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32bdc6-292d-4402-bcfa-944f57deb7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:29.167458 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32bdc6-292d-4402-bcfa-944f57deb7fc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:29.167744 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32bdc6-292d-4402-bcfa-944f57deb7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:29.168023 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32bdc6-292d-4402-bcfa-944f57deb7fc None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:29.168694 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32bdc6-292d-4402-bcfa-944f57deb7fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:29.169001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32bdc6-292d-4402-bcfa-944f57deb7fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:29.170389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32bdc6-292d-4402-bcfa-944f57deb7fc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:29.182670 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 23/50] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:42:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:29.188436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8f94f-7e14-4e41-bedd-23b2970e3f24 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:29.285367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8f94f-7e14-4e41-bedd-23b2970e3f24 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:29.298647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f04c4-f598-44bc-b64d-51d0d4ff491d None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:29.298990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f04c4-f598-44bc-b64d-51d0d4ff491d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:29.299271 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f04c4-f598-44bc-b64d-51d0d4ff491d None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:29.300610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 24/51] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:42:29.305429 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77672adb-9981-4082-96c3-c9fd3e9019ef None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:29.305716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77672adb-9981-4082-96c3-c9fd3e9019ef None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:29.305994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77672adb-9981-4082-96c3-c9fd3e9019ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:29.319543 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651f428-d4a6-46ea-a003-5b17b73b45b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:29.320178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651f428-d4a6-46ea-a003-5b17b73b45b0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:29.320461 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651f428-d4a6-46ea-a003-5b17b73b45b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:29.320739 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1651f428-d4a6-46ea-a003-5b17b73b45b0 None admin] PATH_INFO: `/v3/users/94631e4d22874dba849ec3d0cdff5210` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:29.321868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651f428-d4a6-46ea-a003-5b17b73b45b0 None admin] RBAC: Authorizing `identity:get_user(user_id=94631e4d22874dba849ec3d0cdff5210)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:29.323357 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1651f428-d4a6-46ea-a003-5b17b73b45b0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:29.323637 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-77672adb-9981-4082-96c3-c9fd3e9019ef None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:29.324822 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-77672adb-9981-4082-96c3-c9fd3e9019ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:29.324930 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 28/52] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:29 2022] GET /identity/v3/users/94631e4d22874dba849ec3d0cdff5210 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:29.330632 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651f428-d4a6-46ea-a003-5b17b73b45b0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:29.348602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:29.393736 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 25/53] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:42:29.415898 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77672adb-9981-4082-96c3-c9fd3e9019ef None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:29.427947 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1651f428-d4a6-46ea-a003-5b17b73b45b0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:29.461595 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a32b6-82cf-455e-bce6-663d6726bbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:29.462236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a32b6-82cf-455e-bce6-663d6726bbe4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:29.462520 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a32b6-82cf-455e-bce6-663d6726bbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:29.462820 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a32b6-82cf-455e-bce6-663d6726bbe4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:29.463932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a32b6-82cf-455e-bce6-663d6726bbe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:29.465410 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a32b6-82cf-455e-bce6-663d6726bbe4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:29.467004 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 29/54] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:42:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:29.470538 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:29.472833 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a32b6-82cf-455e-bce6-663d6726bbe4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:29.513956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77672adb-9981-4082-96c3-c9fd3e9019ef None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:29.547080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8231df-6ade-4db5-b94b-74817cc5fff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:29.547726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8231df-6ade-4db5-b94b-74817cc5fff6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:29.548012 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8231df-6ade-4db5-b94b-74817cc5fff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:29.548289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8231df-6ade-4db5-b94b-74817cc5fff6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:29.549406 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8231df-6ade-4db5-b94b-74817cc5fff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:29.550897 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8231df-6ade-4db5-b94b-74817cc5fff6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:29.552448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 26/55] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:42:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:29.555462 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:29.558113 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8231df-6ade-4db5-b94b-74817cc5fff6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:29.571591 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a32b6-82cf-455e-bce6-663d6726bbe4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:29.604539 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b59e9b-b291-4511-b0a1-ba8db2ab88f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:29.605142 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b59e9b-b291-4511-b0a1-ba8db2ab88f1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:29.605434 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b59e9b-b291-4511-b0a1-ba8db2ab88f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:29.605709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b59e9b-b291-4511-b0a1-ba8db2ab88f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:29.606433 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b59e9b-b291-4511-b0a1-ba8db2ab88f1 None admin] RBAC: Adding query filter params (role.id=00c6de5dd6cd4267ba05941ddb91e6ad, scope.domain.id=default, user.id=94631e4d22874dba849ec3d0cdff5210) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:29.606739 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b59e9b-b291-4511-b0a1-ba8db2ab88f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:29.608219 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b59e9b-b291-4511-b0a1-ba8db2ab88f1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:29.614716 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 30/56] 10.222.0.43 () {56 vars in 1322 bytes} [Thu Aug 11 10:42:29 2022] GET /identity/v3/role_assignments?user.id=94631e4d22874dba849ec3d0cdff5210&scope.domain.id=default&role.id=00c6de5dd6cd4267ba05941ddb91e6ad => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:29.663634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8231df-6ade-4db5-b94b-74817cc5fff6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:29.688928 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:29.700071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a99616-eb2c-4cb2-b133-75bd6d59ff9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:29.700700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a99616-eb2c-4cb2-b133-75bd6d59ff9b None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:29.700983 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a99616-eb2c-4cb2-b133-75bd6d59ff9b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:29.701261 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a99616-eb2c-4cb2-b133-75bd6d59ff9b None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:29.701916 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a99616-eb2c-4cb2-b133-75bd6d59ff9b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:29.704125 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a99616-eb2c-4cb2-b133-75bd6d59ff9b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:29.833794 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 27/57] 10.222.0.43 () {60 vars in 1140 bytes} [Thu Aug 11 10:42:29 2022] POST /identity/v3/projects => generated 298 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:42:31.830665 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9482e7d-0dcc-4643-9707-6e0ff543a334 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:31.831210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9482e7d-0dcc-4643-9707-6e0ff543a334 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:31.831323 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9482e7d-0dcc-4643-9707-6e0ff543a334 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:31.832577 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 31/58] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:31.837927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35826cc9-1063-4d3a-988c-8dc0a9770a19 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:31.838357 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35826cc9-1063-4d3a-988c-8dc0a9770a19 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:31.838492 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35826cc9-1063-4d3a-988c-8dc0a9770a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:31.856685 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-35826cc9-1063-4d3a-988c-8dc0a9770a19 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:31.857885 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-35826cc9-1063-4d3a-988c-8dc0a9770a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:31.922615 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 28/59] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:31.946203 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9482e7d-0dcc-4643-9707-6e0ff543a334 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:32.044826 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9482e7d-0dcc-4643-9707-6e0ff543a334 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:32.077154 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8193f-464e-4a48-ae13-7f12b58172d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:32.078363 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8193f-464e-4a48-ae13-7f12b58172d8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:32.078638 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8193f-464e-4a48-ae13-7f12b58172d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:32.078936 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8193f-464e-4a48-ae13-7f12b58172d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:32.080025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8193f-464e-4a48-ae13-7f12b58172d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:32.081517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8193f-464e-4a48-ae13-7f12b58172d8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:32.083031 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 32/60] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:42:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:32.088692 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35826cc9-1063-4d3a-988c-8dc0a9770a19 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:32.184371 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35826cc9-1063-4d3a-988c-8dc0a9770a19 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:32.192179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:32.217882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ec229-ddb2-4307-8468-8e8fd95c63e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:32.218627 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ec229-ddb2-4307-8468-8e8fd95c63e6 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:32.218939 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ec229-ddb2-4307-8468-8e8fd95c63e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:32.219222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ec229-ddb2-4307-8468-8e8fd95c63e6 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:32.219870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ec229-ddb2-4307-8468-8e8fd95c63e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:32.221371 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ec229-ddb2-4307-8468-8e8fd95c63e6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:32.349263 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 29/61] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Aug 11 10:42:32 2022] POST /identity/v3/users => generated 275 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:42:35.469733 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e986f-a341-4735-b66f-a3b4a31cc527 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:35.470590 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e986f-a341-4735-b66f-a3b4a31cc527 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:35.471023 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e986f-a341-4735-b66f-a3b4a31cc527 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:35.472792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 33/62] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:35.477674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f59e41-8b7c-4b7b-8b61-8429bda5d63d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:35.478492 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f59e41-8b7c-4b7b-8b61-8429bda5d63d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:35.478943 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f59e41-8b7c-4b7b-8b61-8429bda5d63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:35.507804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-32f59e41-8b7c-4b7b-8b61-8429bda5d63d None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:35.509234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-32f59e41-8b7c-4b7b-8b61-8429bda5d63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:35.593289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 30/63] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:35.628244 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e986f-a341-4735-b66f-a3b4a31cc527 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:35.654081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c7e8-12f9-493f-8ff4-ff7ce1b0a60a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:35.654584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c7e8-12f9-493f-8ff4-ff7ce1b0a60a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:35.655015 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c7e8-12f9-493f-8ff4-ff7ce1b0a60a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:35.655426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:35.656673 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 31/64] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:42:35.661769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e369f-db1b-4109-812b-604b3c659b27 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:35.662215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e369f-db1b-4109-812b-604b3c659b27 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:35.662629 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e369f-db1b-4109-812b-604b3c659b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:35.695917 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ab3e369f-db1b-4109-812b-604b3c659b27 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:35.697340 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ab3e369f-db1b-4109-812b-604b3c659b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:35.747387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e986f-a341-4735-b66f-a3b4a31cc527 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:35.784693 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2f4e9-6936-4821-a1ab-748b4ad43b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:35.785899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2f4e9-6936-4821-a1ab-748b4ad43b80 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:35.786385 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2f4e9-6936-4821-a1ab-748b4ad43b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:35.786880 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2f4e9-6936-4821-a1ab-748b4ad43b80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:35.806747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2f4e9-6936-4821-a1ab-748b4ad43b80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:35.815868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-5ce2f4e9-6936-4821-a1ab-748b4ad43b80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:42:35.815868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:35.815868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:35.815868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:35.815868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:35.815868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:35.815868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:35.815868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:35.815868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:35.815868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:35.815868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:35.815868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:35.815868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:35.815868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:35.815868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:35.815868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:35.816702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:35.816702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:35.816702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:35.816702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:35.816702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:35.816702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:35.816702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:35.816702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:35.816702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:35.816702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:35.816702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:35.816702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:35.816702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:35.816702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:35.816702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:35.816702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:35.817424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:35.817424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:35.817424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:35.817424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:35.817424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:35.817424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:35.817424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:35.817424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:35.817424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:35.817424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:35.817424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:42:35.817424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:42:35.821431 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 34/65] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:42:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:42:35.823527 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 32/66] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:42:35.827768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2f4e9-6936-4821-a1ab-748b4ad43b80 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:35.833703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9d524-212d-4078-b7b7-9cd05205824e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:35.833996 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9d524-212d-4078-b7b7-9cd05205824e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:35.834273 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9d524-212d-4078-b7b7-9cd05205824e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:35.835644 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 33/67] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:42:35.840552 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5cb5b-4703-47be-993c-c8becd522fa9 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:35.840994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5cb5b-4703-47be-993c-c8becd522fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:35.841438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5cb5b-4703-47be-993c-c8becd522fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:35.871473 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-aca5cb5b-4703-47be-993c-c8becd522fa9 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:35.872984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-aca5cb5b-4703-47be-993c-c8becd522fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:35.891363 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:35.916376 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:35.940992 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2f4e9-6936-4821-a1ab-748b4ad43b80 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:35.950218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 34/68] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:35.951729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5cb5b-4703-47be-993c-c8becd522fa9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:35.981831 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9bcaa-2d2a-4264-b267-c81232016d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:35.982452 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9bcaa-2d2a-4264-b267-c81232016d9c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:35.982740 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9bcaa-2d2a-4264-b267-c81232016d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:35.983075 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9bcaa-2d2a-4264-b267-c81232016d9c None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:35.984397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9bcaa-2d2a-4264-b267-c81232016d9c None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:35.984802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9bcaa-2d2a-4264-b267-c81232016d9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:35.986216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9bcaa-2d2a-4264-b267-c81232016d9c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:35.994996 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 35/69] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:42:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:35.996252 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a479629-978a-4f90-a45b-0abb96fcf1cb None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:35.996543 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a479629-978a-4f90-a45b-0abb96fcf1cb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:35.996823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a479629-978a-4f90-a45b-0abb96fcf1cb None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:35.998071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 36/70] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:35.998721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a479629-978a-4f90-a45b-0abb96fcf1cb None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:36.079146 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5cb5b-4703-47be-993c-c8becd522fa9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:36.115816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31062fc-bf83-46ee-b259-b8efbfcd1940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:36.116458 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31062fc-bf83-46ee-b259-b8efbfcd1940 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:36.116739 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31062fc-bf83-46ee-b259-b8efbfcd1940 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:36.117021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31062fc-bf83-46ee-b259-b8efbfcd1940 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:36.118144 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a479629-978a-4f90-a45b-0abb96fcf1cb None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:36.127506 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31062fc-bf83-46ee-b259-b8efbfcd1940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:36.132234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e31062fc-bf83-46ee-b259-b8efbfcd1940 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:42:36.132234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:36.132234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:36.132234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:36.132234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:36.132234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:36.132234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:36.132234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:36.132234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:36.132234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:36.132234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:36.132234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:36.132234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:36.132234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:36.132234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:36.132234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:36.133035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:36.133035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:36.133035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:36.133035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:36.133035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:36.133035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:36.133035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:36.133035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:36.133035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:36.133035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:36.133035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:36.133035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:36.133035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:36.133035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:36.133035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:36.133035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:36.133748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:36.133748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:36.133748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:36.133748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:36.133748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:36.133748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:36.133748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:36.133748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:36.133748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:36.133748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:36.133748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:42:36.133748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:42:36.133748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 35/71] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:42:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:42:36.138975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31062fc-bf83-46ee-b259-b8efbfcd1940 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:36.154130 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:36.157179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019799cf-57bb-4d3b-a1ab-b944297b7070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:36.157825 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019799cf-57bb-4d3b-a1ab-b944297b7070 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:36.158106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019799cf-57bb-4d3b-a1ab-b944297b7070 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:36.158442 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019799cf-57bb-4d3b-a1ab-b944297b7070 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:36.165391 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:36.170081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019799cf-57bb-4d3b-a1ab-b944297b7070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:36.175741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-019799cf-57bb-4d3b-a1ab-b944297b7070 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:42:36.175741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:36.175741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:36.175741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:36.175741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:36.175741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:36.175741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:36.175741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:36.175741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:36.175741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:36.175741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:36.175741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:36.175741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:36.175741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:36.175741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:36.175741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:36.176574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:36.176574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:36.176574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:36.176574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:36.176574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:36.176574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:36.176574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:36.176574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:36.176574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:36.176574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:36.176574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:36.176574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:36.176574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:36.176574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:36.176574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:36.176574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:36.177294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:36.177294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:36.177294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:36.177294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:36.177294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:36.177294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:36.177294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:36.177294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:36.177294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:36.177294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:36.177294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:42:36.177294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:42:36.177294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 37/72] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:42:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:42:36.180005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf776cfb-291c-4b47-bfa1-638d60d199d4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:36.180297 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf776cfb-291c-4b47-bfa1-638d60d199d4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:36.180582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf776cfb-291c-4b47-bfa1-638d60d199d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:36.198628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-bf776cfb-291c-4b47-bfa1-638d60d199d4 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:36.199846 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-bf776cfb-291c-4b47-bfa1-638d60d199d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:36.247378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31062fc-bf83-46ee-b259-b8efbfcd1940 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:36.267433 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 38/73] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:36.268206 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf776cfb-291c-4b47-bfa1-638d60d199d4 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:36.290115 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615500d7-a456-4e06-94c5-9e1214eaaa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:36.290752 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615500d7-a456-4e06-94c5-9e1214eaaa18 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:36.291066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615500d7-a456-4e06-94c5-9e1214eaaa18 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:36.291341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615500d7-a456-4e06-94c5-9e1214eaaa18 None admin] PATH_INFO: `/v3/users/d2ada0c204a84a70b855ffcb0dbe36d7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:36.307652 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615500d7-a456-4e06-94c5-9e1214eaaa18 None admin] RBAC: Authorizing `identity:get_user(user_id=d2ada0c204a84a70b855ffcb0dbe36d7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:36.309584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615500d7-a456-4e06-94c5-9e1214eaaa18 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:36.311284 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 36/74] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:36 2022] GET /identity/v3/users/d2ada0c204a84a70b855ffcb0dbe36d7 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:36.312234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615500d7-a456-4e06-94c5-9e1214eaaa18 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:36.366785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf776cfb-291c-4b47-bfa1-638d60d199d4 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:36.380354 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:36.393159 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:36.401010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad47225-4902-4b44-b4c4-106a866c60bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:36.401623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad47225-4902-4b44-b4c4-106a866c60bb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:36.401907 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad47225-4902-4b44-b4c4-106a866c60bb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:36.402182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad47225-4902-4b44-b4c4-106a866c60bb None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:36.402887 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad47225-4902-4b44-b4c4-106a866c60bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:36.403195 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad47225-4902-4b44-b4c4-106a866c60bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:36.404581 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad47225-4902-4b44-b4c4-106a866c60bb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:36.411621 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615500d7-a456-4e06-94c5-9e1214eaaa18 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:36.412711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 39/75] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:42:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:36.413889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff9cee-bbe1-4be0-817e-11747cdad2ad None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:36.414176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff9cee-bbe1-4be0-817e-11747cdad2ad None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:36.414453 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff9cee-bbe1-4be0-817e-11747cdad2ad None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:36.415718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 40/76] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:36.416420 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff9cee-bbe1-4be0-817e-11747cdad2ad None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:36.451581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a492d3f-fbe1-4e23-a143-d6a1911fac12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:36.452696 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a492d3f-fbe1-4e23-a143-d6a1911fac12 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:36.452974 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a492d3f-fbe1-4e23-a143-d6a1911fac12 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:36.453255 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a492d3f-fbe1-4e23-a143-d6a1911fac12 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:36.453928 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a492d3f-fbe1-4e23-a143-d6a1911fac12 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:36.454232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a492d3f-fbe1-4e23-a143-d6a1911fac12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:36.455654 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a492d3f-fbe1-4e23-a143-d6a1911fac12 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:36.463433 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 37/77] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:42:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:36.468627 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a492d3f-fbe1-4e23-a143-d6a1911fac12 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:36.518407 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff9cee-bbe1-4be0-817e-11747cdad2ad None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:36.552580 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a5e38-b23a-4508-9ef6-a7304f822eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:36.553282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a5e38-b23a-4508-9ef6-a7304f822eab None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:36.553642 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a5e38-b23a-4508-9ef6-a7304f822eab None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:36.553998 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a5e38-b23a-4508-9ef6-a7304f822eab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:36.563661 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a492d3f-fbe1-4e23-a143-d6a1911fac12 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:36.564378 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a5e38-b23a-4508-9ef6-a7304f822eab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:36.569073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-bd3a5e38-b23a-4508-9ef6-a7304f822eab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:42:36.569073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:36.569073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:36.569073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:36.569073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:36.569073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:36.569073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:36.569073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:36.569073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:36.569073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:36.569073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:36.569073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:36.569073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:36.569073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:36.569073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:36.569073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:36.569863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:36.569863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:36.569863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:36.569863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:36.569863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:36.569863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:36.569863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:36.569863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:36.569863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:36.569863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:36.569863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:36.569863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:36.569863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:36.569863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:36.569863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:36.569863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:36.570615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:36.570615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:36.570615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:36.570615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:36.570615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:36.570615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:36.570615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:36.570615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:36.570615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:36.570615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:36.570615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:42:36.570615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:42:36.570615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 41/78] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:42:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:42:36.571272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a5e38-b23a-4508-9ef6-a7304f822eab None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:36.593771 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:36.598540 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918de8f-66a9-41e5-bfab-0827954cdb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:36.599188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918de8f-66a9-41e5-bfab-0827954cdb90 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:36.599483 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918de8f-66a9-41e5-bfab-0827954cdb90 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:36.599766 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918de8f-66a9-41e5-bfab-0827954cdb90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:36.621511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:36.667869 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918de8f-66a9-41e5-bfab-0827954cdb90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:36.669371 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918de8f-66a9-41e5-bfab-0827954cdb90 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:36.670041 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a5e38-b23a-4508-9ef6-a7304f822eab None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:36.711636 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593e908-c229-41d7-a871-5be842d23f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:36.712268 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593e908-c229-41d7-a871-5be842d23f80 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:36.712551 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593e908-c229-41d7-a871-5be842d23f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:36.712828 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593e908-c229-41d7-a871-5be842d23f80 None admin] PATH_INFO: `/v3/users/94631e4d22874dba849ec3d0cdff5210` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:36.713958 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593e908-c229-41d7-a871-5be842d23f80 None admin] RBAC: Authorizing `identity:get_user(user_id=94631e4d22874dba849ec3d0cdff5210)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:36.715452 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593e908-c229-41d7-a871-5be842d23f80 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:36.717050 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 42/79] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:36 2022] GET /identity/v3/users/94631e4d22874dba849ec3d0cdff5210 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:36.720389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf2f1c-c641-45b9-b349-1f09b3587e51 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:36.720690 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf2f1c-c641-45b9-b349-1f09b3587e51 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:36.720967 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf2f1c-c641-45b9-b349-1f09b3587e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:36.738065 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-24cf2f1c-c641-45b9-b349-1f09b3587e51 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:36.739275 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-24cf2f1c-c641-45b9-b349-1f09b3587e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:36.768761 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 38/80] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:42:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:42:36.769558 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918de8f-66a9-41e5-bfab-0827954cdb90 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:36.802295 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:36.805948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 43/81] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:36.819021 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf2f1c-c641-45b9-b349-1f09b3587e51 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:36.854973 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:36.873412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918de8f-66a9-41e5-bfab-0827954cdb90 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:36.904780 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf2f1c-c641-45b9-b349-1f09b3587e51 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:36.909941 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a05e68-c8ea-4c6a-b4ce-f7d577ae1776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:36.910585 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a05e68-c8ea-4c6a-b4ce-f7d577ae1776 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:36.910904 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a05e68-c8ea-4c6a-b4ce-f7d577ae1776 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:36.911187 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a05e68-c8ea-4c6a-b4ce-f7d577ae1776 None admin] PATH_INFO: `/v3/users/d2ada0c204a84a70b855ffcb0dbe36d7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:36.912326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a05e68-c8ea-4c6a-b4ce-f7d577ae1776 None admin] RBAC: Authorizing `identity:get_user(user_id=d2ada0c204a84a70b855ffcb0dbe36d7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:36.913778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a05e68-c8ea-4c6a-b4ce-f7d577ae1776 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:36.915405 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 39/82] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:36 2022] GET /identity/v3/users/d2ada0c204a84a70b855ffcb0dbe36d7 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:36.916203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a05e68-c8ea-4c6a-b4ce-f7d577ae1776 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:36.945131 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427a3f3-6378-45b3-92dd-5730a52b4cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:36.945757 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427a3f3-6378-45b3-92dd-5730a52b4cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:36.946045 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427a3f3-6378-45b3-92dd-5730a52b4cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:36.946328 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427a3f3-6378-45b3-92dd-5730a52b4cb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:36.947028 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7427a3f3-6378-45b3-92dd-5730a52b4cb2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:36.947338 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7427a3f3-6378-45b3-92dd-5730a52b4cb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:36.948811 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7427a3f3-6378-45b3-92dd-5730a52b4cb2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:36.956948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 44/83] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:42:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:36.957738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427a3f3-6378-45b3-92dd-5730a52b4cb2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:37.013578 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:37.016898 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a05e68-c8ea-4c6a-b4ce-f7d577ae1776 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:37.051557 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874d2e3-2dad-4949-8a17-3f47b3703ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:37.052180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874d2e3-2dad-4949-8a17-3f47b3703ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:37.052467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874d2e3-2dad-4949-8a17-3f47b3703ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:37.052752 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874d2e3-2dad-4949-8a17-3f47b3703ca6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:37.058271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427a3f3-6378-45b3-92dd-5730a52b4cb2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:37.068969 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:37.091882 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e59f24-c7b6-4ba8-baad-a4ecfb863a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:37.092510 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e59f24-c7b6-4ba8-baad-a4ecfb863a2b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:37.092901 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e59f24-c7b6-4ba8-baad-a4ecfb863a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:37.093177 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e59f24-c7b6-4ba8-baad-a4ecfb863a2b None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:37.094399 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e59f24-c7b6-4ba8-baad-a4ecfb863a2b None admin] RBAC: Authorizing `identity:get_project(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:37.096019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e59f24-c7b6-4ba8-baad-a4ecfb863a2b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:37.097728 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 45/84] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:36 2022] GET /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:37.098494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e59f24-c7b6-4ba8-baad-a4ecfb863a2b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:37.126394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874d2e3-2dad-4949-8a17-3f47b3703ca6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:37.127960 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874d2e3-2dad-4949-8a17-3f47b3703ca6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:37.197393 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e59f24-c7b6-4ba8-baad-a4ecfb863a2b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:37.224313 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:37.228532 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 40/85] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:42:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:42:37.229190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874d2e3-2dad-4949-8a17-3f47b3703ca6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:37.236346 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa596a9-760a-48fa-87ac-495dd14bb8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:37.236988 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa596a9-760a-48fa-87ac-495dd14bb8db None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:37.237700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa596a9-760a-48fa-87ac-495dd14bb8db None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:37.237987 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa596a9-760a-48fa-87ac-495dd14bb8db None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:37.239143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa596a9-760a-48fa-87ac-495dd14bb8db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:37.240618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa596a9-760a-48fa-87ac-495dd14bb8db None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:37.242341 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 46/86] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:42:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:37.242970 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa596a9-760a-48fa-87ac-495dd14bb8db None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:37.290854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:37.327642 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874d2e3-2dad-4949-8a17-3f47b3703ca6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:37.342648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa596a9-760a-48fa-87ac-495dd14bb8db None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:37.362280 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80efc0d-01b8-48c4-9bc1-dc96fb34d7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:37.362926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80efc0d-01b8-48c4-9bc1-dc96fb34d7be None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:37.363216 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80efc0d-01b8-48c4-9bc1-dc96fb34d7be None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:37.363494 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80efc0d-01b8-48c4-9bc1-dc96fb34d7be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:37.377315 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c8d4c-2c91-4805-a34f-cb8222e19ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:37.377933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c8d4c-2c91-4805-a34f-cb8222e19ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:37.378217 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c8d4c-2c91-4805-a34f-cb8222e19ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:37.378492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c8d4c-2c91-4805-a34f-cb8222e19ff4 None admin] PATH_INFO: `/v3/users/d2ada0c204a84a70b855ffcb0dbe36d7` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:37.379641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c8d4c-2c91-4805-a34f-cb8222e19ff4 None admin] RBAC: Authorizing `identity:get_user(user_id=d2ada0c204a84a70b855ffcb0dbe36d7)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:37.381114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c8d4c-2c91-4805-a34f-cb8222e19ff4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:37.382685 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 47/87] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:37 2022] GET /identity/v3/users/d2ada0c204a84a70b855ffcb0dbe36d7 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:37.383490 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c8d4c-2c91-4805-a34f-cb8222e19ff4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:37.432059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:37.434539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80efc0d-01b8-48c4-9bc1-dc96fb34d7be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:37.436066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80efc0d-01b8-48c4-9bc1-dc96fb34d7be None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:37.481064 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c8d4c-2c91-4805-a34f-cb8222e19ff4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:37.495332 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:37.516133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9d958-0be5-4888-929c-8d6d6ef581ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:37.516966 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9d958-0be5-4888-929c-8d6d6ef581ca None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:37.517252 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9d958-0be5-4888-929c-8d6d6ef581ca None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:37.517526 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9d958-0be5-4888-929c-8d6d6ef581ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:37.518245 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9d958-0be5-4888-929c-8d6d6ef581ca None admin] RBAC: Adding query filter params (role.id=ea851d0cf29e44a1884d7c23431a7481, scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6, user.id=d2ada0c204a84a70b855ffcb0dbe36d7) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:37.518621 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9d958-0be5-4888-929c-8d6d6ef581ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:37.520192 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9d958-0be5-4888-929c-8d6d6ef581ca None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:37.526015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 48/88] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:42:37 2022] GET /identity/v3/role_assignments?user.id=d2ada0c204a84a70b855ffcb0dbe36d7&scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6&role.id=ea851d0cf29e44a1884d7c23431a7481 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:37.526825 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9d958-0be5-4888-929c-8d6d6ef581ca None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:37.553662 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 41/89] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:42:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:42:37.553662 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80efc0d-01b8-48c4-9bc1-dc96fb34d7be None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:37.643784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9d958-0be5-4888-929c-8d6d6ef581ca None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:37.665361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:37.669262 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80efc0d-01b8-48c4-9bc1-dc96fb34d7be None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:37.681836 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05155d84-5470-4ac6-bc4d-0a137ab4ca00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:37.682472 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05155d84-5470-4ac6-bc4d-0a137ab4ca00 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:37.684558 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05155d84-5470-4ac6-bc4d-0a137ab4ca00 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:37.684558 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05155d84-5470-4ac6-bc4d-0a137ab4ca00 None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:37.684558 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05155d84-5470-4ac6-bc4d-0a137ab4ca00 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:37.685597 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05155d84-5470-4ac6-bc4d-0a137ab4ca00 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:37.687567 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 49/90] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:37 2022] GET /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:37.688342 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05155d84-5470-4ac6-bc4d-0a137ab4ca00 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:37.709915 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c0da8-655c-4762-aa6f-896b55a1d1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:37.710536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c0da8-655c-4762-aa6f-896b55a1d1a5 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:37.710904 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c0da8-655c-4762-aa6f-896b55a1d1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:37.711190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c0da8-655c-4762-aa6f-896b55a1d1a5 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:37.711845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c0da8-655c-4762-aa6f-896b55a1d1a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:37.713324 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c0da8-655c-4762-aa6f-896b55a1d1a5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:37.738339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:37.789361 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05155d84-5470-4ac6-bc4d-0a137ab4ca00 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:37.822509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022681d0-fcce-465c-865a-9a0c747d9fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:37.823086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022681d0-fcce-465c-865a-9a0c747d9fbc None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:37.823380 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022681d0-fcce-465c-865a-9a0c747d9fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:37.823640 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022681d0-fcce-465c-865a-9a0c747d9fbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:37.836185 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 42/91] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Aug 11 10:42:37 2022] POST /identity/v3/users => generated 289 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:42:37.836910 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c0da8-655c-4762-aa6f-896b55a1d1a5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:37.925330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022681d0-fcce-465c-865a-9a0c747d9fbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:37.926928 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022681d0-fcce-465c-865a-9a0c747d9fbc None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:37.974427 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c0da8-655c-4762-aa6f-896b55a1d1a5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:37.979576 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:38.022138 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d48e5-a06f-4d6c-992c-a9ab70333034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:38.023930 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d48e5-a06f-4d6c-992c-a9ab70333034 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:38.024235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d48e5-a06f-4d6c-992c-a9ab70333034 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:38.024516 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d48e5-a06f-4d6c-992c-a9ab70333034 None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:38.025847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d48e5-a06f-4d6c-992c-a9ab70333034 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:38.027625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d48e5-a06f-4d6c-992c-a9ab70333034 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:38.029771 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 43/92] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:37 2022] GET /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:38.031454 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d48e5-a06f-4d6c-992c-a9ab70333034 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:38.047970 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 50/93] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:42:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:42:38.048834 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022681d0-fcce-465c-865a-9a0c747d9fbc None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:38.065013 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:38.167479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d48e5-a06f-4d6c-992c-a9ab70333034 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:38.174596 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022681d0-fcce-465c-865a-9a0c747d9fbc None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:38.213089 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce4ef8-3064-42c6-af2d-bff7caae64fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:38.213717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce4ef8-3064-42c6-af2d-bff7caae64fb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:38.214976 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce4ef8-3064-42c6-af2d-bff7caae64fb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:38.215261 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce4ef8-3064-42c6-af2d-bff7caae64fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:38.216196 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce4ef8-3064-42c6-af2d-bff7caae64fb None admin] RBAC: Adding query filter params (role.id=00c6de5dd6cd4267ba05941ddb91e6ad, scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6, user.id=94631e4d22874dba849ec3d0cdff5210) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:38.216511 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce4ef8-3064-42c6-af2d-bff7caae64fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:38.216815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f93e6-5e49-4d76-a525-125a797b4c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:38.217379 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f93e6-5e49-4d76-a525-125a797b4c25 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:38.217689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f93e6-5e49-4d76-a525-125a797b4c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:38.218010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f93e6-5e49-4d76-a525-125a797b4c25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:38.218204 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce4ef8-3064-42c6-af2d-bff7caae64fb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:38.218851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f93e6-5e49-4d76-a525-125a797b4c25 None admin] RBAC: Adding query filter params (role.id=e9cc929c9958498d8ce27ca88f685549, scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6, user.id=d2ada0c204a84a70b855ffcb0dbe36d7) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:38.219159 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f93e6-5e49-4d76-a525-125a797b4c25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:38.220615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f93e6-5e49-4d76-a525-125a797b4c25 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:38.227476 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 44/94] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:42:38 2022] GET /identity/v3/role_assignments?user.id=94631e4d22874dba849ec3d0cdff5210&scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6&role.id=00c6de5dd6cd4267ba05941ddb91e6ad => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:38.227626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 51/95] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:42:38 2022] GET /identity/v3/role_assignments?user.id=d2ada0c204a84a70b855ffcb0dbe36d7&scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6&role.id=e9cc929c9958498d8ce27ca88f685549 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:38.228089 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce4ef8-3064-42c6-af2d-bff7caae64fb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:38.351124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:38.371544 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce4ef8-3064-42c6-af2d-bff7caae64fb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:38.412462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205b4e1-9cb1-4215-ae7a-0992a030d34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:38.413161 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205b4e1-9cb1-4215-ae7a-0992a030d34f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:38.413442 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205b4e1-9cb1-4215-ae7a-0992a030d34f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:38.413717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205b4e1-9cb1-4215-ae7a-0992a030d34f None admin] PATH_INFO: `/v3/projects/f05bb246416f4682a59e422c692b65e6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:38.414939 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205b4e1-9cb1-4215-ae7a-0992a030d34f None admin] RBAC: Authorizing `identity:get_project(project_id=f05bb246416f4682a59e422c692b65e6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:38.416409 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205b4e1-9cb1-4215-ae7a-0992a030d34f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:38.418309 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 45/96] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:38 2022] GET /identity/v3/projects/f05bb246416f4682a59e422c692b65e6 => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:38.427123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f93e6-5e49-4d76-a525-125a797b4c25 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:38.445392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:38.562510 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f93e6-5e49-4d76-a525-125a797b4c25 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:38.606272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b72f51-f174-4b39-bf34-747ec28688b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:38.607327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b72f51-f174-4b39-bf34-747ec28688b3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:38.607812 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b72f51-f174-4b39-bf34-747ec28688b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:38.608807 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b72f51-f174-4b39-bf34-747ec28688b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:38.610022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b72f51-f174-4b39-bf34-747ec28688b3 None admin] RBAC: Adding query filter params (role.id=ea851d0cf29e44a1884d7c23431a7481, scope.project.id=f05bb246416f4682a59e422c692b65e6, user.id=d2ada0c204a84a70b855ffcb0dbe36d7) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:38.610562 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b72f51-f174-4b39-bf34-747ec28688b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:38.612241 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b72f51-f174-4b39-bf34-747ec28688b3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:38.618388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 52/97] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:42:38 2022] GET /identity/v3/role_assignments?user.id=d2ada0c204a84a70b855ffcb0dbe36d7&scope.project.id=f05bb246416f4682a59e422c692b65e6&role.id=ea851d0cf29e44a1884d7c23431a7481 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:39.927942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2e113-6423-4e0b-98b4-c078225bda1a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:39.928562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2e113-6423-4e0b-98b4-c078225bda1a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:39.928562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2e113-6423-4e0b-98b4-c078225bda1a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:39.929980 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 46/98] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:42:39.935076 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfeadc3-5843-47aa-bb06-d577b2d0f97b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:39.935491 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfeadc3-5843-47aa-bb06-d577b2d0f97b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:39.935675 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfeadc3-5843-47aa-bb06-d577b2d0f97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:39.956195 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-7cfeadc3-5843-47aa-bb06-d577b2d0f97b None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:39.957384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7cfeadc3-5843-47aa-bb06-d577b2d0f97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:40.048778 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 53/99] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:42:40.082928 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2e113-6423-4e0b-98b4-c078225bda1a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:40.195403 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2e113-6423-4e0b-98b4-c078225bda1a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:40.231264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd195415-8e58-4f70-abf2-9a591f6f1921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:40.231902 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd195415-8e58-4f70-abf2-9a591f6f1921 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:40.232186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd195415-8e58-4f70-abf2-9a591f6f1921 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:40.232517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd195415-8e58-4f70-abf2-9a591f6f1921 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:40.243827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd195415-8e58-4f70-abf2-9a591f6f1921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:40.248604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-cd195415-8e58-4f70-abf2-9a591f6f1921 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:42:40.248604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:40.248604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:40.248604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:40.248604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:40.248604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:40.248604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:40.248604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:40.248604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:40.248604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:40.248604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:40.248604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:40.248604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:40.248604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:40.248604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:40.248604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:40.250038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:40.250038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:40.250038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:40.250038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:40.250038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:40.250038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:40.250038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:40.250038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:40.250038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:40.250038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:40.250038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:40.250038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:40.250038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:40.250038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:40.250038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:40.250038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:40.250810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:40.250810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:40.250810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:40.250810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:40.250810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:40.250810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:40.250810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:40.250810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:40.250810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:40.250810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:40.250810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:42:40.250810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:42:40.250810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 47/100] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:42:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:42:40.256524 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfeadc3-5843-47aa-bb06-d577b2d0f97b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:40.259631 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:40.364980 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfeadc3-5843-47aa-bb06-d577b2d0f97b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:40.406430 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5465ac-a9c9-45fd-84f9-6c0cbfbe6995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:40.407070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5465ac-a9c9-45fd-84f9-6c0cbfbe6995 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:40.407354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5465ac-a9c9-45fd-84f9-6c0cbfbe6995 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:40.407665 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5465ac-a9c9-45fd-84f9-6c0cbfbe6995 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:40.408339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5465ac-a9c9-45fd-84f9-6c0cbfbe6995 None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:40.408640 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5465ac-a9c9-45fd-84f9-6c0cbfbe6995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:40.410011 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5465ac-a9c9-45fd-84f9-6c0cbfbe6995 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:40.422117 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 54/101] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:42:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:40.428296 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd195415-8e58-4f70-abf2-9a591f6f1921 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:40.452810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:40.550215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd195415-8e58-4f70-abf2-9a591f6f1921 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:40.585456 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c8145-219d-4b2a-bc7d-6c0f9b8a6c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:40.586146 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c8145-219d-4b2a-bc7d-6c0f9b8a6c01 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:40.586425 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c8145-219d-4b2a-bc7d-6c0f9b8a6c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:40.586751 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c8145-219d-4b2a-bc7d-6c0f9b8a6c01 None admin] PATH_INFO: `/v3/users/d2ada0c204a84a70b855ffcb0dbe36d7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:40.587900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c8145-219d-4b2a-bc7d-6c0f9b8a6c01 None admin] RBAC: Authorizing `identity:get_user(user_id=d2ada0c204a84a70b855ffcb0dbe36d7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:40.589419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c8145-219d-4b2a-bc7d-6c0f9b8a6c01 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:40.591026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 48/102] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:40 2022] GET /identity/v3/users/d2ada0c204a84a70b855ffcb0dbe36d7 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:40.597699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5465ac-a9c9-45fd-84f9-6c0cbfbe6995 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:40.672111 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:40.725657 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5465ac-a9c9-45fd-84f9-6c0cbfbe6995 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:40.770165 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4af82-64f8-428b-b070-114aa63eccd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:40.770836 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4af82-64f8-428b-b070-114aa63eccd1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:40.771122 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4af82-64f8-428b-b070-114aa63eccd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:40.771399 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4af82-64f8-428b-b070-114aa63eccd1 None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:40.772565 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4af82-64f8-428b-b070-114aa63eccd1 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:40.774177 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4af82-64f8-428b-b070-114aa63eccd1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:40.778529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 55/103] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:40 2022] GET /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:40.784797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c8145-219d-4b2a-bc7d-6c0f9b8a6c01 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:40.878412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:40.895153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c8145-219d-4b2a-bc7d-6c0f9b8a6c01 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:40.931979 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a8633-27da-4b95-9974-fe5dc39a3246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:40.932749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a8633-27da-4b95-9974-fe5dc39a3246 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:40.932914 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a8633-27da-4b95-9974-fe5dc39a3246 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:40.933185 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a8633-27da-4b95-9974-fe5dc39a3246 None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6/users/d2ada0c204a84a70b855ffcb0dbe36d7/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:40.935189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a8633-27da-4b95-9974-fe5dc39a3246 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6, user_id=d2ada0c204a84a70b855ffcb0dbe36d7, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:40.936899 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a8633-27da-4b95-9974-fe5dc39a3246 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:40.972976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68639e-0f90-4c84-8ea7-78a304239e7a None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:40.973613 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68639e-0f90-4c84-8ea7-78a304239e7a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:40.973613 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68639e-0f90-4c84-8ea7-78a304239e7a None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:40.975195 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 56/104] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:40.980727 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e4801-0a0d-455f-a9b9-052839dfab76 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:40.980959 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e4801-0a0d-455f-a9b9-052839dfab76 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:40.981242 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e4801-0a0d-455f-a9b9-052839dfab76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:41.001968 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-077e4801-0a0d-455f-a9b9-052839dfab76 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:41.003322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-077e4801-0a0d-455f-a9b9-052839dfab76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:41.023744 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 49/105] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:42:40 2022] PUT /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6/users/d2ada0c204a84a70b855ffcb0dbe36d7/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:42:41.109043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 57/106] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:42:41.133822 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a8633-27da-4b95-9974-fe5dc39a3246 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:41.244933 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a8633-27da-4b95-9974-fe5dc39a3246 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:41.273524 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1fb32-e1a9-4eab-95a5-ff86926e0b1d None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:41.273853 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1fb32-e1a9-4eab-95a5-ff86926e0b1d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:41.274073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1fb32-e1a9-4eab-95a5-ff86926e0b1d None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:41.275496 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 58/107] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:41.284691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea515f-9550-4ba9-8d94-4ab407b90ac1 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:41.284972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea515f-9550-4ba9-8d94-4ab407b90ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:41.285252 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea515f-9550-4ba9-8d94-4ab407b90ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:41.295062 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d7760-2dd1-4c5b-a8b7-8c088b2cb373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:41.295902 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d7760-2dd1-4c5b-a8b7-8c088b2cb373 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:41.296272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d7760-2dd1-4c5b-a8b7-8c088b2cb373 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:41.296538 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d7760-2dd1-4c5b-a8b7-8c088b2cb373 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:41.305330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d8ea515f-9550-4ba9-8d94-4ab407b90ac1 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:41.306864 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d8ea515f-9550-4ba9-8d94-4ab407b90ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:41.324541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d7760-2dd1-4c5b-a8b7-8c088b2cb373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:41.330438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-dc2d7760-2dd1-4c5b-a8b7-8c088b2cb373 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 10:42:41.330438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:41.330438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:41.330438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:41.330438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:41.330438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:41.330438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:41.330438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:41.330438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:41.330438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:41.330438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:41.330438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:41.330438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:41.330438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:41.330438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:41.330438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:41.331523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:41.331523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:41.331523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:41.331523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:41.331523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:41.331523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:41.331523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:41.331523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:41.331523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:41.331523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:41.331523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:41.331523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:41.331523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:41.331523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:41.331523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:41.331523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:41.332382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:41.332382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:41.332382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:41.332382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:41.332382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:41.332382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:41.332382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:41.332382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:41.332382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:41.332382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:41.332382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 10:42:41.332382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:42:41.334333 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 50/108] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:42:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:42:41.338368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c7dcd-6c01-4d8c-811d-b24877452229 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:41.338847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c7dcd-6c01-4d8c-811d-b24877452229 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:41.339331 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c7dcd-6c01-4d8c-811d-b24877452229 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:41.340931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 51/109] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:41.345546 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c7dcd-6c01-4d8c-811d-b24877452229 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:41.351115 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:41.385125 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:41.394260 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 59/110] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:42:41.395644 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af5729-d142-4052-9a8d-088572991d4d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:41.395967 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af5729-d142-4052-9a8d-088572991d4d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:41.396210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af5729-d142-4052-9a8d-088572991d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:41.415721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-47af5729-d142-4052-9a8d-088572991d4d None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:41.417163 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-47af5729-d142-4052-9a8d-088572991d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:41.485500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c7dcd-6c01-4d8c-811d-b24877452229 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:41.523391 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff28b2b-e4bc-41c7-9864-db4dbd4c5223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:41.524338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff28b2b-e4bc-41c7-9864-db4dbd4c5223 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:41.524950 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff28b2b-e4bc-41c7-9864-db4dbd4c5223 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:41.525557 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff28b2b-e4bc-41c7-9864-db4dbd4c5223 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:41.526426 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff28b2b-e4bc-41c7-9864-db4dbd4c5223 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:41.526958 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff28b2b-e4bc-41c7-9864-db4dbd4c5223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:41.528818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff28b2b-e4bc-41c7-9864-db4dbd4c5223 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:41.538187 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 52/111] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:42:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:41.543516 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff28b2b-e4bc-41c7-9864-db4dbd4c5223 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:41.549109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 60/112] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:41.550199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af5729-d142-4052-9a8d-088572991d4d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:41.639179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:41.656172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff28b2b-e4bc-41c7-9864-db4dbd4c5223 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:41.694346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50029c55-7da2-4d48-88a0-f12a692ad04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:41.695461 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50029c55-7da2-4d48-88a0-f12a692ad04b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:41.695977 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50029c55-7da2-4d48-88a0-f12a692ad04b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:41.696526 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50029c55-7da2-4d48-88a0-f12a692ad04b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:41.697864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50029c55-7da2-4d48-88a0-f12a692ad04b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:41.699736 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50029c55-7da2-4d48-88a0-f12a692ad04b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:41.701557 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 53/113] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:42:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:41.703185 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50029c55-7da2-4d48-88a0-f12a692ad04b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:41.717496 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af5729-d142-4052-9a8d-088572991d4d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:41.767729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:41.800162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7206d-8e43-4bfa-9324-eab4a9f541f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:41.800759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7206d-8e43-4bfa-9324-eab4a9f541f9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:41.801080 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7206d-8e43-4bfa-9324-eab4a9f541f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:41.801303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7206d-8e43-4bfa-9324-eab4a9f541f9 None admin] PATH_INFO: `/v3/users/1603872504f6486d8c83c22bdaeb5f90` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:41.814393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50029c55-7da2-4d48-88a0-f12a692ad04b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:41.829852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7206d-8e43-4bfa-9324-eab4a9f541f9 None admin] RBAC: Authorizing `identity:get_user(user_id=1603872504f6486d8c83c22bdaeb5f90)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:41.831523 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7206d-8e43-4bfa-9324-eab4a9f541f9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:41.833312 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 61/114] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:41 2022] GET /identity/v3/users/1603872504f6486d8c83c22bdaeb5f90 => generated 289 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:41.834100 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7206d-8e43-4bfa-9324-eab4a9f541f9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:41.857549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2179da2-c2c4-475b-9a6f-9ccc1bfde0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:41.859572 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2179da2-c2c4-475b-9a6f-9ccc1bfde0a3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:41.859918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2179da2-c2c4-475b-9a6f-9ccc1bfde0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:41.860257 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2179da2-c2c4-475b-9a6f-9ccc1bfde0a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:41.862382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:41.871937 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2179da2-c2c4-475b-9a6f-9ccc1bfde0a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:41.877084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e2179da2-c2c4-475b-9a6f-9ccc1bfde0a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:42:41.877084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:41.877084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:41.877084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:41.877084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:41.877084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:41.877084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:41.877084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:41.877084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:41.877084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:41.877084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:41.877084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:41.877084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:41.877084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:41.877084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:41.877084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:41.877907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:41.877907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:41.877907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:41.877907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:41.877907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:41.877907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:41.877907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:41.877907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:41.877907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:41.877907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:41.877907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:41.877907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:41.877907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:41.877907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:41.877907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:41.877907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:41.878685 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:41.878685 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:41.878685 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:41.878685 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:41.878685 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:41.878685 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:41.878685 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:41.878685 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:41.878685 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:41.878685 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:41.878685 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:42:41.878685 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:42:41.878685 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 54/115] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:42:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:42:41.884722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c5259-5c13-4230-880d-6f5907f03dcf None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:41.884722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c5259-5c13-4230-880d-6f5907f03dcf None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:41.884722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c5259-5c13-4230-880d-6f5907f03dcf None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:41.884722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 55/116] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:41.884722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c5259-5c13-4230-880d-6f5907f03dcf None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:41.973766 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7206d-8e43-4bfa-9324-eab4a9f541f9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:41.998521 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c5259-5c13-4230-880d-6f5907f03dcf None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:42.012952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85955c-d81e-47f3-93f2-e9084b49dc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:42.013877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85955c-d81e-47f3-93f2-e9084b49dc1c None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:42.014347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85955c-d81e-47f3-93f2-e9084b49dc1c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:42.015132 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85955c-d81e-47f3-93f2-e9084b49dc1c None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:42.015924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85955c-d81e-47f3-93f2-e9084b49dc1c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:42.017671 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85955c-d81e-47f3-93f2-e9084b49dc1c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:42.039000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5052e-105e-4702-baba-9b6ffd5417ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:42.039000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5052e-105e-4702-baba-9b6ffd5417ea None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:42.039000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5052e-105e-4702-baba-9b6ffd5417ea None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:42.039000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5052e-105e-4702-baba-9b6ffd5417ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:42.102370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:42.111233 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5052e-105e-4702-baba-9b6ffd5417ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:42.114864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5052e-105e-4702-baba-9b6ffd5417ea None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:42.115258 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 62/117] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Aug 11 10:42:41 2022] POST /identity/v3/projects => generated 302 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:42:42.117324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85955c-d81e-47f3-93f2-e9084b49dc1c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:42.176006 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:42.248052 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 56/118] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:42:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:42:42.255291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be12d29-6351-4c7a-a8ca-5c0ced76d540 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:42.255936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be12d29-6351-4c7a-a8ca-5c0ced76d540 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:42.256427 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be12d29-6351-4c7a-a8ca-5c0ced76d540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:42.276917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85955c-d81e-47f3-93f2-e9084b49dc1c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:42.277277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3be12d29-6351-4c7a-a8ca-5c0ced76d540 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:42.278793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3be12d29-6351-4c7a-a8ca-5c0ced76d540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:42.321277 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db4c66-a6b6-48a5-89b5-245b11f5e4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:42.322735 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db4c66-a6b6-48a5-89b5-245b11f5e4dd None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:42.323114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db4c66-a6b6-48a5-89b5-245b11f5e4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:42.323392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db4c66-a6b6-48a5-89b5-245b11f5e4dd None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:42.325738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db4c66-a6b6-48a5-89b5-245b11f5e4dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:42.325738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db4c66-a6b6-48a5-89b5-245b11f5e4dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:42.327536 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db4c66-a6b6-48a5-89b5-245b11f5e4dd None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:42.337839 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 63/119] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:42:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:42.340054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6f003-d026-4215-a6ff-cf45f7100368 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:42.340339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6f003-d026-4215-a6ff-cf45f7100368 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:42.340619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6f003-d026-4215-a6ff-cf45f7100368 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:42.341968 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 64/120] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:42.344238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6f003-d026-4215-a6ff-cf45f7100368 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:42.377422 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 57/121] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:42.377422 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be12d29-6351-4c7a-a8ca-5c0ced76d540 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:42.417262 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:42.467967 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:42.477121 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6f003-d026-4215-a6ff-cf45f7100368 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:42.501743 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be12d29-6351-4c7a-a8ca-5c0ced76d540 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:42.517473 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b479c6-4502-429f-9f29-118439b2e3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:42.518296 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b479c6-4502-429f-9f29-118439b2e3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:42.518681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b479c6-4502-429f-9f29-118439b2e3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:42.519083 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b479c6-4502-429f-9f29-118439b2e3a3 None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:42.520344 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b479c6-4502-429f-9f29-118439b2e3a3 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:42.521971 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b479c6-4502-429f-9f29-118439b2e3a3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:42.524023 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 65/122] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:42 2022] GET /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:42.525074 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9409b28-4038-4009-97d1-95839cb4b965 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:42.525451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9409b28-4038-4009-97d1-95839cb4b965 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:42.525827 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9409b28-4038-4009-97d1-95839cb4b965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:42.543606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aeb301-af6e-45d5-9b03-a4e6abbf02d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:42.544267 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aeb301-af6e-45d5-9b03-a4e6abbf02d8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:42.544551 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aeb301-af6e-45d5-9b03-a4e6abbf02d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:42.544828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aeb301-af6e-45d5-9b03-a4e6abbf02d8 None admin] PATH_INFO: `/v3/users/94631e4d22874dba849ec3d0cdff5210` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:42.546312 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a9409b28-4038-4009-97d1-95839cb4b965 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:42.546430 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aeb301-af6e-45d5-9b03-a4e6abbf02d8 None admin] RBAC: Authorizing `identity:get_user(user_id=94631e4d22874dba849ec3d0cdff5210)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:42.547828 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a9409b28-4038-4009-97d1-95839cb4b965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:42.547939 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aeb301-af6e-45d5-9b03-a4e6abbf02d8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:42.549861 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 58/123] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:42 2022] GET /identity/v3/users/94631e4d22874dba849ec3d0cdff5210 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:42.550780 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aeb301-af6e-45d5-9b03-a4e6abbf02d8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:42.634124 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 66/124] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:42.635059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9409b28-4038-4009-97d1-95839cb4b965 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:42.683369 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:42.694398 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aeb301-af6e-45d5-9b03-a4e6abbf02d8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:42.736335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:42.744530 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9409b28-4038-4009-97d1-95839cb4b965 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:42.747045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c513f-3953-447b-8ef7-a164d370a4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:42.747692 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c513f-3953-447b-8ef7-a164d370a4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:42.749216 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c513f-3953-447b-8ef7-a164d370a4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:42.749216 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c513f-3953-447b-8ef7-a164d370a4b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:42.760126 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c513f-3953-447b-8ef7-a164d370a4b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:42.765180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ee3c513f-3953-447b-8ef7-a164d370a4b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:42:42.765180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:42.765180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:42.765180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:42.765180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:42.765180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:42.765180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:42.765180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:42.765180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:42.765180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:42.765180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:42.765180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:42.765180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:42.765180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:42.765180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:42.765180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:42.765993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:42.765993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:42.765993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:42.765993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:42.765993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:42.765993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:42.765993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:42.765993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:42.765993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:42.765993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:42.765993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:42.765993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:42.765993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:42.765993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:42.765993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:42.765993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:42.766726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:42.766726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:42.766726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:42.766726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:42.766726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:42.766726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:42.766726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:42.766726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:42.766726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:42.766726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:42.766726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:42:42.766726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:42:42.766726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 59/125] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:42:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:42:42.771752 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c513f-3953-447b-8ef7-a164d370a4b9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:42.789798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01820e3e-bba1-44dc-b09d-6739fa5c3f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:42.790743 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01820e3e-bba1-44dc-b09d-6739fa5c3f0e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:42.791242 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01820e3e-bba1-44dc-b09d-6739fa5c3f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:42.791722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01820e3e-bba1-44dc-b09d-6739fa5c3f0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:42.792579 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01820e3e-bba1-44dc-b09d-6739fa5c3f0e None admin] RBAC: Adding query filter params (role.id=cef88e8a775e490a985ff36748d330f4, scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6, user.id=1603872504f6486d8c83c22bdaeb5f90) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:42.792958 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01820e3e-bba1-44dc-b09d-6739fa5c3f0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:42.794549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01820e3e-bba1-44dc-b09d-6739fa5c3f0e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:42.801183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 67/126] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:42:42 2022] GET /identity/v3/role_assignments?user.id=1603872504f6486d8c83c22bdaeb5f90&scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6&role.id=cef88e8a775e490a985ff36748d330f4 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:42.802115 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01820e3e-bba1-44dc-b09d-6739fa5c3f0e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:42.929197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c513f-3953-447b-8ef7-a164d370a4b9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:42.991920 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01820e3e-bba1-44dc-b09d-6739fa5c3f0e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:42.992591 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7ae89-ecb7-4faf-a18e-a67a835075a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:42.993241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7ae89-ecb7-4faf-a18e-a67a835075a6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:42.993526 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7ae89-ecb7-4faf-a18e-a67a835075a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:42.993916 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7ae89-ecb7-4faf-a18e-a67a835075a6 None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:42.995147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7ae89-ecb7-4faf-a18e-a67a835075a6 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:42.996608 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7ae89-ecb7-4faf-a18e-a67a835075a6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:43.000001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 60/127] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:42 2022] GET /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:43.000001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7ae89-ecb7-4faf-a18e-a67a835075a6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:43.027868 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:43.049216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc10b6-07b3-4770-9d3e-9b164fe1b198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:43.050734 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc10b6-07b3-4770-9d3e-9b164fe1b198 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:43.051270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc10b6-07b3-4770-9d3e-9b164fe1b198 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:43.051745 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc10b6-07b3-4770-9d3e-9b164fe1b198 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:43.066030 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc10b6-07b3-4770-9d3e-9b164fe1b198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:43.072105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-61dc10b6-07b3-4770-9d3e-9b164fe1b198 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:42:43.072105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:43.072105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:43.072105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:43.072105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:43.072105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:43.072105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:43.072105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:43.072105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:43.072105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:43.072105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:43.072105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:43.072105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:43.072105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:43.072105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:43.072105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:43.072932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:43.072932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:43.072932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:43.072932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:43.072932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:43.072932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:43.072932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:43.072932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:43.072932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:43.072932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:43.072932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:43.072932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:43.072932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:43.072932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:43.072932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:43.072932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:43.073662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:43.073662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:43.073662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:43.073662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:43.073662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:43.073662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:43.073662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:43.073662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:43.073662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:43.073662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:43.073662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:42:43.073662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:42:43.075865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 68/128] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:42:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:42:43.078010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc10b6-07b3-4770-9d3e-9b164fe1b198 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:43.123109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:43.195157 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7ae89-ecb7-4faf-a18e-a67a835075a6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:43.263668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d796b4e-3968-4ba4-93e3-65874f57f0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:43.264479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d796b4e-3968-4ba4-93e3-65874f57f0f4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:43.265774 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d796b4e-3968-4ba4-93e3-65874f57f0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:43.266058 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d796b4e-3968-4ba4-93e3-65874f57f0f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:43.267470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d796b4e-3968-4ba4-93e3-65874f57f0f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:43.267782 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d796b4e-3968-4ba4-93e3-65874f57f0f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:43.269156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d796b4e-3968-4ba4-93e3-65874f57f0f4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:43.276188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc10b6-07b3-4770-9d3e-9b164fe1b198 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:43.289078 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 61/129] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:42:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:43.290000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d796b4e-3968-4ba4-93e3-65874f57f0f4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:43.348025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bb490-3cc9-4777-b18d-9c3207a8a60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:43.349052 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bb490-3cc9-4777-b18d-9c3207a8a60a None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:43.349530 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bb490-3cc9-4777-b18d-9c3207a8a60a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:43.350015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bb490-3cc9-4777-b18d-9c3207a8a60a None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6/users/94631e4d22874dba849ec3d0cdff5210/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:43.352261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bb490-3cc9-4777-b18d-9c3207a8a60a None admin] RBAC: Authorizing `identity:create_grant(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6, user_id=94631e4d22874dba849ec3d0cdff5210, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:43.353946 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bb490-3cc9-4777-b18d-9c3207a8a60a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:43.405834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:43.424993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d796b4e-3968-4ba4-93e3-65874f57f0f4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:43.460400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0f7fe-ed6e-4614-82b0-25119900718c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:43.460946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0f7fe-ed6e-4614-82b0-25119900718c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:43.461236 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0f7fe-ed6e-4614-82b0-25119900718c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:43.461515 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0f7fe-ed6e-4614-82b0-25119900718c None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:43.462189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0f7fe-ed6e-4614-82b0-25119900718c None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:43.462511 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0f7fe-ed6e-4614-82b0-25119900718c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:43.463987 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0f7fe-ed6e-4614-82b0-25119900718c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:43.473774 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 62/130] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:42:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:43.474623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0f7fe-ed6e-4614-82b0-25119900718c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:43.493783 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 69/131] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:42:43 2022] PUT /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6/users/94631e4d22874dba849ec3d0cdff5210/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:42:43.508815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bb490-3cc9-4777-b18d-9c3207a8a60a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:43.588111 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0f7fe-ed6e-4614-82b0-25119900718c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:43.614666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:43.629038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ebde5-6ae2-44cf-aa2e-459ea84e2ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:43.635276 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ebde5-6ae2-44cf-aa2e-459ea84e2ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:43.635276 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ebde5-6ae2-44cf-aa2e-459ea84e2ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:43.635276 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ebde5-6ae2-44cf-aa2e-459ea84e2ea5 None admin] PATH_INFO: `/v3/users/d2ada0c204a84a70b855ffcb0dbe36d7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:43.635276 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ebde5-6ae2-44cf-aa2e-459ea84e2ea5 None admin] RBAC: Authorizing `identity:get_user(user_id=d2ada0c204a84a70b855ffcb0dbe36d7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:43.635276 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ebde5-6ae2-44cf-aa2e-459ea84e2ea5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:43.636020 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 63/132] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:43 2022] GET /identity/v3/users/d2ada0c204a84a70b855ffcb0dbe36d7 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:43.637784 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201790f7-2552-44c2-8a88-60ef13a5778b None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:43.638090 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201790f7-2552-44c2-8a88-60ef13a5778b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:43.638371 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201790f7-2552-44c2-8a88-60ef13a5778b None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:43.641019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 64/133] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:43.642402 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bb490-3cc9-4777-b18d-9c3207a8a60a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:43.650552 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d9e30-b8f7-48ce-9e8b-225931cb0000 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:43.650552 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d9e30-b8f7-48ce-9e8b-225931cb0000 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:43.650552 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d9e30-b8f7-48ce-9e8b-225931cb0000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:43.685399 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1486d3-6650-4a74-b66d-937491862ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:43.686106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1486d3-6650-4a74-b66d-937491862ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:43.686387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1486d3-6650-4a74-b66d-937491862ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:43.686915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1486d3-6650-4a74-b66d-937491862ab3 None admin] PATH_INFO: `/v3/users/d2ada0c204a84a70b855ffcb0dbe36d7` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:43.688281 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1486d3-6650-4a74-b66d-937491862ab3 None admin] RBAC: Authorizing `identity:get_user(user_id=d2ada0c204a84a70b855ffcb0dbe36d7)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:43.689846 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1486d3-6650-4a74-b66d-937491862ab3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:43.691803 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7e9d9e30-b8f7-48ce-9e8b-225931cb0000 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:43.691923 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 70/134] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:43 2022] GET /identity/v3/users/d2ada0c204a84a70b855ffcb0dbe36d7 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:43.692694 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1486d3-6650-4a74-b66d-937491862ab3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:43.693085 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7e9d9e30-b8f7-48ce-9e8b-225931cb0000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:43.709548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:43.822895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1486d3-6650-4a74-b66d-937491862ab3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:43.836044 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 65/135] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:43.836983 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d9e30-b8f7-48ce-9e8b-225931cb0000 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:43.886471 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be6925-1687-4f81-a4b4-372a7b7378bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:43.887162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be6925-1687-4f81-a4b4-372a7b7378bc None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:43.887449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be6925-1687-4f81-a4b4-372a7b7378bc None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:43.887728 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be6925-1687-4f81-a4b4-372a7b7378bc None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:43.889137 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be6925-1687-4f81-a4b4-372a7b7378bc None admin] RBAC: Authorizing `identity:get_project(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:43.892246 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be6925-1687-4f81-a4b4-372a7b7378bc None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:43.893893 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 71/136] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:43 2022] GET /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:43.899099 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be6925-1687-4f81-a4b4-372a7b7378bc None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:43.922201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:44.023079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be6925-1687-4f81-a4b4-372a7b7378bc None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:44.065625 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b52043-8284-4b01-83c9-095f56d0d090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:44.066276 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b52043-8284-4b01-83c9-095f56d0d090 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:44.066562 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b52043-8284-4b01-83c9-095f56d0d090 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:44.066888 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b52043-8284-4b01-83c9-095f56d0d090 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:44.078630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b52043-8284-4b01-83c9-095f56d0d090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:44.083941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-69b52043-8284-4b01-83c9-095f56d0d090 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:42:44.083941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:44.083941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:44.083941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:44.083941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:44.083941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:44.083941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:44.083941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:44.083941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:44.083941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:44.083941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:44.083941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:44.083941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:44.083941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:44.083941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:44.083941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:44.084772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:44.084772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:44.084772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:44.084772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:44.084772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:44.084772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:44.084772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:44.084772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:44.084772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:44.084772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:44.084772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:44.084772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:44.084772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:44.084772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:44.084772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:44.084772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:44.085517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:44.085517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:44.085517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:44.085517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:44.085517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:44.085517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:44.085517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:44.085517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:44.085517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:44.085517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:44.085517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:42:44.085517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:42:44.086072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d9e30-b8f7-48ce-9e8b-225931cb0000 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:44.086483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 72/137] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:42:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:42:44.086483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b52043-8284-4b01-83c9-095f56d0d090 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:44.203161 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:44.211341 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b52043-8284-4b01-83c9-095f56d0d090 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:44.232069 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadfe53-8e8c-4b08-a651-f08cf5b5b679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:44.232734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadfe53-8e8c-4b08-a651-f08cf5b5b679 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:44.233305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadfe53-8e8c-4b08-a651-f08cf5b5b679 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:44.233621 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadfe53-8e8c-4b08-a651-f08cf5b5b679 None admin] PATH_INFO: `/v3/projects/f05bb246416f4682a59e422c692b65e6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:44.235119 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadfe53-8e8c-4b08-a651-f08cf5b5b679 None admin] RBAC: Authorizing `identity:get_project(project_id=f05bb246416f4682a59e422c692b65e6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:44.236589 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadfe53-8e8c-4b08-a651-f08cf5b5b679 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:44.238541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 66/138] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:43 2022] GET /identity/v3/projects/f05bb246416f4682a59e422c692b65e6 => generated 312 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:44.239360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadfe53-8e8c-4b08-a651-f08cf5b5b679 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:44.250768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13995698-076c-4d8c-9871-c024a4921c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:44.251464 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13995698-076c-4d8c-9871-c024a4921c24 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:44.251749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13995698-076c-4d8c-9871-c024a4921c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:44.252024 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13995698-076c-4d8c-9871-c024a4921c24 None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6/users/d2ada0c204a84a70b855ffcb0dbe36d7/roles/e9cc929c9958498d8ce27ca88f685549` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:44.259552 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13995698-076c-4d8c-9871-c024a4921c24 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6, user_id=d2ada0c204a84a70b855ffcb0dbe36d7, role_id=e9cc929c9958498d8ce27ca88f685549)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:44.261058 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13995698-076c-4d8c-9871-c024a4921c24 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:44.267614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:44.354175 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 73/139] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:42:44 2022] PUT /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6/users/d2ada0c204a84a70b855ffcb0dbe36d7/roles/e9cc929c9958498d8ce27ca88f685549 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:42:44.355288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13995698-076c-4d8c-9871-c024a4921c24 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:44.367196 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadfe53-8e8c-4b08-a651-f08cf5b5b679 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:44.415784 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad4645-24bb-4f04-aee6-8073a3f24ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:44.416879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad4645-24bb-4f04-aee6-8073a3f24ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:44.417393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad4645-24bb-4f04-aee6-8073a3f24ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:44.417843 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad4645-24bb-4f04-aee6-8073a3f24ee6 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:44.419280 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad4645-24bb-4f04-aee6-8073a3f24ee6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:44.419763 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad4645-24bb-4f04-aee6-8073a3f24ee6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:44.421431 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad4645-24bb-4f04-aee6-8073a3f24ee6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:44.432063 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 67/140] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:42:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:44.436672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b693e-12c9-4f17-a6b8-0dcd6ee9d7fb None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:44.437617 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b693e-12c9-4f17-a6b8-0dcd6ee9d7fb None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:44.438449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b693e-12c9-4f17-a6b8-0dcd6ee9d7fb None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:44.441247 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 68/141] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:44.442240 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b693e-12c9-4f17-a6b8-0dcd6ee9d7fb None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:44.522572 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13995698-076c-4d8c-9871-c024a4921c24 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:44.539855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:44.566795 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f7c61-12fa-4365-b557-c067e3e03175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:44.567506 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f7c61-12fa-4365-b557-c067e3e03175 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:44.567973 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f7c61-12fa-4365-b557-c067e3e03175 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:44.568268 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f7c61-12fa-4365-b557-c067e3e03175 None admin] PATH_INFO: `/v3/projects/f05bb246416f4682a59e422c692b65e6/users/d2ada0c204a84a70b855ffcb0dbe36d7/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:44.570409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f7c61-12fa-4365-b557-c067e3e03175 None admin] RBAC: Authorizing `identity:create_grant(project_id=f05bb246416f4682a59e422c692b65e6, user_id=d2ada0c204a84a70b855ffcb0dbe36d7, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:44.572598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f7c61-12fa-4365-b557-c067e3e03175 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:44.575791 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:44.580116 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b693e-12c9-4f17-a6b8-0dcd6ee9d7fb None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:44.625294 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec0cfa-22f9-4c3b-82f7-2e6419a68817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:44.626298 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec0cfa-22f9-4c3b-82f7-2e6419a68817 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:44.626789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec0cfa-22f9-4c3b-82f7-2e6419a68817 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:44.627239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec0cfa-22f9-4c3b-82f7-2e6419a68817 None admin] PATH_INFO: `/v3/users/d2ada0c204a84a70b855ffcb0dbe36d7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:44.629976 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec0cfa-22f9-4c3b-82f7-2e6419a68817 None admin] RBAC: Authorizing `identity:get_user(user_id=d2ada0c204a84a70b855ffcb0dbe36d7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:44.631715 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec0cfa-22f9-4c3b-82f7-2e6419a68817 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:44.633598 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 69/142] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:44 2022] GET /identity/v3/users/d2ada0c204a84a70b855ffcb0dbe36d7 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:44.634989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d6831-d4b3-45a3-9351-18e308ed701f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:44.635455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d6831-d4b3-45a3-9351-18e308ed701f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:44.635980 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d6831-d4b3-45a3-9351-18e308ed701f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:44.655449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-361d6831-d4b3-45a3-9351-18e308ed701f None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:44.656946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-361d6831-d4b3-45a3-9351-18e308ed701f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:44.689484 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 74/143] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:42:44 2022] PUT /identity/v3/projects/f05bb246416f4682a59e422c692b65e6/users/d2ada0c204a84a70b855ffcb0dbe36d7/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:42:44.690635 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f7c61-12fa-4365-b557-c067e3e03175 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:44.775287 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 70/144] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:44.820275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d6831-d4b3-45a3-9351-18e308ed701f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:44.867025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f7c61-12fa-4365-b557-c067e3e03175 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:44.932817 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aeec0a-7e94-4ecb-a40e-acb9cd10548f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:44.933355 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aeec0a-7e94-4ecb-a40e-acb9cd10548f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:44.933636 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aeec0a-7e94-4ecb-a40e-acb9cd10548f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:44.934275 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aeec0a-7e94-4ecb-a40e-acb9cd10548f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:44.956964 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:44.994455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d6831-d4b3-45a3-9351-18e308ed701f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:45.043423 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bf3aa-a593-4936-bf9c-a7ffa5503b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:45.044378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bf3aa-a593-4936-bf9c-a7ffa5503b42 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:45.044864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bf3aa-a593-4936-bf9c-a7ffa5503b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:45.045338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bf3aa-a593-4936-bf9c-a7ffa5503b42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:45.046972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bf3aa-a593-4936-bf9c-a7ffa5503b42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:45.048670 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bf3aa-a593-4936-bf9c-a7ffa5503b42 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:45.050476 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 71/145] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:42:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:45.057167 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bf3aa-a593-4936-bf9c-a7ffa5503b42 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:45.069530 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:45.079856 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aeec0a-7e94-4ecb-a40e-acb9cd10548f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:45.081957 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aeec0a-7e94-4ecb-a40e-acb9cd10548f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:45.224823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bf3aa-a593-4936-bf9c-a7ffa5503b42 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:45.258291 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 75/146] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:42:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:42:45.266978 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aeec0a-7e94-4ecb-a40e-acb9cd10548f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:45.269719 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d888a-679c-441d-b2b4-e34239c85a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:45.270349 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d888a-679c-441d-b2b4-e34239c85a30 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:45.270655 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d888a-679c-441d-b2b4-e34239c85a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:45.270970 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d888a-679c-441d-b2b4-e34239c85a30 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:45.271632 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d888a-679c-441d-b2b4-e34239c85a30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:45.277319 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d888a-679c-441d-b2b4-e34239c85a30 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:45.296730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:45.405233 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:45.411885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aeec0a-7e94-4ecb-a40e-acb9cd10548f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:45.436723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 72/147] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Aug 11 10:42:45 2022] POST /identity/v3/users => generated 283 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:42:45.471662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d41b5-85e4-4714-a43a-53f981af9347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:45.472321 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d41b5-85e4-4714-a43a-53f981af9347 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:45.472626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d41b5-85e4-4714-a43a-53f981af9347 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:45.472872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d41b5-85e4-4714-a43a-53f981af9347 None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:45.474033 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d41b5-85e4-4714-a43a-53f981af9347 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:45.475603 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d41b5-85e4-4714-a43a-53f981af9347 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:45.477535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 76/148] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:45 2022] GET /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:45.483437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d888a-679c-441d-b2b4-e34239c85a30 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:45.539973 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2706c66-04b3-47c8-a298-a51e1603ad5b None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:45.540248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2706c66-04b3-47c8-a298-a51e1603ad5b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:45.540523 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2706c66-04b3-47c8-a298-a51e1603ad5b None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:45.541863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 77/149] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:42:45.548099 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1affa-a120-4836-a369-33a102e8a294 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:45.548380 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1affa-a120-4836-a369-33a102e8a294 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:45.548656 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1affa-a120-4836-a369-33a102e8a294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:45.568288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-10d1affa-a120-4836-a369-33a102e8a294 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:45.570623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-10d1affa-a120-4836-a369-33a102e8a294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:45.630134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d888a-679c-441d-b2b4-e34239c85a30 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:45.652631 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 78/150] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:42:45.684160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1affa-a120-4836-a369-33a102e8a294 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:45.700117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8a8f0-c1c1-4eef-8bd2-87dbca11419e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:45.701184 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8a8f0-c1c1-4eef-8bd2-87dbca11419e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:45.701476 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8a8f0-c1c1-4eef-8bd2-87dbca11419e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:45.701809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8a8f0-c1c1-4eef-8bd2-87dbca11419e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:45.702574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8a8f0-c1c1-4eef-8bd2-87dbca11419e None admin] RBAC: Adding query filter params (role.id=ea851d0cf29e44a1884d7c23431a7481, scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6, user.id=d2ada0c204a84a70b855ffcb0dbe36d7) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:45.702931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8a8f0-c1c1-4eef-8bd2-87dbca11419e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:45.704426 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8a8f0-c1c1-4eef-8bd2-87dbca11419e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:45.722815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 73/151] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:42:45 2022] GET /identity/v3/role_assignments?user.id=d2ada0c204a84a70b855ffcb0dbe36d7&scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6&role.id=ea851d0cf29e44a1884d7c23431a7481 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:45.827068 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:45.842008 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1affa-a120-4836-a369-33a102e8a294 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:45.888836 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2cfb6-46df-478f-aab6-b7c1f58522ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:45.890200 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2cfb6-46df-478f-aab6-b7c1f58522ec None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:45.890597 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2cfb6-46df-478f-aab6-b7c1f58522ec None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:45.890897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2cfb6-46df-478f-aab6-b7c1f58522ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:45.908405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2cfb6-46df-478f-aab6-b7c1f58522ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:45.913094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-8cd2cfb6-46df-478f-aab6-b7c1f58522ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 10:42:45.913094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:45.913094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:45.913094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:45.913094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:45.913094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:45.913094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:45.913094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:45.913094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:45.913094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:45.913094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:45.913094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:45.913094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:45.913094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:45.913094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:45.913094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:45.913904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:45.913904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:45.913904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:45.913904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:45.913904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:45.913904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:45.913904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:45.913904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:45.913904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:45.913904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:45.913904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:45.913904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:45.913904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:45.913904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:45.913904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:45.913904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:45.914626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:45.914626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:45.914626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:45.914626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:45.914626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:45.914626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:45.914626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:45.914626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:45.914626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:45.914626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:45.914626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 10:42:45.914626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:42:45.914626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 79/152] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:42:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:42:45.921175 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8a8f0-c1c1-4eef-8bd2-87dbca11419e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:45.996510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:46.045861 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8a8f0-c1c1-4eef-8bd2-87dbca11419e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:46.089258 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2901925-5b88-42e8-aa61-0dba9f0bb21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:46.090109 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2901925-5b88-42e8-aa61-0dba9f0bb21a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:46.090531 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2901925-5b88-42e8-aa61-0dba9f0bb21a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:46.090972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2901925-5b88-42e8-aa61-0dba9f0bb21a None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:46.091770 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2901925-5b88-42e8-aa61-0dba9f0bb21a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:46.092238 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2901925-5b88-42e8-aa61-0dba9f0bb21a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:46.094153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2901925-5b88-42e8-aa61-0dba9f0bb21a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:46.106281 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 74/153] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:42:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:46.112712 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2cfb6-46df-478f-aab6-b7c1f58522ec None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:46.246122 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2cfb6-46df-478f-aab6-b7c1f58522ec None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:46.287722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c31d16-8b74-4b57-8789-9992adb22455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:46.288383 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c31d16-8b74-4b57-8789-9992adb22455 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:46.288660 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c31d16-8b74-4b57-8789-9992adb22455 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:46.288931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c31d16-8b74-4b57-8789-9992adb22455 None admin] PATH_INFO: `/v3/users/1603872504f6486d8c83c22bdaeb5f90` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:46.290209 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c31d16-8b74-4b57-8789-9992adb22455 None admin] RBAC: Authorizing `identity:get_user(user_id=1603872504f6486d8c83c22bdaeb5f90)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:46.291715 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c31d16-8b74-4b57-8789-9992adb22455 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:46.293718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 80/154] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:46 2022] GET /identity/v3/users/1603872504f6486d8c83c22bdaeb5f90 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:46.299277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2901925-5b88-42e8-aa61-0dba9f0bb21a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:46.335129 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac948a6-9bb6-44a2-90a1-aefb81d62c3f None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:46.335420 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac948a6-9bb6-44a2-90a1-aefb81d62c3f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:46.335681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac948a6-9bb6-44a2-90a1-aefb81d62c3f None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:46.337017 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 81/155] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:42:46.342096 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd40ce-478d-4403-bfee-9a4998fd100c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:46.343093 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd40ce-478d-4403-bfee-9a4998fd100c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:46.343477 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd40ce-478d-4403-bfee-9a4998fd100c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:46.367619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1efd40ce-478d-4403-bfee-9a4998fd100c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:46.369265 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1efd40ce-478d-4403-bfee-9a4998fd100c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:46.389955 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:46.439432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2901925-5b88-42e8-aa61-0dba9f0bb21a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:46.463167 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 82/156] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:42:46.471191 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:46.485489 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76d524-1317-40d3-8f2e-cf6d4d3fca97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:46.486134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76d524-1317-40d3-8f2e-cf6d4d3fca97 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:46.486413 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76d524-1317-40d3-8f2e-cf6d4d3fca97 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:46.486688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76d524-1317-40d3-8f2e-cf6d4d3fca97 None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:46.487955 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76d524-1317-40d3-8f2e-cf6d4d3fca97 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:46.489651 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d76d524-1317-40d3-8f2e-cf6d4d3fca97 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:46.491753 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 75/157] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:46 2022] GET /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:46.491874 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd40ce-478d-4403-bfee-9a4998fd100c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:46.497424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76d524-1317-40d3-8f2e-cf6d4d3fca97 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:46.677451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd40ce-478d-4403-bfee-9a4998fd100c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:46.699402 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76d524-1317-40d3-8f2e-cf6d4d3fca97 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:46.746137 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74828070-7f33-4126-9a87-fd2f7a6a651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:46.746795 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74828070-7f33-4126-9a87-fd2f7a6a651f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:46.747076 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74828070-7f33-4126-9a87-fd2f7a6a651f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:46.751752 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74828070-7f33-4126-9a87-fd2f7a6a651f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:46.766532 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74828070-7f33-4126-9a87-fd2f7a6a651f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:46.771026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c154b-2281-4bde-ab1d-ed1b9dda5086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:46.771694 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c154b-2281-4bde-ab1d-ed1b9dda5086 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:46.771974 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c154b-2281-4bde-ab1d-ed1b9dda5086 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:46.776298 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c154b-2281-4bde-ab1d-ed1b9dda5086 None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6/users/1603872504f6486d8c83c22bdaeb5f90/roles/cef88e8a775e490a985ff36748d330f4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:46.776397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-74828070-7f33-4126-9a87-fd2f7a6a651f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:42:46.776397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:46.776397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:46.776397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:46.776397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:46.776397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:46.776397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:46.776397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:46.776397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:46.776397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:46.776397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:46.776397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:46.776397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:46.776397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:46.776397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:46.776397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:46.777160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:46.777160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:46.777160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:46.777160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:46.777160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:46.777160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:46.777160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:46.777160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:46.777160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:46.777160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:46.777160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:46.777160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:46.777160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:46.777160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:46.777160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:46.777160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:46.777914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:46.777914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:46.777914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:46.777914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:46.777914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:46.777914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:46.777914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:46.777914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:46.777914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:46.777914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:46.777914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:42:46.777914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:42:46.777914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 83/158] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:42:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:42:46.782399 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c154b-2281-4bde-ab1d-ed1b9dda5086 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6, user_id=1603872504f6486d8c83c22bdaeb5f90, role_id=cef88e8a775e490a985ff36748d330f4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:46.784015 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c154b-2281-4bde-ab1d-ed1b9dda5086 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:46.788803 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74828070-7f33-4126-9a87-fd2f7a6a651f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:46.803709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:46.899051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 76/159] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:42:46 2022] PUT /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6/users/1603872504f6486d8c83c22bdaeb5f90/roles/cef88e8a775e490a985ff36748d330f4 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:42:46.911259 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74828070-7f33-4126-9a87-fd2f7a6a651f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:46.952161 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b410a-f45d-499d-a7ac-52d8c43a9333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:46.952829 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b410a-f45d-499d-a7ac-52d8c43a9333 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:46.953184 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b410a-f45d-499d-a7ac-52d8c43a9333 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:46.953484 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b410a-f45d-499d-a7ac-52d8c43a9333 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:46.954232 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b410a-f45d-499d-a7ac-52d8c43a9333 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:46.954536 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b410a-f45d-499d-a7ac-52d8c43a9333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:46.956170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b410a-f45d-499d-a7ac-52d8c43a9333 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:46.970683 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 84/160] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:42:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:46.976356 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c154b-2281-4bde-ab1d-ed1b9dda5086 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:47.048509 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:47.107595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c154b-2281-4bde-ab1d-ed1b9dda5086 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:47.157702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c92d7-8602-438a-b070-cff4452db1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:47.158370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c92d7-8602-438a-b070-cff4452db1ef None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:47.158655 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c92d7-8602-438a-b070-cff4452db1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:47.158955 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c92d7-8602-438a-b070-cff4452db1ef None admin] PATH_INFO: `/v3/users/94631e4d22874dba849ec3d0cdff5210` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:47.160255 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c92d7-8602-438a-b070-cff4452db1ef None admin] RBAC: Authorizing `identity:get_user(user_id=94631e4d22874dba849ec3d0cdff5210)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:47.161741 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c92d7-8602-438a-b070-cff4452db1ef None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:47.163619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 77/161] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:46 2022] GET /identity/v3/users/94631e4d22874dba849ec3d0cdff5210 => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:47.169543 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b410a-f45d-499d-a7ac-52d8c43a9333 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:47.250735 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:47.288257 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b410a-f45d-499d-a7ac-52d8c43a9333 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:47.325413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c651f1-977c-44a6-8c50-6bbf91d261cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:47.326078 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c651f1-977c-44a6-8c50-6bbf91d261cb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:47.326364 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c651f1-977c-44a6-8c50-6bbf91d261cb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:47.326821 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c651f1-977c-44a6-8c50-6bbf91d261cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:47.407658 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c651f1-977c-44a6-8c50-6bbf91d261cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:47.409153 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c651f1-977c-44a6-8c50-6bbf91d261cb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:47.495796 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:47.532576 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 85/162] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:42:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:42:47.538300 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c92d7-8602-438a-b070-cff4452db1ef None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:47.659251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c92d7-8602-438a-b070-cff4452db1ef None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:47.681169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:47.690029 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05c580-8db7-4d2a-a384-05772a4534b6 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:47.690658 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05c580-8db7-4d2a-a384-05772a4534b6 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:47.691156 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05c580-8db7-4d2a-a384-05772a4534b6 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:47.692951 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 86/163] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:47.704716 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38afb6a-0844-4435-a8a8-6f7df9163f45 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:47.704716 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38afb6a-0844-4435-a8a8-6f7df9163f45 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:47.704716 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38afb6a-0844-4435-a8a8-6f7df9163f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:47.704985 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4229e-dcce-4e3e-99a2-9725ae2fb835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:47.704985 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4229e-dcce-4e3e-99a2-9725ae2fb835 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:47.704985 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4229e-dcce-4e3e-99a2-9725ae2fb835 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:47.704985 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4229e-dcce-4e3e-99a2-9725ae2fb835 None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:47.705243 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4229e-dcce-4e3e-99a2-9725ae2fb835 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:47.705243 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4229e-dcce-4e3e-99a2-9725ae2fb835 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:47.707002 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 78/164] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:47 2022] GET /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:47.713026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4229e-dcce-4e3e-99a2-9725ae2fb835 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:47.731856 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c38afb6a-0844-4435-a8a8-6f7df9163f45 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:47.733896 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c38afb6a-0844-4435-a8a8-6f7df9163f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:47.822879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4229e-dcce-4e3e-99a2-9725ae2fb835 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:47.852053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 87/165] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:42:47.856891 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971b3db-fc15-47c4-9d72-2ad1dfbc9d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:47.857509 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971b3db-fc15-47c4-9d72-2ad1dfbc9d44 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:47.857844 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971b3db-fc15-47c4-9d72-2ad1dfbc9d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:47.858244 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971b3db-fc15-47c4-9d72-2ad1dfbc9d44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:47.859515 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971b3db-fc15-47c4-9d72-2ad1dfbc9d44 None admin] RBAC: Adding query filter params (role.id=00c6de5dd6cd4267ba05941ddb91e6ad, scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6, user.id=94631e4d22874dba849ec3d0cdff5210) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:47.859833 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971b3db-fc15-47c4-9d72-2ad1dfbc9d44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:47.861286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971b3db-fc15-47c4-9d72-2ad1dfbc9d44 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:47.867544 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 79/166] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:42:47 2022] GET /identity/v3/role_assignments?user.id=94631e4d22874dba849ec3d0cdff5210&scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6&role.id=00c6de5dd6cd4267ba05941ddb91e6ad => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:47.889148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38afb6a-0844-4435-a8a8-6f7df9163f45 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:48.019226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38afb6a-0844-4435-a8a8-6f7df9163f45 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:48.021222 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:48.063047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b11b9a-b0a9-47c6-a797-fd4eb13fd0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:48.063716 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b11b9a-b0a9-47c6-a797-fd4eb13fd0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:48.063997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b11b9a-b0a9-47c6-a797-fd4eb13fd0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:48.064270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b11b9a-b0a9-47c6-a797-fd4eb13fd0f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:48.081347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b11b9a-b0a9-47c6-a797-fd4eb13fd0f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:48.086150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-14b11b9a-b0a9-47c6-a797-fd4eb13fd0f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:42:48.086150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:48.086150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:48.086150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:48.086150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:48.086150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:48.086150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:48.086150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:48.086150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:48.086150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:48.086150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:48.086150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:48.086150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:48.086150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:48.086150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:48.086150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:48.087101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:48.087101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:48.087101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:48.087101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:48.087101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:48.087101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:48.087101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:48.087101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:48.087101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:48.087101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:48.087101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:48.087101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:48.087101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:48.087101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:48.087101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:48.087101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:48.088053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:48.088053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:48.088053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:48.088053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:48.088053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:48.088053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:48.088053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:48.088053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:48.088053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:48.088053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:48.088053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:42:48.088053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:42:48.088053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 88/167] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:42:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:42:48.095309 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971b3db-fc15-47c4-9d72-2ad1dfbc9d44 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:48.186792 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:48.241732 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971b3db-fc15-47c4-9d72-2ad1dfbc9d44 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:48.281450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682caab-3f38-47b0-8d3f-da2c2da29218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:48.282311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682caab-3f38-47b0-8d3f-da2c2da29218 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:48.282789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682caab-3f38-47b0-8d3f-da2c2da29218 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:48.283229 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682caab-3f38-47b0-8d3f-da2c2da29218 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:48.284037 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682caab-3f38-47b0-8d3f-da2c2da29218 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:48.284482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682caab-3f38-47b0-8d3f-da2c2da29218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:48.286018 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682caab-3f38-47b0-8d3f-da2c2da29218 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:48.294948 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 80/168] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:42:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:48.301074 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b11b9a-b0a9-47c6-a797-fd4eb13fd0f6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:48.413445 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf8d2f-0c83-43b3-8c7f-c045b3d2a8d5 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:48.413969 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf8d2f-0c83-43b3-8c7f-c045b3d2a8d5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:48.414384 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf8d2f-0c83-43b3-8c7f-c045b3d2a8d5 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:48.416124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 81/169] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:48.421424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b125c1a-7a48-482d-8b85-dd794f7d7b1f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:48.421862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b125c1a-7a48-482d-8b85-dd794f7d7b1f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:48.422278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b125c1a-7a48-482d-8b85-dd794f7d7b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:48.441546 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1b125c1a-7a48-482d-8b85-dd794f7d7b1f None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:48.442987 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1b125c1a-7a48-482d-8b85-dd794f7d7b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:48.450462 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b11b9a-b0a9-47c6-a797-fd4eb13fd0f6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:48.495488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e290ca-19cb-4a2c-8999-4f3565e338ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:48.496094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e290ca-19cb-4a2c-8999-4f3565e338ce None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:48.496375 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e290ca-19cb-4a2c-8999-4f3565e338ce None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:48.496646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e290ca-19cb-4a2c-8999-4f3565e338ce None admin] PATH_INFO: `/v3/users/d2ada0c204a84a70b855ffcb0dbe36d7` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:48.497808 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e290ca-19cb-4a2c-8999-4f3565e338ce None admin] RBAC: Authorizing `identity:get_user(user_id=d2ada0c204a84a70b855ffcb0dbe36d7)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:48.500302 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e290ca-19cb-4a2c-8999-4f3565e338ce None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:48.501656 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 89/170] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:48 2022] GET /identity/v3/users/d2ada0c204a84a70b855ffcb0dbe36d7 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:48.507031 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e290ca-19cb-4a2c-8999-4f3565e338ce None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:48.517920 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 82/171] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:42:48.542220 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b125c1a-7a48-482d-8b85-dd794f7d7b1f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:48.551168 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:48.593358 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:48.645775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b125c1a-7a48-482d-8b85-dd794f7d7b1f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:48.679497 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1cc6d-b382-4c55-843f-884fdc3d0839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:48.680060 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1cc6d-b382-4c55-843f-884fdc3d0839 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:48.680346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1cc6d-b382-4c55-843f-884fdc3d0839 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:48.680618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1cc6d-b382-4c55-843f-884fdc3d0839 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:48.699812 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1cc6d-b382-4c55-843f-884fdc3d0839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:48.705338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-1ab1cc6d-b382-4c55-843f-884fdc3d0839 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:42:48.705338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:48.705338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:48.705338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:48.705338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:48.705338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:48.705338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:48.705338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:48.705338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:48.705338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:48.705338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:48.705338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:48.705338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:48.705338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:48.705338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:48.705338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:48.706215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:48.706215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:48.706215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:48.706215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:48.706215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:48.706215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:48.706215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:48.706215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:48.706215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:48.706215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:48.706215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:48.706215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:48.706215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:48.706215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:48.706215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:48.706215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:48.707014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:48.707014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:48.707014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:48.707014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:48.707014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:48.707014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:48.707014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:48.707014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:48.707014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:48.707014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:48.707014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:42:48.707014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:42:48.715172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 83/172] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:42:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:42:48.721724 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1cc6d-b382-4c55-843f-884fdc3d0839 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:48.735300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e290ca-19cb-4a2c-8999-4f3565e338ce None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:48.777242 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc6f21-28cb-417b-810a-2b61842e85c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:48.777889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc6f21-28cb-417b-810a-2b61842e85c8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:48.778175 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc6f21-28cb-417b-810a-2b61842e85c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:48.778452 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc6f21-28cb-417b-810a-2b61842e85c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:48.904438 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc6f21-28cb-417b-810a-2b61842e85c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:48.905990 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc6f21-28cb-417b-810a-2b61842e85c8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:48.947222 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:48.970912 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:48.976667 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1cc6d-b382-4c55-843f-884fdc3d0839 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:49.038939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 90/173] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:42:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 10:42:49.047465 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc6f21-28cb-417b-810a-2b61842e85c8 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:49.071472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877c51f-30c9-488b-a03f-2a0959183441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:49.072110 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877c51f-30c9-488b-a03f-2a0959183441 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:49.072398 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877c51f-30c9-488b-a03f-2a0959183441 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:49.072674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877c51f-30c9-488b-a03f-2a0959183441 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:49.073363 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877c51f-30c9-488b-a03f-2a0959183441 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:49.073675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877c51f-30c9-488b-a03f-2a0959183441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:49.075089 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877c51f-30c9-488b-a03f-2a0959183441 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:49.109533 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 84/174] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:42:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:49.116724 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877c51f-30c9-488b-a03f-2a0959183441 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:49.188628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc6f21-28cb-417b-810a-2b61842e85c8 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:49.222828 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:49.232998 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a5bda-6695-4fac-8f19-ef6e504346e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:49.233789 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a5bda-6695-4fac-8f19-ef6e504346e6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:49.234327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a5bda-6695-4fac-8f19-ef6e504346e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:49.234607 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a5bda-6695-4fac-8f19-ef6e504346e6 None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:49.240253 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a5bda-6695-4fac-8f19-ef6e504346e6 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:49.240253 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a5bda-6695-4fac-8f19-ef6e504346e6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:49.240418 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 91/175] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:49 2022] GET /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:49.246511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a5bda-6695-4fac-8f19-ef6e504346e6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:49.356510 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a5bda-6695-4fac-8f19-ef6e504346e6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:49.374083 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877c51f-30c9-488b-a03f-2a0959183441 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:49.403476 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48029b-fb6f-4c19-9793-096a75ffc41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:49.404628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48029b-fb6f-4c19-9793-096a75ffc41a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:49.406233 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48029b-fb6f-4c19-9793-096a75ffc41a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:49.407161 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48029b-fb6f-4c19-9793-096a75ffc41a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:49.407933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48029b-fb6f-4c19-9793-096a75ffc41a None admin] RBAC: Adding query filter params (role.id=e9cc929c9958498d8ce27ca88f685549, scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6, user.id=d2ada0c204a84a70b855ffcb0dbe36d7) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:49.408252 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48029b-fb6f-4c19-9793-096a75ffc41a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:49.409717 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48029b-fb6f-4c19-9793-096a75ffc41a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:49.421783 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 92/176] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:42:49 2022] GET /identity/v3/role_assignments?user.id=d2ada0c204a84a70b855ffcb0dbe36d7&scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6&role.id=e9cc929c9958498d8ce27ca88f685549 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:49.439571 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b5e05-5401-46f2-8725-19c3331b9b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:49.440233 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b5e05-5401-46f2-8725-19c3331b9b4f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:49.440512 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b5e05-5401-46f2-8725-19c3331b9b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:49.440782 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b5e05-5401-46f2-8725-19c3331b9b4f None admin] PATH_INFO: `/v3/users/d2ada0c204a84a70b855ffcb0dbe36d7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:49.447758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b5e05-5401-46f2-8725-19c3331b9b4f None admin] RBAC: Authorizing `identity:get_user(user_id=d2ada0c204a84a70b855ffcb0dbe36d7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:49.449289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b5e05-5401-46f2-8725-19c3331b9b4f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:49.451210 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 85/177] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:49 2022] GET /identity/v3/users/d2ada0c204a84a70b855ffcb0dbe36d7 => generated 275 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:49.457619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48029b-fb6f-4c19-9793-096a75ffc41a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:49.552213 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:49.604476 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48029b-fb6f-4c19-9793-096a75ffc41a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:49.655950 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa967e-c6cb-41d2-9267-5f05ef616a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:49.656567 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa967e-c6cb-41d2-9267-5f05ef616a16 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:49.656855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa967e-c6cb-41d2-9267-5f05ef616a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:49.657128 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa967e-c6cb-41d2-9267-5f05ef616a16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:49.755106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa967e-c6cb-41d2-9267-5f05ef616a16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:49.756608 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa967e-c6cb-41d2-9267-5f05ef616a16 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:49.821371 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49029cdd-6e23-490b-af22-1219cfaa043b None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:49.821863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49029cdd-6e23-490b-af22-1219cfaa043b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:49.821863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49029cdd-6e23-490b-af22-1219cfaa043b None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:49.823358 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 86/178] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:42:49.829267 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b82ca-f83f-4d57-9fe2-606b59e8f35c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:49.829572 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b82ca-f83f-4d57-9fe2-606b59e8f35c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:49.829846 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b82ca-f83f-4d57-9fe2-606b59e8f35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:49.841632 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:49.867854 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-254b82ca-f83f-4d57-9fe2-606b59e8f35c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:49.869062 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-254b82ca-f83f-4d57-9fe2-606b59e8f35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:49.894020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 93/179] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:42:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:42:49.900331 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa967e-c6cb-41d2-9267-5f05ef616a16 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:49.925267 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:50.012909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa967e-c6cb-41d2-9267-5f05ef616a16 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:50.017192 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 87/180] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:42:50.054015 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b82ca-f83f-4d57-9fe2-606b59e8f35c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:50.055483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb9e3d-bc7c-407f-9c6a-41697990caea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:50.056364 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb9e3d-bc7c-407f-9c6a-41697990caea None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:50.056834 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb9e3d-bc7c-407f-9c6a-41697990caea None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:50.057295 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb9e3d-bc7c-407f-9c6a-41697990caea None admin] PATH_INFO: `/v3/projects/f05bb246416f4682a59e422c692b65e6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:50.058731 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb9e3d-bc7c-407f-9c6a-41697990caea None admin] RBAC: Authorizing `identity:get_project(project_id=f05bb246416f4682a59e422c692b65e6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:50.060428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb9e3d-bc7c-407f-9c6a-41697990caea None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:50.062916 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 94/181] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:49 2022] GET /identity/v3/projects/f05bb246416f4682a59e422c692b65e6 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:50.068920 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb9e3d-bc7c-407f-9c6a-41697990caea None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:50.107145 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:50.182536 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb9e3d-bc7c-407f-9c6a-41697990caea None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:50.194611 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b82ca-f83f-4d57-9fe2-606b59e8f35c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:50.224218 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca36c45-6b40-4351-bb99-7f6aeb975748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:50.225124 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca36c45-6b40-4351-bb99-7f6aeb975748 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:50.225663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca36c45-6b40-4351-bb99-7f6aeb975748 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:50.226107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca36c45-6b40-4351-bb99-7f6aeb975748 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:50.227151 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca36c45-6b40-4351-bb99-7f6aeb975748 None admin] RBAC: Adding query filter params (role.id=ea851d0cf29e44a1884d7c23431a7481, scope.project.id=f05bb246416f4682a59e422c692b65e6, user.id=d2ada0c204a84a70b855ffcb0dbe36d7) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:50.227638 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca36c45-6b40-4351-bb99-7f6aeb975748 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:50.229670 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca36c45-6b40-4351-bb99-7f6aeb975748 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:50.231370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c62d4b-c439-4f59-81e7-ad64f2da6307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:50.232010 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c62d4b-c439-4f59-81e7-ad64f2da6307 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:50.232290 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c62d4b-c439-4f59-81e7-ad64f2da6307 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:50.232558 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c62d4b-c439-4f59-81e7-ad64f2da6307 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:50.237591 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 95/182] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:42:50 2022] GET /identity/v3/role_assignments?user.id=d2ada0c204a84a70b855ffcb0dbe36d7&scope.project.id=f05bb246416f4682a59e422c692b65e6&role.id=ea851d0cf29e44a1884d7c23431a7481 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:50.246477 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98f298-8832-4e76-b223-b8d654fff643 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:50.246477 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98f298-8832-4e76-b223-b8d654fff643 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:50.246477 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98f298-8832-4e76-b223-b8d654fff643 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:50.246477 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 96/183] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:50.252250 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a37bbf-ae14-4ee5-a65a-e04ac6a46a44 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:50.252541 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a37bbf-ae14-4ee5-a65a-e04ac6a46a44 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:50.252805 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a37bbf-ae14-4ee5-a65a-e04ac6a46a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:50.259389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c62d4b-c439-4f59-81e7-ad64f2da6307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:50.264737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c4c62d4b-c439-4f59-81e7-ad64f2da6307 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:42:50.264737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:50.264737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:50.264737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:50.264737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:50.264737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:50.264737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:50.264737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:50.264737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:50.264737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:50.264737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:50.264737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:50.264737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:50.264737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:50.264737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:50.264737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:50.265807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:50.265807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:50.265807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:50.265807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:50.265807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:50.265807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:50.265807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:50.265807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:50.265807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:50.265807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:50.265807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:50.265807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:50.265807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:50.265807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:50.265807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:50.265807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:50.266561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:50.266561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:50.266561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:50.266561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:50.266561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:50.266561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:50.266561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:50.266561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:50.266561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:50.266561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:50.266561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:42:50.266561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:42:50.266561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 88/184] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:42:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:42:50.267764 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad950475-c30b-4427-9d7a-7b1a0ce8ac77 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:50.267946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad950475-c30b-4427-9d7a-7b1a0ce8ac77 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:50.268196 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad950475-c30b-4427-9d7a-7b1a0ce8ac77 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:50.269437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 89/185] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:50.271578 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d380d93-4598-44e0-8c8a-6d16a55b8e5f None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:50.271578 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d380d93-4598-44e0-8c8a-6d16a55b8e5f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:50.271578 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d380d93-4598-44e0-8c8a-6d16a55b8e5f None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:50.272515 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 90/186] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:50.273949 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d380d93-4598-44e0-8c8a-6d16a55b8e5f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:50.280577 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-34a37bbf-ae14-4ee5-a65a-e04ac6a46a44 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:50.281804 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-34a37bbf-ae14-4ee5-a65a-e04ac6a46a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:50.299233 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:50.356728 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 97/187] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:50.367452 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab75a4b-f719-4112-a534-37b7c6381056 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:50.367452 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab75a4b-f719-4112-a534-37b7c6381056 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:50.367452 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab75a4b-f719-4112-a534-37b7c6381056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:50.384000 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-9ab75a4b-f719-4112-a534-37b7c6381056 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:50.385224 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9ab75a4b-f719-4112-a534-37b7c6381056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:50.401809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d380d93-4598-44e0-8c8a-6d16a55b8e5f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:50.405557 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:50.450001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751c6a2-2c16-43df-a7f2-43a556ea0ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:50.450974 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751c6a2-2c16-43df-a7f2-43a556ea0ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:50.451288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751c6a2-2c16-43df-a7f2-43a556ea0ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:50.452265 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d751c6a2-2c16-43df-a7f2-43a556ea0ed5 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:50.453278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751c6a2-2c16-43df-a7f2-43a556ea0ed5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:50.453595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751c6a2-2c16-43df-a7f2-43a556ea0ed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:50.455046 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d751c6a2-2c16-43df-a7f2-43a556ea0ed5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:50.462002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 98/188] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:50.463570 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e60361-cc4c-4d15-b254-42def432ac57 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:50.463722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 91/189] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:42:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:50.464158 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e60361-cc4c-4d15-b254-42def432ac57 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:50.464538 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751c6a2-2c16-43df-a7f2-43a556ea0ed5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:50.464761 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e60361-cc4c-4d15-b254-42def432ac57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:50.489462 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-28e60361-cc4c-4d15-b254-42def432ac57 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:50.490645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-28e60361-cc4c-4d15-b254-42def432ac57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:50.552097 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:50.560098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 99/190] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:50.562908 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e60361-cc4c-4d15-b254-42def432ac57 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:50.571583 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d751c6a2-2c16-43df-a7f2-43a556ea0ed5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:50.608309 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921cdf2-6ab4-4029-ae58-c74255f00789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:50.608951 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921cdf2-6ab4-4029-ae58-c74255f00789 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:50.609498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921cdf2-6ab4-4029-ae58-c74255f00789 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:50.609767 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921cdf2-6ab4-4029-ae58-c74255f00789 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:50.620787 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921cdf2-6ab4-4029-ae58-c74255f00789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:50.625647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c921cdf2-6ab4-4029-ae58-c74255f00789 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 10:42:50.625647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:50.625647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:50.625647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:50.625647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:50.625647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:50.625647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:50.625647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:50.625647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:50.625647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:50.625647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:50.625647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:50.625647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:50.625647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:50.625647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:50.625647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:50.626482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:50.626482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:50.626482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:50.626482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:50.626482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:50.626482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:50.626482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:50.626482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:50.626482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:50.626482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:50.626482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:50.626482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:50.626482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:50.626482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:50.626482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:50.626482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:50.627285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:50.627285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:50.627285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:50.627285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:50.627285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:50.627285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:50.627285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:50.627285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:50.627285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:50.627285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:50.627285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 10:42:50.627285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:42:50.627285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 92/191] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:42:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:42:50.627911 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921cdf2-6ab4-4029-ae58-c74255f00789 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:50.646360 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:50.661853 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e60361-cc4c-4d15-b254-42def432ac57 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:50.694423 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c286d-6f5a-4f8b-8c06-2f48bcd7a5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:50.695077 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c286d-6f5a-4f8b-8c06-2f48bcd7a5aa None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:50.695355 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c286d-6f5a-4f8b-8c06-2f48bcd7a5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:50.695625 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c286d-6f5a-4f8b-8c06-2f48bcd7a5aa None admin] PATH_INFO: `/v3/users/0101580d0c37412e99286be49e265bc6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:50.708539 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c286d-6f5a-4f8b-8c06-2f48bcd7a5aa None admin] RBAC: Authorizing `identity:get_user(user_id=0101580d0c37412e99286be49e265bc6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:50.710012 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c286d-6f5a-4f8b-8c06-2f48bcd7a5aa None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:50.711674 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 100/192] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:50 2022] GET /identity/v3/users/0101580d0c37412e99286be49e265bc6 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:50.712433 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c286d-6f5a-4f8b-8c06-2f48bcd7a5aa None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:50.728809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921cdf2-6ab4-4029-ae58-c74255f00789 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:50.762167 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50596227-17e3-4595-9fc1-23a943e39e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:50.762812 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50596227-17e3-4595-9fc1-23a943e39e87 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:50.763092 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50596227-17e3-4595-9fc1-23a943e39e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:50.763361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50596227-17e3-4595-9fc1-23a943e39e87 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:50.774067 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50596227-17e3-4595-9fc1-23a943e39e87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:50.779517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-50596227-17e3-4595-9fc1-23a943e39e87 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:42:50.779517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:50.779517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:50.779517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:50.779517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:50.779517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:50.779517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:50.779517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:50.779517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:50.779517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:50.779517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:50.779517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:50.779517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:50.779517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:50.779517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:50.779517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:50.780364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:50.780364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:50.780364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:50.780364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:50.780364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:50.780364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:50.780364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:50.780364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:50.780364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:50.780364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:50.780364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:50.780364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:50.780364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:50.780364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:50.780364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:50.780364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:50.781139 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:50.781139 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:50.781139 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:50.781139 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:50.781139 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:50.781139 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:50.781139 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:50.781139 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:50.781139 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:50.781139 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:50.781139 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:42:50.781139 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:42:50.781139 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 93/193] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:42:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:42:50.781782 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50596227-17e3-4595-9fc1-23a943e39e87 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:50.784203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:50.814989 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c286d-6f5a-4f8b-8c06-2f48bcd7a5aa None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:50.847994 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b41639-212f-4898-86e4-d5b5990fe971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:50.848617 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b41639-212f-4898-86e4-d5b5990fe971 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:50.848903 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b41639-212f-4898-86e4-d5b5990fe971 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:50.849170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b41639-212f-4898-86e4-d5b5990fe971 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:50.850254 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b41639-212f-4898-86e4-d5b5990fe971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:50.851723 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b41639-212f-4898-86e4-d5b5990fe971 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:50.853459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 101/194] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:42:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:50.854018 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b41639-212f-4898-86e4-d5b5990fe971 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:50.866418 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:50.884631 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50596227-17e3-4595-9fc1-23a943e39e87 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:50.917691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9ed0e-c16d-4640-b309-5ea901ee8444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:50.918302 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9ed0e-c16d-4640-b309-5ea901ee8444 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:50.918584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9ed0e-c16d-4640-b309-5ea901ee8444 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:50.918892 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9ed0e-c16d-4640-b309-5ea901ee8444 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:50.919559 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9ed0e-c16d-4640-b309-5ea901ee8444 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:50.919861 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9ed0e-c16d-4640-b309-5ea901ee8444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:50.921535 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9ed0e-c16d-4640-b309-5ea901ee8444 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:50.929512 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 94/195] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:42:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:50.931442 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9ed0e-c16d-4640-b309-5ea901ee8444 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:50.954747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b41639-212f-4898-86e4-d5b5990fe971 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:50.987228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d159523-bcae-45e8-ba18-e37a574e23bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:50.987832 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d159523-bcae-45e8-ba18-e37a574e23bd None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:50.988109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d159523-bcae-45e8-ba18-e37a574e23bd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:50.988374 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d159523-bcae-45e8-ba18-e37a574e23bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:50.992591 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:51.035160 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9ed0e-c16d-4640-b309-5ea901ee8444 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:51.054084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d159523-bcae-45e8-ba18-e37a574e23bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:51.055597 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d159523-bcae-45e8-ba18-e37a574e23bd None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:51.066978 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:51.068431 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492147a0-6835-4276-88ba-12f9676f92c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:51.069030 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492147a0-6835-4276-88ba-12f9676f92c1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:51.069307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492147a0-6835-4276-88ba-12f9676f92c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:51.069581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492147a0-6835-4276-88ba-12f9676f92c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:51.070231 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492147a0-6835-4276-88ba-12f9676f92c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:51.070527 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492147a0-6835-4276-88ba-12f9676f92c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:51.071905 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492147a0-6835-4276-88ba-12f9676f92c1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:51.079820 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 95/196] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:42:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:51.079820 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492147a0-6835-4276-88ba-12f9676f92c1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:51.152430 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 102/197] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:42:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:42:51.157778 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d159523-bcae-45e8-ba18-e37a574e23bd None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:51.182142 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492147a0-6835-4276-88ba-12f9676f92c1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:51.208825 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:51.217573 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be9131-420e-430a-8551-d183e49bce2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:51.218179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be9131-420e-430a-8551-d183e49bce2e None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:51.220951 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be9131-420e-430a-8551-d183e49bce2e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:51.220951 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be9131-420e-430a-8551-d183e49bce2e None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:51.220951 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be9131-420e-430a-8551-d183e49bce2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:51.220951 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be9131-420e-430a-8551-d183e49bce2e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:51.254505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d159523-bcae-45e8-ba18-e37a574e23bd None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:51.265696 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:51.287789 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2dcb0-982a-4144-9c85-705a633d00bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:51.288410 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2dcb0-982a-4144-9c85-705a633d00bb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:51.288695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2dcb0-982a-4144-9c85-705a633d00bb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:51.288969 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2dcb0-982a-4144-9c85-705a633d00bb None admin] PATH_INFO: `/v3/users/1603872504f6486d8c83c22bdaeb5f90` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:51.290090 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2dcb0-982a-4144-9c85-705a633d00bb None admin] RBAC: Authorizing `identity:get_user(user_id=1603872504f6486d8c83c22bdaeb5f90)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:51.291931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2dcb0-982a-4144-9c85-705a633d00bb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:51.294925 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 103/198] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:51 2022] GET /identity/v3/users/1603872504f6486d8c83c22bdaeb5f90 => generated 289 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:51.297116 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2dcb0-982a-4144-9c85-705a633d00bb None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:51.303870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 96/199] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Aug 11 10:42:51 2022] POST /identity/v3/users => generated 297 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:42:51.319001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be9131-420e-430a-8551-d183e49bce2e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:51.422340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2dcb0-982a-4144-9c85-705a633d00bb None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:51.449533 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be9131-420e-430a-8551-d183e49bce2e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:51.465589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f2518-df50-478f-9a2e-a0b44dad586e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:51.467521 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f2518-df50-478f-9a2e-a0b44dad586e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:51.469357 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f2518-df50-478f-9a2e-a0b44dad586e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:51.469357 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f2518-df50-478f-9a2e-a0b44dad586e None admin] PATH_INFO: `/v3/users/0101580d0c37412e99286be49e265bc6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:51.469685 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f2518-df50-478f-9a2e-a0b44dad586e None admin] RBAC: Authorizing `identity:get_user(user_id=0101580d0c37412e99286be49e265bc6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:51.471217 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f2518-df50-478f-9a2e-a0b44dad586e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:51.477691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 104/200] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:51 2022] GET /identity/v3/users/0101580d0c37412e99286be49e265bc6 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:51.479142 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f2518-df50-478f-9a2e-a0b44dad586e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:51.500840 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e17125-3d2b-417f-8dc8-2863fcfd03ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:51.501489 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e17125-3d2b-417f-8dc8-2863fcfd03ab None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:51.501769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e17125-3d2b-417f-8dc8-2863fcfd03ab None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:51.502045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e17125-3d2b-417f-8dc8-2863fcfd03ab None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:51.503233 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e17125-3d2b-417f-8dc8-2863fcfd03ab None admin] RBAC: Authorizing `identity:get_project(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:51.504725 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e17125-3d2b-417f-8dc8-2863fcfd03ab None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:51.506371 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 97/201] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:51 2022] GET /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:51.507260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e17125-3d2b-417f-8dc8-2863fcfd03ab None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:51.542836 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:51.580482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:51.617713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f2518-df50-478f-9a2e-a0b44dad586e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:51.658831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e17125-3d2b-417f-8dc8-2863fcfd03ab None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:51.671452 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a570be-be81-40a6-8b1e-3e2c0a725ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:51.672461 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a570be-be81-40a6-8b1e-3e2c0a725ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:51.672925 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a570be-be81-40a6-8b1e-3e2c0a725ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:51.673205 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a570be-be81-40a6-8b1e-3e2c0a725ad8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:51.713215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bd4f4-3689-4606-9963-05c412074fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:51.714619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bd4f4-3689-4606-9963-05c412074fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:51.714619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bd4f4-3689-4606-9963-05c412074fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:51.714619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bd4f4-3689-4606-9963-05c412074fb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:51.760956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a570be-be81-40a6-8b1e-3e2c0a725ad8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:51.762423 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a570be-be81-40a6-8b1e-3e2c0a725ad8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:51.836774 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:51.882797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0bd4f4-3689-4606-9963-05c412074fb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:51.882797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0bd4f4-3689-4606-9963-05c412074fb5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:51.940355 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 105/202] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:42:51.941160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a570be-be81-40a6-8b1e-3e2c0a725ad8 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:51.958967 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:52.018936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 98/203] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:42:52.020131 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bd4f4-3689-4606-9963-05c412074fb5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:52.089253 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a570be-be81-40a6-8b1e-3e2c0a725ad8 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:52.128563 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b84940-7e32-48c8-a740-4a4d7015a6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:52.129331 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b84940-7e32-48c8-a740-4a4d7015a6ae None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:52.129703 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b84940-7e32-48c8-a740-4a4d7015a6ae None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:52.130067 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b84940-7e32-48c8-a740-4a4d7015a6ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:52.130937 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b84940-7e32-48c8-a740-4a4d7015a6ae None admin] RBAC: Adding query filter params (role.id=00c6de5dd6cd4267ba05941ddb91e6ad, scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c, user.id=0101580d0c37412e99286be49e265bc6) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:52.131358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b84940-7e32-48c8-a740-4a4d7015a6ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:52.132895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b84940-7e32-48c8-a740-4a4d7015a6ae None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:52.138714 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 106/204] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:42:51 2022] GET /identity/v3/role_assignments?user.id=0101580d0c37412e99286be49e265bc6&scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c&role.id=00c6de5dd6cd4267ba05941ddb91e6ad => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:52.147980 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b84940-7e32-48c8-a740-4a4d7015a6ae None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:52.149738 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bd4f4-3689-4606-9963-05c412074fb5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:52.171229 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:52.202571 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d37e50-8b0c-4f50-8af8-ffdf0fa59b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:52.203159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d37e50-8b0c-4f50-8af8-ffdf0fa59b4c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:52.203434 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d37e50-8b0c-4f50-8af8-ffdf0fa59b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:52.203705 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d37e50-8b0c-4f50-8af8-ffdf0fa59b4c None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:52.205528 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d37e50-8b0c-4f50-8af8-ffdf0fa59b4c None admin] RBAC: Authorizing `identity:get_project(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:52.207020 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d37e50-8b0c-4f50-8af8-ffdf0fa59b4c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:52.208993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 99/205] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:52 2022] GET /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:52.218110 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d37e50-8b0c-4f50-8af8-ffdf0fa59b4c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:52.258567 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:52.340276 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b84940-7e32-48c8-a740-4a4d7015a6ae None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:52.394606 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef155075-289e-4814-a6a8-4f0eac1f591a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:52.395646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef155075-289e-4814-a6a8-4f0eac1f591a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:52.396129 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef155075-289e-4814-a6a8-4f0eac1f591a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:52.396622 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef155075-289e-4814-a6a8-4f0eac1f591a None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:52.397952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef155075-289e-4814-a6a8-4f0eac1f591a None admin] RBAC: Authorizing `identity:get_project(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:52.399656 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef155075-289e-4814-a6a8-4f0eac1f591a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:52.401498 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 107/206] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:52 2022] GET /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:52.402631 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d37e50-8b0c-4f50-8af8-ffdf0fa59b4c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:52.408845 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef155075-289e-4814-a6a8-4f0eac1f591a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:52.441038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb1a34-fafb-4287-9503-d75210ff002d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:52.441627 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb1a34-fafb-4287-9503-d75210ff002d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:52.441911 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb1a34-fafb-4287-9503-d75210ff002d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:52.442234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb1a34-fafb-4287-9503-d75210ff002d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:52.442992 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb1a34-fafb-4287-9503-d75210ff002d None admin] RBAC: Adding query filter params (role.id=cef88e8a775e490a985ff36748d330f4, scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6, user.id=1603872504f6486d8c83c22bdaeb5f90) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:52.443296 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb1a34-fafb-4287-9503-d75210ff002d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:52.444946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb1a34-fafb-4287-9503-d75210ff002d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:52.451054 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 100/207] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:42:52 2022] GET /identity/v3/role_assignments?user.id=1603872504f6486d8c83c22bdaeb5f90&scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6&role.id=cef88e8a775e490a985ff36748d330f4 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:52.536022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:52.561534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef155075-289e-4814-a6a8-4f0eac1f591a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:52.603415 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be582e-1df1-475b-8e78-343d935851c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:52.604385 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be582e-1df1-475b-8e78-343d935851c6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:52.604884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be582e-1df1-475b-8e78-343d935851c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:52.605161 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be582e-1df1-475b-8e78-343d935851c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:52.605903 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be582e-1df1-475b-8e78-343d935851c6 None admin] RBAC: Adding query filter params (role.id=e9cc929c9958498d8ce27ca88f685549, scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c, user.id=0101580d0c37412e99286be49e265bc6) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:52.606275 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be582e-1df1-475b-8e78-343d935851c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:52.611628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be582e-1df1-475b-8e78-343d935851c6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:52.618948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 108/208] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:42:52 2022] GET /identity/v3/role_assignments?user.id=0101580d0c37412e99286be49e265bc6&scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c&role.id=e9cc929c9958498d8ce27ca88f685549 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:53.574019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be8a79-931d-45ee-b860-fb57792d5810 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:53.574535 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be8a79-931d-45ee-b860-fb57792d5810 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:53.574609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be8a79-931d-45ee-b860-fb57792d5810 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:53.576168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 101/209] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:53.581955 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010f0a5-e684-4fa7-8531-4c8f73796c88 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:53.582390 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010f0a5-e684-4fa7-8531-4c8f73796c88 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:53.582531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010f0a5-e684-4fa7-8531-4c8f73796c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:53.600401 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-2010f0a5-e684-4fa7-8531-4c8f73796c88 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:53.601578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2010f0a5-e684-4fa7-8531-4c8f73796c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:53.670162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 109/210] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:53.692695 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be8a79-931d-45ee-b860-fb57792d5810 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:53.696306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cbe3e-5d85-4150-b3fb-731b01b04bf2 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:53.696593 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cbe3e-5d85-4150-b3fb-731b01b04bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:53.696871 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cbe3e-5d85-4150-b3fb-731b01b04bf2 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:53.698472 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 110/211] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:53.703895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc19440-18bc-429e-af4f-178adf46664c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:53.704180 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc19440-18bc-429e-af4f-178adf46664c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:53.704454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc19440-18bc-429e-af4f-178adf46664c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:53.722487 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-8dc19440-18bc-429e-af4f-178adf46664c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:53.723697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8dc19440-18bc-429e-af4f-178adf46664c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:53.797890 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 111/212] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:42:53.819456 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:53.824539 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc19440-18bc-429e-af4f-178adf46664c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:53.827839 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:53.845848 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be8a79-931d-45ee-b860-fb57792d5810 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:53.895350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ca4b6-bebd-4397-aa23-a85bae76c841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:53.896388 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ca4b6-bebd-4397-aa23-a85bae76c841 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:53.896868 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ca4b6-bebd-4397-aa23-a85bae76c841 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:53.897487 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ca4b6-bebd-4397-aa23-a85bae76c841 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:53.911665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ca4b6-bebd-4397-aa23-a85bae76c841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:53.917968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-df1ca4b6-bebd-4397-aa23-a85bae76c841 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:42:53.917968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:53.917968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:53.917968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:53.917968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:53.917968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:53.917968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:53.917968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:53.917968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:53.917968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:53.917968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:53.917968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:53.917968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:53.917968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:53.917968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:53.917968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:53.918866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:53.918866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:53.918866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:53.918866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:53.918866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:53.918866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:53.918866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:53.918866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:53.918866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:53.918866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:53.918866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:53.918866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:53.918866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:53.918866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:53.918866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:53.918866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:53.919614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:53.919614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:53.919614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:53.919614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:53.919614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:53.919614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:53.919614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:53.919614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:53.919614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:53.919614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:53.919614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:42:53.919614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:42:53.922651 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 102/213] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:42:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:42:53.928805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ca4b6-bebd-4397-aa23-a85bae76c841 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:53.945510 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc19440-18bc-429e-af4f-178adf46664c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:53.990352 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b311c-4bac-43d0-b21a-e081956481f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:53.991010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b311c-4bac-43d0-b21a-e081956481f2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:53.991290 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b311c-4bac-43d0-b21a-e081956481f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:53.991558 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b311c-4bac-43d0-b21a-e081956481f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:53.993338 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b311c-4bac-43d0-b21a-e081956481f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:53.995365 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b311c-4bac-43d0-b21a-e081956481f2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:54.002823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 112/214] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:42:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:54.004753 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b311c-4bac-43d0-b21a-e081956481f2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:54.050011 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ca4b6-bebd-4397-aa23-a85bae76c841 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:54.088142 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27816125-0317-4b76-bf01-697a482dda5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:54.089197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27816125-0317-4b76-bf01-697a482dda5f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:54.089731 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27816125-0317-4b76-bf01-697a482dda5f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:54.090203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27816125-0317-4b76-bf01-697a482dda5f None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:54.091113 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27816125-0317-4b76-bf01-697a482dda5f None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:54.091699 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27816125-0317-4b76-bf01-697a482dda5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:54.093789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27816125-0317-4b76-bf01-697a482dda5f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:54.097298 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:54.108835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 103/215] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:42:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:54.110283 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27816125-0317-4b76-bf01-697a482dda5f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:54.115578 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:54.133233 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b311c-4bac-43d0-b21a-e081956481f2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:54.168638 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d847e6-d2ff-4995-8712-60dfd5ae8e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:54.169021 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d847e6-d2ff-4995-8712-60dfd5ae8e49 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:54.169301 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d847e6-d2ff-4995-8712-60dfd5ae8e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:54.169572 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d847e6-d2ff-4995-8712-60dfd5ae8e49 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:54.170859 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d847e6-d2ff-4995-8712-60dfd5ae8e49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:54.172350 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d847e6-d2ff-4995-8712-60dfd5ae8e49 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:54.233919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27816125-0317-4b76-bf01-697a482dda5f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:54.269360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94416a82-99cc-43c9-86f1-dc9abee92cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:54.269990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94416a82-99cc-43c9-86f1-dc9abee92cbe None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:54.270275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94416a82-99cc-43c9-86f1-dc9abee92cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:54.270548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94416a82-99cc-43c9-86f1-dc9abee92cbe None admin] PATH_INFO: `/v3/users/124a3c498d9f4f25b933b699a6c04e0b` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:54.283980 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94416a82-99cc-43c9-86f1-dc9abee92cbe None admin] RBAC: Authorizing `identity:get_user(user_id=124a3c498d9f4f25b933b699a6c04e0b)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:54.285443 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94416a82-99cc-43c9-86f1-dc9abee92cbe None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:54.287419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 104/216] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:54 2022] GET /identity/v3/users/124a3c498d9f4f25b933b699a6c04e0b => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:54.292811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94416a82-99cc-43c9-86f1-dc9abee92cbe None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:54.307569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 113/217] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Aug 11 10:42:54 2022] POST /identity/v3/users => generated 297 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:42:54.372613 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:54.418977 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94416a82-99cc-43c9-86f1-dc9abee92cbe None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:54.438361 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7bc5e-14b2-4c4c-9659-37e278022c9c None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:54.438651 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7bc5e-14b2-4c4c-9659-37e278022c9c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:54.438977 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7bc5e-14b2-4c4c-9659-37e278022c9c None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:54.440493 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 114/218] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:54.446882 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311abf0-d4da-447c-8f40-471bc35e1eaa None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:54.447170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311abf0-d4da-447c-8f40-471bc35e1eaa None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:54.447442 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311abf0-d4da-447c-8f40-471bc35e1eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:54.465438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc1694-902d-4408-b54f-f79e96706b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:54.466067 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc1694-902d-4408-b54f-f79e96706b6a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:54.466348 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc1694-902d-4408-b54f-f79e96706b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:54.466621 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc1694-902d-4408-b54f-f79e96706b6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:54.468624 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f311abf0-d4da-447c-8f40-471bc35e1eaa None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:54.470169 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f311abf0-d4da-447c-8f40-471bc35e1eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:54.553405 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc1694-902d-4408-b54f-f79e96706b6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:54.555599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc1694-902d-4408-b54f-f79e96706b6a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:54.564028 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 115/219] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:42:54.586441 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311abf0-d4da-447c-8f40-471bc35e1eaa None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:54.643632 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:54.652874 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:54.694313 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 105/220] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:42:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 10:42:54.699927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc1694-902d-4408-b54f-f79e96706b6a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:54.711117 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311abf0-d4da-447c-8f40-471bc35e1eaa None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:54.772058 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fea848-ef28-4f29-b814-7456483d1597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:54.773341 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fea848-ef28-4f29-b814-7456483d1597 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:54.773841 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fea848-ef28-4f29-b814-7456483d1597 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:54.774306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fea848-ef28-4f29-b814-7456483d1597 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:54.793067 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fea848-ef28-4f29-b814-7456483d1597 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:54.799436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-93fea848-ef28-4f29-b814-7456483d1597 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:42:54.799436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:54.799436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:54.799436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:54.799436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:54.799436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:54.799436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:54.799436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:54.799436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:54.799436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:54.799436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:54.799436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:54.799436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:54.799436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:54.799436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:54.799436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:54.800306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:54.800306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:54.800306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:54.800306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:54.800306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:54.800306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:54.800306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:54.800306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:54.800306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:54.800306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:54.800306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:54.800306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:54.800306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:54.800306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:54.800306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:54.800306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:54.801042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:54.801042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:54.801042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:54.801042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:54.801042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:54.801042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:54.801042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:54.801042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:54.801042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:54.801042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:54.801042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:42:54.801042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:42:54.804607 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 116/221] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:42:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:42:54.811871 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fea848-ef28-4f29-b814-7456483d1597 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:54.838407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc1694-902d-4408-b54f-f79e96706b6a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:54.881252 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07080c3-a214-4e1d-b05e-104c8109e9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:54.882057 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07080c3-a214-4e1d-b05e-104c8109e9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:54.882340 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07080c3-a214-4e1d-b05e-104c8109e9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:54.883026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07080c3-a214-4e1d-b05e-104c8109e9e1 None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:54.884422 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07080c3-a214-4e1d-b05e-104c8109e9e1 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:54.886324 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07080c3-a214-4e1d-b05e-104c8109e9e1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:54.890913 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 106/222] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:54 2022] GET /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:54.892250 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc0098-b4b1-4f3d-9e00-0f1ff42e980c None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:54.892546 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc0098-b4b1-4f3d-9e00-0f1ff42e980c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:54.892999 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc0098-b4b1-4f3d-9e00-0f1ff42e980c None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:54.894387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 107/223] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:54.895077 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc0098-b4b1-4f3d-9e00-0f1ff42e980c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:54.935111 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:54.944073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fea848-ef28-4f29-b814-7456483d1597 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:54.962106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:54.981181 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20959405-fd0a-4548-bbd4-6bd708f9d982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:54.982084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20959405-fd0a-4548-bbd4-6bd708f9d982 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:54.982365 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20959405-fd0a-4548-bbd4-6bd708f9d982 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:54.983400 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20959405-fd0a-4548-bbd4-6bd708f9d982 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:54.984797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20959405-fd0a-4548-bbd4-6bd708f9d982 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:54.985106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20959405-fd0a-4548-bbd4-6bd708f9d982 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:54.987368 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20959405-fd0a-4548-bbd4-6bd708f9d982 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:55.002982 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 117/224] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:42:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:55.004683 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324af6da-f29c-4da3-8112-906b83e78318 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:55.004976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324af6da-f29c-4da3-8112-906b83e78318 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:55.005252 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324af6da-f29c-4da3-8112-906b83e78318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:55.027835 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-324af6da-f29c-4da3-8112-906b83e78318 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:55.029030 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-324af6da-f29c-4da3-8112-906b83e78318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:55.036028 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc0098-b4b1-4f3d-9e00-0f1ff42e980c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:55.075482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf45a32-3947-4e1c-872e-d879941852dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:55.077118 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf45a32-3947-4e1c-872e-d879941852dd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:55.077827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf45a32-3947-4e1c-872e-d879941852dd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:55.078315 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf45a32-3947-4e1c-872e-d879941852dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:55.079349 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf45a32-3947-4e1c-872e-d879941852dd None admin] RBAC: Adding query filter params (role.id=ea851d0cf29e44a1884d7c23431a7481, scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c, user.id=124a3c498d9f4f25b933b699a6c04e0b) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:55.079876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf45a32-3947-4e1c-872e-d879941852dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:55.081526 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf45a32-3947-4e1c-872e-d879941852dd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:55.088137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 108/225] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:42:54 2022] GET /identity/v3/role_assignments?user.id=124a3c498d9f4f25b933b699a6c04e0b&scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c&role.id=ea851d0cf29e44a1884d7c23431a7481 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:55.089178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf45a32-3947-4e1c-872e-d879941852dd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:55.139164 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 118/226] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:55.157724 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324af6da-f29c-4da3-8112-906b83e78318 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:55.272424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324af6da-f29c-4da3-8112-906b83e78318 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:55.283440 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:55.292690 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:55.299957 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf45a32-3947-4e1c-872e-d879941852dd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:55.309822 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c90da-11e9-45a7-b432-f785094f1cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:55.311009 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c90da-11e9-45a7-b432-f785094f1cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:55.311312 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c90da-11e9-45a7-b432-f785094f1cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:55.311586 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c90da-11e9-45a7-b432-f785094f1cf9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:55.323127 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c90da-11e9-45a7-b432-f785094f1cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:55.328194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-8e4c90da-11e9-45a7-b432-f785094f1cf9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:42:55.328194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:55.328194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:55.328194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:55.328194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:55.328194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:55.328194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:55.328194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:55.328194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:55.328194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:55.328194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:55.328194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:55.328194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:55.328194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:55.328194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:55.328194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:55.329049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:55.329049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:55.329049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:55.329049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:55.329049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:55.329049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:55.329049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:55.329049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:55.329049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:55.329049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:55.329049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:55.329049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:55.329049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:55.329049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:55.329049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:55.329049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:55.330280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:55.330280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:55.330280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:55.330280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:55.330280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:55.330280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:55.330280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:55.330280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:55.330280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:55.330280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:55.330280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:42:55.330280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:42:55.330280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 119/227] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:42:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:42:55.334984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c90da-11e9-45a7-b432-f785094f1cf9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:55.338323 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a65d1-4a1c-4e81-9e75-0ec7b0b01ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:55.339331 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a65d1-4a1c-4e81-9e75-0ec7b0b01ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:55.339942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a65d1-4a1c-4e81-9e75-0ec7b0b01ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:55.341104 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a65d1-4a1c-4e81-9e75-0ec7b0b01ee9 None admin] PATH_INFO: `/v3/users/0101580d0c37412e99286be49e265bc6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:55.341694 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a65d1-4a1c-4e81-9e75-0ec7b0b01ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=0101580d0c37412e99286be49e265bc6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:55.343830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a65d1-4a1c-4e81-9e75-0ec7b0b01ee9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:55.345806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 109/228] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:55 2022] GET /identity/v3/users/0101580d0c37412e99286be49e265bc6 => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:55.351456 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a65d1-4a1c-4e81-9e75-0ec7b0b01ee9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:55.455697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a65d1-4a1c-4e81-9e75-0ec7b0b01ee9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:55.489991 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c90da-11e9-45a7-b432-f785094f1cf9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:55.492012 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dedd44-4e02-4f53-9dbe-3632cf7c63ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:55.492662 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dedd44-4e02-4f53-9dbe-3632cf7c63ea None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:55.492983 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dedd44-4e02-4f53-9dbe-3632cf7c63ea None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:55.493250 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dedd44-4e02-4f53-9dbe-3632cf7c63ea None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:55.494453 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dedd44-4e02-4f53-9dbe-3632cf7c63ea None admin] RBAC: Authorizing `identity:get_project(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:55.495932 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dedd44-4e02-4f53-9dbe-3632cf7c63ea None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:55.502871 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 110/229] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:55 2022] GET /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:55.504358 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dedd44-4e02-4f53-9dbe-3632cf7c63ea None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:55.536348 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:55.550441 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdbdd5-3fcc-48da-b091-3cd761e5a441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:55.555495 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdbdd5-3fcc-48da-b091-3cd761e5a441 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:55.555495 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdbdd5-3fcc-48da-b091-3cd761e5a441 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:55.555495 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdbdd5-3fcc-48da-b091-3cd761e5a441 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:55.555495 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bdbdd5-3fcc-48da-b091-3cd761e5a441 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:55.555495 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bdbdd5-3fcc-48da-b091-3cd761e5a441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:55.555495 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bdbdd5-3fcc-48da-b091-3cd761e5a441 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:55.570369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 120/230] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:42:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:55.576014 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdbdd5-3fcc-48da-b091-3cd761e5a441 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:55.610352 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dedd44-4e02-4f53-9dbe-3632cf7c63ea None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:55.624199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:55.646538 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd1df8-dafa-446e-be35-a8da6eca8025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:55.647305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd1df8-dafa-446e-be35-a8da6eca8025 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:55.647546 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd1df8-dafa-446e-be35-a8da6eca8025 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:55.647826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd1df8-dafa-446e-be35-a8da6eca8025 None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c/users/0101580d0c37412e99286be49e265bc6/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:55.649781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd1df8-dafa-446e-be35-a8da6eca8025 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c, user_id=0101580d0c37412e99286be49e265bc6, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:55.651350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd1df8-dafa-446e-be35-a8da6eca8025 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:55.701005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdbdd5-3fcc-48da-b091-3cd761e5a441 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:55.737258 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad732a-2b2b-4429-ba3e-3e6ca256442c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:55.737859 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad732a-2b2b-4429-ba3e-3e6ca256442c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:55.738136 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad732a-2b2b-4429-ba3e-3e6ca256442c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:55.738446 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad732a-2b2b-4429-ba3e-3e6ca256442c None admin] PATH_INFO: `/v3/users/0101580d0c37412e99286be49e265bc6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:55.739637 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad732a-2b2b-4429-ba3e-3e6ca256442c None admin] RBAC: Authorizing `identity:get_user(user_id=0101580d0c37412e99286be49e265bc6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:55.741081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad732a-2b2b-4429-ba3e-3e6ca256442c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:55.742895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 121/231] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:55 2022] GET /identity/v3/users/0101580d0c37412e99286be49e265bc6 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:55.748345 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad732a-2b2b-4429-ba3e-3e6ca256442c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:55.760296 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 111/232] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:42:55 2022] PUT /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c/users/0101580d0c37412e99286be49e265bc6/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:42:55.853511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:55.858684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad732a-2b2b-4429-ba3e-3e6ca256442c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:55.896226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41477838-5a6a-4243-bfd9-529ffe9c9f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:55.896883 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41477838-5a6a-4243-bfd9-529ffe9c9f87 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:55.897158 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41477838-5a6a-4243-bfd9-529ffe9c9f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:55.897423 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41477838-5a6a-4243-bfd9-529ffe9c9f87 None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:55.898650 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41477838-5a6a-4243-bfd9-529ffe9c9f87 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:55.900200 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41477838-5a6a-4243-bfd9-529ffe9c9f87 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:55.902212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 122/233] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:55 2022] GET /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:55.908641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd1df8-dafa-446e-be35-a8da6eca8025 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:56.034736 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:56.050749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd1df8-dafa-446e-be35-a8da6eca8025 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:56.105016 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe5c88-c339-4e6c-a21a-de3c9aa6dabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:56.105679 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe5c88-c339-4e6c-a21a-de3c9aa6dabb None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:56.105957 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe5c88-c339-4e6c-a21a-de3c9aa6dabb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:56.106229 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe5c88-c339-4e6c-a21a-de3c9aa6dabb None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c/users/0101580d0c37412e99286be49e265bc6/roles/e9cc929c9958498d8ce27ca88f685549` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:56.112692 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe5c88-c339-4e6c-a21a-de3c9aa6dabb None admin] RBAC: Authorizing `identity:create_grant(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c, user_id=0101580d0c37412e99286be49e265bc6, role_id=e9cc929c9958498d8ce27ca88f685549)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:56.114154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe5c88-c339-4e6c-a21a-de3c9aa6dabb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:56.237174 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 112/234] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:42:55 2022] PUT /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c/users/0101580d0c37412e99286be49e265bc6/roles/e9cc929c9958498d8ce27ca88f685549 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:42:56.892944 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fe97f-e244-4e0c-a7b4-9bd6e21b6185 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:56.893613 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fe97f-e244-4e0c-a7b4-9bd6e21b6185 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:56.893613 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fe97f-e244-4e0c-a7b4-9bd6e21b6185 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:56.895104 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 123/235] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:56.900230 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac06ab-6d7a-41b7-9b70-24aa3b03996c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:56.900715 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac06ab-6d7a-41b7-9b70-24aa3b03996c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:56.900882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac06ab-6d7a-41b7-9b70-24aa3b03996c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:56.924688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a5ac06ab-6d7a-41b7-9b70-24aa3b03996c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:56.925874 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a5ac06ab-6d7a-41b7-9b70-24aa3b03996c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:57.013100 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 113/236] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:57.056269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fe97f-e244-4e0c-a7b4-9bd6e21b6185 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:57.140812 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f113a-3d80-4442-b479-69cb19ffb883 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:57.141134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f113a-3d80-4442-b479-69cb19ffb883 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:57.141363 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f113a-3d80-4442-b479-69cb19ffb883 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:57.142791 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 114/237] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:57.147816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1c3bd-047f-44b5-bcda-d4300e82e4ee None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:57.148037 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1c3bd-047f-44b5-bcda-d4300e82e4ee None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:57.148308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1c3bd-047f-44b5-bcda-d4300e82e4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:57.167013 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ccf1c3bd-047f-44b5-bcda-d4300e82e4ee None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:57.168246 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ccf1c3bd-047f-44b5-bcda-d4300e82e4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:57.201750 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fe97f-e244-4e0c-a7b4-9bd6e21b6185 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:57.238752 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 115/238] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:42:57.262431 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1c3bd-047f-44b5-bcda-d4300e82e4ee None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:57.265639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ddd34-204e-4001-88f4-8e89859b1a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:57.266399 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ddd34-204e-4001-88f4-8e89859b1a40 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:57.266682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ddd34-204e-4001-88f4-8e89859b1a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:57.266976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ddd34-204e-4001-88f4-8e89859b1a40 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:57.279908 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:57.291674 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ddd34-204e-4001-88f4-8e89859b1a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:57.297466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-b31ddd34-204e-4001-88f4-8e89859b1a40 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 10:42:57.297466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:57.297466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:57.297466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:57.297466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:57.297466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:57.297466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:57.297466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:57.297466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:57.297466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:57.297466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:57.297466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:57.297466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:57.297466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:57.297466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:57.297466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:57.303785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:57.303785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:57.303785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:57.303785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:57.303785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:57.303785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:57.303785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:57.303785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:57.303785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:57.303785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:57.303785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:57.303785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:57.303785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:57.303785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:57.303785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:57.303785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:57.304665 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:57.304665 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:57.304665 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:57.304665 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:57.304665 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:57.304665 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:57.304665 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:57.304665 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:57.304665 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:57.304665 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:57.304665 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 10:42:57.304665 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:42:57.304665 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 124/239] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:42:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:42:57.306369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ddd34-204e-4001-88f4-8e89859b1a40 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:57.366300 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1c3bd-047f-44b5-bcda-d4300e82e4ee None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:57.380621 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:57.405746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26911f72-1c47-4547-b862-be18a9b5a542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:57.406283 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26911f72-1c47-4547-b862-be18a9b5a542 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:57.406634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26911f72-1c47-4547-b862-be18a9b5a542 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:57.407003 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26911f72-1c47-4547-b862-be18a9b5a542 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:57.408344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26911f72-1c47-4547-b862-be18a9b5a542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:57.409808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26911f72-1c47-4547-b862-be18a9b5a542 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:57.411894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 116/240] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:42:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:57.413978 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b6d39-f315-4380-93b5-cda57ef81189 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:57.414266 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b6d39-f315-4380-93b5-cda57ef81189 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:57.414540 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b6d39-f315-4380-93b5-cda57ef81189 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:57.420197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 117/241] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:57.421155 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b6d39-f315-4380-93b5-cda57ef81189 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:57.478126 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ddd34-204e-4001-88f4-8e89859b1a40 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:57.522460 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:57.524343 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b087d-35e5-47d2-9926-6828d211d390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:57.524959 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b087d-35e5-47d2-9926-6828d211d390 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:57.525452 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b087d-35e5-47d2-9926-6828d211d390 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:57.525725 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b087d-35e5-47d2-9926-6828d211d390 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:57.527605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b087d-35e5-47d2-9926-6828d211d390 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:57.528466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b087d-35e5-47d2-9926-6828d211d390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:57.530356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b087d-35e5-47d2-9926-6828d211d390 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:57.542059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 125/242] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:42:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:57.543771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82951f6-d2ce-42cc-9dd4-b1735e6f4595 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:57.544261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82951f6-d2ce-42cc-9dd4-b1735e6f4595 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:57.544755 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82951f6-d2ce-42cc-9dd4-b1735e6f4595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:57.552499 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b6d39-f315-4380-93b5-cda57ef81189 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:57.567601 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e82951f6-d2ce-42cc-9dd4-b1735e6f4595 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:57.569739 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e82951f6-d2ce-42cc-9dd4-b1735e6f4595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:57.591462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631efbc-6ab4-4831-8d9c-2e1c1b2be925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:57.592119 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631efbc-6ab4-4831-8d9c-2e1c1b2be925 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:57.592401 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631efbc-6ab4-4831-8d9c-2e1c1b2be925 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:57.592674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631efbc-6ab4-4831-8d9c-2e1c1b2be925 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:57.593605 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631efbc-6ab4-4831-8d9c-2e1c1b2be925 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:57.595123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631efbc-6ab4-4831-8d9c-2e1c1b2be925 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:57.650790 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 126/243] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:57.650790 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82951f6-d2ce-42cc-9dd4-b1735e6f4595 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:57.669252 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:57.716242 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 118/244] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Aug 11 10:42:57 2022] POST /identity/v3/users => generated 293 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:42:57.717151 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631efbc-6ab4-4831-8d9c-2e1c1b2be925 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:57.769011 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82951f6-d2ce-42cc-9dd4-b1735e6f4595 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:57.816939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797e1be-8f5f-4427-b38a-f4ec90614bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:57.818215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797e1be-8f5f-4427-b38a-f4ec90614bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:57.818734 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797e1be-8f5f-4427-b38a-f4ec90614bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:57.819232 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797e1be-8f5f-4427-b38a-f4ec90614bd4 None admin] PATH_INFO: `/v3/users/d7c7c5c733b64acc8cab8a4191191a7a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:57.836683 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797e1be-8f5f-4427-b38a-f4ec90614bd4 None admin] RBAC: Authorizing `identity:get_user(user_id=d7c7c5c733b64acc8cab8a4191191a7a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:57.839078 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797e1be-8f5f-4427-b38a-f4ec90614bd4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:57.841221 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 127/245] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:57 2022] GET /identity/v3/users/d7c7c5c733b64acc8cab8a4191191a7a => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:57.847949 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797e1be-8f5f-4427-b38a-f4ec90614bd4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:57.945218 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:57.973509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797e1be-8f5f-4427-b38a-f4ec90614bd4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:57.988562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631efbc-6ab4-4831-8d9c-2e1c1b2be925 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:58.021480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a25502-93ca-45aa-b535-278eba631f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:58.022932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a25502-93ca-45aa-b535-278eba631f36 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:58.023450 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a25502-93ca-45aa-b535-278eba631f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:58.024048 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a25502-93ca-45aa-b535-278eba631f36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:58.027767 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995032f-6042-492c-920e-5acb7d7ce29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:58.028413 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995032f-6042-492c-920e-5acb7d7ce29d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:58.028693 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995032f-6042-492c-920e-5acb7d7ce29d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:58.028967 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995032f-6042-492c-920e-5acb7d7ce29d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:58.031861 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:58.045878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995032f-6042-492c-920e-5acb7d7ce29d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:58.054186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b995032f-6042-492c-920e-5acb7d7ce29d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:42:58.054186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:58.054186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:58.054186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:58.054186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:58.054186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:58.054186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:58.054186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:58.054186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:58.054186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:58.054186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:58.054186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:58.054186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:58.054186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:58.054186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:58.054186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:58.055094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:58.055094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:58.055094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:58.055094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:58.055094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:58.055094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:58.055094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:58.055094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:58.055094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:58.055094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:58.055094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:58.055094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:58.055094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:58.055094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:58.055094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:58.055094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:58.055867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:58.055867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:58.055867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:58.055867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:58.055867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:58.055867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:58.055867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:58.055867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:58.055867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:58.055867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:58.055867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:42:58.055867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:42:58.055867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 119/246] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:42:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:42:58.061484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995032f-6042-492c-920e-5acb7d7ce29d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:58.125184 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a25502-93ca-45aa-b535-278eba631f36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:58.125801 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a25502-93ca-45aa-b535-278eba631f36 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:58.198085 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995032f-6042-492c-920e-5acb7d7ce29d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:58.228841 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:58.243014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064579b2-2817-4efc-833f-74c88386513b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:58.243678 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064579b2-2817-4efc-833f-74c88386513b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:58.243959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064579b2-2817-4efc-833f-74c88386513b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:58.244233 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064579b2-2817-4efc-833f-74c88386513b None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:58.244905 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064579b2-2817-4efc-833f-74c88386513b None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:58.245257 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064579b2-2817-4efc-833f-74c88386513b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:58.246660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064579b2-2817-4efc-833f-74c88386513b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:58.257208 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 128/247] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:42:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 10:42:58.261783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 120/248] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:42:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:58.263228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a25502-93ca-45aa-b535-278eba631f36 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:58.264099 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064579b2-2817-4efc-833f-74c88386513b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:58.332650 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:58.385863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a25502-93ca-45aa-b535-278eba631f36 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:58.392716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064579b2-2817-4efc-833f-74c88386513b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:58.433570 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd0c4b-1538-445f-a8f8-ed66f5327bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:58.434670 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd0c4b-1538-445f-a8f8-ed66f5327bfe None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:58.435216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd0c4b-1538-445f-a8f8-ed66f5327bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:58.436168 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd0c4b-1538-445f-a8f8-ed66f5327bfe None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:58.437723 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd0c4b-1538-445f-a8f8-ed66f5327bfe None admin] RBAC: Authorizing `identity:get_project(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:58.438041 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc58c53-9a69-43cc-94f8-cf63caaee6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:58.438797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc58c53-9a69-43cc-94f8-cf63caaee6bd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:58.439182 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc58c53-9a69-43cc-94f8-cf63caaee6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:58.439568 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc58c53-9a69-43cc-94f8-cf63caaee6bd None admin] PATH_INFO: `/v3/users/124a3c498d9f4f25b933b699a6c04e0b` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:58.440026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd0c4b-1538-445f-a8f8-ed66f5327bfe None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:58.440890 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc58c53-9a69-43cc-94f8-cf63caaee6bd None admin] RBAC: Authorizing `identity:get_user(user_id=124a3c498d9f4f25b933b699a6c04e0b)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:58.442369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 129/249] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:58 2022] GET /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:58.442483 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc58c53-9a69-43cc-94f8-cf63caaee6bd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:58.446806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 121/250] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:58 2022] GET /identity/v3/users/124a3c498d9f4f25b933b699a6c04e0b => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:58.448321 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd0c4b-1538-445f-a8f8-ed66f5327bfe None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:58.451835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc58c53-9a69-43cc-94f8-cf63caaee6bd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:58.508848 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:58.582134 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd0c4b-1538-445f-a8f8-ed66f5327bfe None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:58.586390 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc58c53-9a69-43cc-94f8-cf63caaee6bd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:58.618123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:58.621124 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d21e2c-615e-4a4e-a3a2-a67d69bc6725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:58.621745 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d21e2c-615e-4a4e-a3a2-a67d69bc6725 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:58.622023 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d21e2c-615e-4a4e-a3a2-a67d69bc6725 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:58.622295 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d21e2c-615e-4a4e-a3a2-a67d69bc6725 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:58.623348 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d21e2c-615e-4a4e-a3a2-a67d69bc6725 None admin] RBAC: Adding query filter params (role.id=cef88e8a775e490a985ff36748d330f4, scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c, user.id=d7c7c5c733b64acc8cab8a4191191a7a) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:58.623724 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d21e2c-615e-4a4e-a3a2-a67d69bc6725 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:58.625194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d21e2c-615e-4a4e-a3a2-a67d69bc6725 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:58.630364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be45aa-7663-4279-8498-f30a23953a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:58.631029 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be45aa-7663-4279-8498-f30a23953a72 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:58.631310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be45aa-7663-4279-8498-f30a23953a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:58.631577 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 130/251] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:42:58 2022] GET /identity/v3/role_assignments?user.id=d7c7c5c733b64acc8cab8a4191191a7a&scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c&role.id=cef88e8a775e490a985ff36748d330f4 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:58.631694 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be45aa-7663-4279-8498-f30a23953a72 None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:58.632706 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be45aa-7663-4279-8498-f30a23953a72 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:58.632879 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3737578-05f6-44ec-8f90-9d7010d331ca None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:58.633140 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3737578-05f6-44ec-8f90-9d7010d331ca None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:58.633418 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3737578-05f6-44ec-8f90-9d7010d331ca None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:58.634138 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be45aa-7663-4279-8498-f30a23953a72 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:58.634940 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 131/252] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:58.644352 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 122/253] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:42:58 2022] GET /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:58.645581 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e0cfa-d356-404d-a644-97b629921cd6 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:58.645875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e0cfa-d356-404d-a644-97b629921cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:58.646153 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e0cfa-d356-404d-a644-97b629921cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:58.658270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be45aa-7663-4279-8498-f30a23953a72 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:58.683812 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-407e0cfa-d356-404d-a644-97b629921cd6 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:58.685025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-407e0cfa-d356-404d-a644-97b629921cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:58.805854 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be45aa-7663-4279-8498-f30a23953a72 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:58.852948 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4e2f7-0ff8-43f6-add7-8af45962ddbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:58.853649 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4e2f7-0ff8-43f6-add7-8af45962ddbc None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:58.853929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4e2f7-0ff8-43f6-add7-8af45962ddbc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:58.854202 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4e2f7-0ff8-43f6-add7-8af45962ddbc None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c/users/124a3c498d9f4f25b933b699a6c04e0b/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:58.856386 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4e2f7-0ff8-43f6-add7-8af45962ddbc None admin] RBAC: Authorizing `identity:create_grant(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c, user_id=124a3c498d9f4f25b933b699a6c04e0b, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:58.858688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4e2f7-0ff8-43f6-add7-8af45962ddbc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:58.860794 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 132/254] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:42:58.901203 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e0cfa-d356-404d-a644-97b629921cd6 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:58.932831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 123/255] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:42:58 2022] PUT /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c/users/124a3c498d9f4f25b933b699a6c04e0b/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:42:58.933942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f65799-b9b2-44a8-921b-235a725e741e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:58.934227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f65799-b9b2-44a8-921b-235a725e741e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:58.934498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f65799-b9b2-44a8-921b-235a725e741e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:58.938369 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 124/256] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:42:58.942181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcf236-eaaa-473f-939f-07bf38cfe397 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:58.942508 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcf236-eaaa-473f-939f-07bf38cfe397 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:58.942835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efcf236-eaaa-473f-939f-07bf38cfe397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:58.965089 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0efcf236-eaaa-473f-939f-07bf38cfe397 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:42:58.966918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0efcf236-eaaa-473f-939f-07bf38cfe397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:42:58.976326 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:59.045213 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e0cfa-d356-404d-a644-97b629921cd6 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:59.076294 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:59.083179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b33442-914b-49db-835d-a23f88d9cac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:59.083838 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b33442-914b-49db-835d-a23f88d9cac5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:59.084125 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b33442-914b-49db-835d-a23f88d9cac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:59.084403 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b33442-914b-49db-835d-a23f88d9cac5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:59.110462 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b33442-914b-49db-835d-a23f88d9cac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:59.116279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-c2b33442-914b-49db-835d-a23f88d9cac5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:42:59.116279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:59.116279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:59.116279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:59.116279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:59.116279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:59.116279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:59.116279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:59.116279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:59.116279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:59.116279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:59.116279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:59.116279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:59.116279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:59.116279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:59.116279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:59.117201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:59.117201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:59.117201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:59.117201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:59.117201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:59.117201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:59.117201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:59.117201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:59.117201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:59.117201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:59.117201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:59.117201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:59.117201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:59.117201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:59.117201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:59.117201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:59.117995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:59.117995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:59.117995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:59.117995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:59.117995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:59.117995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:59.117995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:59.117995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:59.117995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:59.117995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:59.117995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:42:59.117995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:42:59.117995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 133/257] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:42:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:42:59.124731 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b33442-914b-49db-835d-a23f88d9cac5 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:59.131534 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 125/258] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:42:59.172800 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcf236-eaaa-473f-939f-07bf38cfe397 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:59.305983 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:59.312669 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b33442-914b-49db-835d-a23f88d9cac5 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:59.344304 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efcf236-eaaa-473f-939f-07bf38cfe397 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:59.380681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba4264-925c-4ef2-9adc-691893a26097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:59.381902 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba4264-925c-4ef2-9adc-691893a26097 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:59.384522 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba4264-925c-4ef2-9adc-691893a26097 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:59.385004 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba4264-925c-4ef2-9adc-691893a26097 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:59.385930 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba4264-925c-4ef2-9adc-691893a26097 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:59.387096 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba4264-925c-4ef2-9adc-691893a26097 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:59.389268 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba4264-925c-4ef2-9adc-691893a26097 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:59.406640 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 134/259] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:42:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:59.412140 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba4264-925c-4ef2-9adc-691893a26097 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:59.416228 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286cbac-e002-41ff-8754-444ce3967465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:59.417385 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286cbac-e002-41ff-8754-444ce3967465 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:59.418722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286cbac-e002-41ff-8754-444ce3967465 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:59.419227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286cbac-e002-41ff-8754-444ce3967465 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:59.441494 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286cbac-e002-41ff-8754-444ce3967465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:42:59.449754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-6286cbac-e002-41ff-8754-444ce3967465 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:42:59.449754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:42:59.449754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:42:59.449754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:42:59.449754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:42:59.449754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:42:59.449754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:42:59.449754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:42:59.449754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:42:59.449754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:42:59.449754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:42:59.449754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:42:59.449754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:42:59.449754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:42:59.449754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:42:59.449754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:42:59.450609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:42:59.450609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:42:59.450609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:42:59.450609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:42:59.450609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:42:59.450609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:42:59.450609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:42:59.450609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:42:59.450609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:42:59.450609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:42:59.450609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:42:59.450609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:42:59.450609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:42:59.450609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:42:59.450609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:42:59.450609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:42:59.452183 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:42:59.452183 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:42:59.452183 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:42:59.452183 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:42:59.452183 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:42:59.452183 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:42:59.452183 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:42:59.452183 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:42:59.452183 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:42:59.452183 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:42:59.452183 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:42:59.452183 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:42:59.457158 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 126/260] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:42:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:42:59.464539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286cbac-e002-41ff-8754-444ce3967465 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:59.542257 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:59.606638 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba4264-925c-4ef2-9adc-691893a26097 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:59.625841 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286cbac-e002-41ff-8754-444ce3967465 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:59.676753 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c99f60-4e72-4e7e-a40e-a5aed6347987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:59.677763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c99f60-4e72-4e7e-a40e-a5aed6347987 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:59.678242 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c99f60-4e72-4e7e-a40e-a5aed6347987 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:59.678738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c99f60-4e72-4e7e-a40e-a5aed6347987 None admin] PATH_INFO: `/v3/users/0101580d0c37412e99286be49e265bc6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:59.680602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c99f60-4e72-4e7e-a40e-a5aed6347987 None admin] RBAC: Authorizing `identity:get_user(user_id=0101580d0c37412e99286be49e265bc6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:59.682406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c99f60-4e72-4e7e-a40e-a5aed6347987 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:59.686996 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 135/261] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:59 2022] GET /identity/v3/users/0101580d0c37412e99286be49e265bc6 => generated 283 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:42:59.689232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584d081-4e8d-436d-88ec-a437b574c072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:59.690091 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584d081-4e8d-436d-88ec-a437b574c072 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:59.690731 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584d081-4e8d-436d-88ec-a437b574c072 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:59.691415 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584d081-4e8d-436d-88ec-a437b574c072 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:59.693331 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c99f60-4e72-4e7e-a40e-a5aed6347987 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:59.696912 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584d081-4e8d-436d-88ec-a437b574c072 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:42:59.697497 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584d081-4e8d-436d-88ec-a437b574c072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:59.700172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6584d081-4e8d-436d-88ec-a437b574c072 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:59.717856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 127/262] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:42:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:59.723555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584d081-4e8d-436d-88ec-a437b574c072 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:59.751937 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:59.884479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c99f60-4e72-4e7e-a40e-a5aed6347987 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:59.885682 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584d081-4e8d-436d-88ec-a437b574c072 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:42:59.890323 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:42:59.933227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9aa5a-2eb3-47ad-9646-f1f0caea6064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:59.934541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9aa5a-2eb3-47ad-9646-f1f0caea6064 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:59.935064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9aa5a-2eb3-47ad-9646-f1f0caea6064 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:59.936116 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9aa5a-2eb3-47ad-9646-f1f0caea6064 None admin] PATH_INFO: `/v3/users/0101580d0c37412e99286be49e265bc6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:42:59.937544 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9aa5a-2eb3-47ad-9646-f1f0caea6064 None admin] RBAC: Authorizing `identity:get_user(user_id=0101580d0c37412e99286be49e265bc6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:42:59.939416 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9aa5a-2eb3-47ad-9646-f1f0caea6064 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:42:59.941782 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 128/263] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:42:59 2022] GET /identity/v3/users/0101580d0c37412e99286be49e265bc6 => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:42:59.952377 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9aa5a-2eb3-47ad-9646-f1f0caea6064 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:42:59.960171 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3239e-ef93-4398-899d-283aa91a8e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:42:59.960171 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3239e-ef93-4398-899d-283aa91a8e73 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:42:59.960171 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3239e-ef93-4398-899d-283aa91a8e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:42:59.960171 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3239e-ef93-4398-899d-283aa91a8e73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:00.036830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3239e-ef93-4398-899d-283aa91a8e73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:00.038302 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad3239e-ef93-4398-899d-283aa91a8e73 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:00.066657 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:00.157029 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9aa5a-2eb3-47ad-9646-f1f0caea6064 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:00.214141 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afb8c5-6b96-4440-b23b-6a7a7451edf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:00.214781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afb8c5-6b96-4440-b23b-6a7a7451edf7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:00.215072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afb8c5-6b96-4440-b23b-6a7a7451edf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:00.215347 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6afb8c5-6b96-4440-b23b-6a7a7451edf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:00.245860 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 136/264] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:42:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 10:43:00.260599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3239e-ef93-4398-899d-283aa91a8e73 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:00.293112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:00.353351 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6afb8c5-6b96-4440-b23b-6a7a7451edf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:00.354840 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6afb8c5-6b96-4440-b23b-6a7a7451edf7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:00.509437 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3239e-ef93-4398-899d-283aa91a8e73 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:00.537792 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 129/265] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:42:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:43:00.542183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:00.548977 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afb8c5-6b96-4440-b23b-6a7a7451edf7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:00.550951 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a64ab3-1549-4702-b48b-101c40972adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:00.551714 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a64ab3-1549-4702-b48b-101c40972adb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:00.551997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a64ab3-1549-4702-b48b-101c40972adb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:00.552272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a64ab3-1549-4702-b48b-101c40972adb None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:00.558884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a64ab3-1549-4702-b48b-101c40972adb None admin] RBAC: Authorizing `identity:get_project(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:00.558884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a64ab3-1549-4702-b48b-101c40972adb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:00.558884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 137/266] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:43:00 2022] GET /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:00.563521 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a64ab3-1549-4702-b48b-101c40972adb None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:00.672745 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a64ab3-1549-4702-b48b-101c40972adb None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:00.708186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:00.719466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd3565-d877-4ebc-a61c-11826e47d25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:00.720276 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd3565-d877-4ebc-a61c-11826e47d25d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:00.720698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd3565-d877-4ebc-a61c-11826e47d25d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:00.721111 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd3565-d877-4ebc-a61c-11826e47d25d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:00.722008 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd3565-d877-4ebc-a61c-11826e47d25d None admin] RBAC: Adding query filter params (role.id=00c6de5dd6cd4267ba05941ddb91e6ad, scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c, user.id=0101580d0c37412e99286be49e265bc6) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:00.722460 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd3565-d877-4ebc-a61c-11826e47d25d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:00.725155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd3565-d877-4ebc-a61c-11826e47d25d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:00.743733 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 138/267] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:43:00 2022] GET /identity/v3/role_assignments?user.id=0101580d0c37412e99286be49e265bc6&scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c&role.id=00c6de5dd6cd4267ba05941ddb91e6ad => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:00.766335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6afb8c5-6b96-4440-b23b-6a7a7451edf7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:00.810981 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7716f2e-da17-4456-871c-d9359543afa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:00.815686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7716f2e-da17-4456-871c-d9359543afa5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:00.816180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7716f2e-da17-4456-871c-d9359543afa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:00.816601 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7716f2e-da17-4456-871c-d9359543afa5 None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:00.818128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7716f2e-da17-4456-871c-d9359543afa5 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:00.819845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7716f2e-da17-4456-871c-d9359543afa5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:00.822109 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 130/268] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:43:00 2022] GET /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:00.828176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd3565-d877-4ebc-a61c-11826e47d25d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:00.908365 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:00.963268 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd3565-d877-4ebc-a61c-11826e47d25d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:01.009078 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb13b3c-00e1-4b2e-bbac-4ae2369e50f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:01.009689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb13b3c-00e1-4b2e-bbac-4ae2369e50f5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:01.009966 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb13b3c-00e1-4b2e-bbac-4ae2369e50f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:01.010237 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb13b3c-00e1-4b2e-bbac-4ae2369e50f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:01.010995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb13b3c-00e1-4b2e-bbac-4ae2369e50f5 None admin] RBAC: Adding query filter params (role.id=e9cc929c9958498d8ce27ca88f685549, scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c, user.id=0101580d0c37412e99286be49e265bc6) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:01.011304 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb13b3c-00e1-4b2e-bbac-4ae2369e50f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:01.012815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb13b3c-00e1-4b2e-bbac-4ae2369e50f5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:01.026356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 139/269] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:43:00 2022] GET /identity/v3/role_assignments?user.id=0101580d0c37412e99286be49e265bc6&scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c&role.id=e9cc929c9958498d8ce27ca88f685549 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:01.230027 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4550566-62f6-4214-9d56-f34bc103519e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:01.230554 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4550566-62f6-4214-9d56-f34bc103519e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:01.230554 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4550566-62f6-4214-9d56-f34bc103519e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:01.232294 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 131/270] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:01.237737 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b12ef2-8f4f-4132-a839-2795e4c89391 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:01.238181 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b12ef2-8f4f-4132-a839-2795e4c89391 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:01.238356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b12ef2-8f4f-4132-a839-2795e4c89391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:01.259194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e0b12ef2-8f4f-4132-a839-2795e4c89391 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:01.260379 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e0b12ef2-8f4f-4132-a839-2795e4c89391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:01.337901 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 140/271] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:01.363891 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4550566-62f6-4214-9d56-f34bc103519e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:01.472950 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4550566-62f6-4214-9d56-f34bc103519e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:01.508437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1766b50-906f-49b9-a9db-eb64b8883c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:01.509122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1766b50-906f-49b9-a9db-eb64b8883c71 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:01.509394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1766b50-906f-49b9-a9db-eb64b8883c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:01.509711 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1766b50-906f-49b9-a9db-eb64b8883c71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:01.510893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1766b50-906f-49b9-a9db-eb64b8883c71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:01.512274 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1766b50-906f-49b9-a9db-eb64b8883c71 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:01.514232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 132/272] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:01.520208 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b12ef2-8f4f-4132-a839-2795e4c89391 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:01.536186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8f8a8-7eb7-446e-bda3-6819af823179 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:01.536523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8f8a8-7eb7-446e-bda3-6819af823179 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:01.536735 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8f8a8-7eb7-446e-bda3-6819af823179 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:01.538089 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 133/273] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:43:01.547996 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cca161-68a3-4844-95e9-3a9875973eca None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:01.548288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cca161-68a3-4844-95e9-3a9875973eca None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:01.548566 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cca161-68a3-4844-95e9-3a9875973eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:01.570984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-86cca161-68a3-4844-95e9-3a9875973eca None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:01.572256 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-86cca161-68a3-4844-95e9-3a9875973eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:01.575055 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:01.601215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:01.649988 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b12ef2-8f4f-4132-a839-2795e4c89391 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:01.651509 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 134/274] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:43:01.673554 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cca161-68a3-4844-95e9-3a9875973eca None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:01.691059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d438792-eb32-47ca-bf81-0c69734b4a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:01.692353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d438792-eb32-47ca-bf81-0c69734b4a57 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:01.693048 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d438792-eb32-47ca-bf81-0c69734b4a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:01.693500 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d438792-eb32-47ca-bf81-0c69734b4a57 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:01.694564 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d438792-eb32-47ca-bf81-0c69734b4a57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:01.696560 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d438792-eb32-47ca-bf81-0c69734b4a57 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:01.779920 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cca161-68a3-4844-95e9-3a9875973eca None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:01.818705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 141/275] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Aug 11 10:43:01 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:43:01.818964 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e0159-1308-489e-8119-8597c5585c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:01.818964 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e0159-1308-489e-8119-8597c5585c8f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:01.818964 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e0159-1308-489e-8119-8597c5585c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:01.819236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab31c8b-e81d-43ff-b505-8305b8210b71 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:01.819316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e0159-1308-489e-8119-8597c5585c8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:01.819394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab31c8b-e81d-43ff-b505-8305b8210b71 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:01.819394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab31c8b-e81d-43ff-b505-8305b8210b71 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:01.819394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 142/276] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:01.819394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960f25e-3708-4e84-813b-9caf2170874d None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:01.819394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960f25e-3708-4e84-813b-9caf2170874d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:01.819394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960f25e-3708-4e84-813b-9caf2170874d None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:01.820154 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 143/277] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:01.824616 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2a875-c2a9-496c-b072-820ed305111f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:01.824966 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2a875-c2a9-496c-b072-820ed305111f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:01.825179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2a875-c2a9-496c-b072-820ed305111f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:01.827687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:01.832234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e0159-1308-489e-8119-8597c5585c8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:01.837475 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-8d2e0159-1308-489e-8119-8597c5585c8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:43:01.837475 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:01.837475 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:01.837475 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:01.837475 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:01.837475 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:01.837475 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:01.837475 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:01.837475 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:01.837475 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:01.837475 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:01.837475 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:01.837475 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:01.837475 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:01.837475 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:01.837475 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:01.838457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:01.838457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:01.838457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:01.838457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:01.838457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:01.838457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:01.838457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:01.838457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:01.838457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:01.838457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:01.838457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:01.838457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:01.838457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:01.838457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:01.838457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:01.838457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:01.839870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:01.839870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:01.839870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:01.839870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:01.839870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:01.839870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:01.839870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:01.839870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:01.839870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:01.839870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:01.839870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:43:01.839870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:01.839870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 135/278] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:01.840539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e25c96-4cdf-4851-b859-213240fecad1 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:01.840822 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e25c96-4cdf-4851-b859-213240fecad1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:01.841091 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e25c96-4cdf-4851-b859-213240fecad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:01.848013 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-bda2a875-c2a9-496c-b072-820ed305111f None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:01.849247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-bda2a875-c2a9-496c-b072-820ed305111f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:01.865042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-83e25c96-4cdf-4851-b859-213240fecad1 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:01.866156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-83e25c96-4cdf-4851-b859-213240fecad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:01.930492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 144/279] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:01.931776 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2a875-c2a9-496c-b072-820ed305111f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:01.957478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 136/280] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:01.958603 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e25c96-4cdf-4851-b859-213240fecad1 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:01.990172 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:02.066282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2a875-c2a9-496c-b072-820ed305111f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:02.086194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e25c96-4cdf-4851-b859-213240fecad1 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:02.118092 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec9dd4-fc4b-4665-96eb-e2b0debfd882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:02.118092 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec9dd4-fc4b-4665-96eb-e2b0debfd882 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:02.118092 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec9dd4-fc4b-4665-96eb-e2b0debfd882 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:02.118092 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec9dd4-fc4b-4665-96eb-e2b0debfd882 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:02.118457 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec9dd4-fc4b-4665-96eb-e2b0debfd882 None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:02.118457 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec9dd4-fc4b-4665-96eb-e2b0debfd882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:02.120234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec9dd4-fc4b-4665-96eb-e2b0debfd882 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:02.120764 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:02.129667 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81287f92-04f5-4690-8dac-f53dc303c9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:02.130317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81287f92-04f5-4690-8dac-f53dc303c9db None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:02.130646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81287f92-04f5-4690-8dac-f53dc303c9db None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:02.131037 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81287f92-04f5-4690-8dac-f53dc303c9db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:02.135882 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 145/281] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:43:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:02.135882 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec9dd4-fc4b-4665-96eb-e2b0debfd882 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:02.149689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81287f92-04f5-4690-8dac-f53dc303c9db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:02.154562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-81287f92-04f5-4690-8dac-f53dc303c9db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 10:43:02.154562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:02.154562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:02.154562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:02.154562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:02.154562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:02.154562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:02.154562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:02.154562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:02.154562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:02.154562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:02.154562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:02.154562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:02.154562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:02.154562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:02.154562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:02.155545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:02.155545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:02.155545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:02.155545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:02.155545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:02.155545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:02.155545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:02.155545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:02.155545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:02.155545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:02.155545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:02.155545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:02.155545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:02.155545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:02.155545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:02.155545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:02.156308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:02.156308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:02.156308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:02.156308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:02.156308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:02.156308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:02.156308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:02.156308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:02.156308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:02.156308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:02.156308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 10:43:02.156308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:02.156308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 137/282] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:02.156959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81287f92-04f5-4690-8dac-f53dc303c9db None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:02.261268 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec9dd4-fc4b-4665-96eb-e2b0debfd882 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:02.262953 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:02.269526 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81287f92-04f5-4690-8dac-f53dc303c9db None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:02.298904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a369862-db5d-45e3-bd2d-156676adf131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:02.299551 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a369862-db5d-45e3-bd2d-156676adf131 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:02.299834 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a369862-db5d-45e3-bd2d-156676adf131 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:02.300111 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a369862-db5d-45e3-bd2d-156676adf131 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:02.306777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71987469-b091-496f-892b-064533441872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:02.307716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71987469-b091-496f-892b-064533441872 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:02.308192 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71987469-b091-496f-892b-064533441872 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:02.308667 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71987469-b091-496f-892b-064533441872 None admin] PATH_INFO: `/v3/users/f1c35fc801fe4978bce22efb06a83703` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:02.313299 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a369862-db5d-45e3-bd2d-156676adf131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:02.324362 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71987469-b091-496f-892b-064533441872 None admin] RBAC: Authorizing `identity:get_user(user_id=f1c35fc801fe4978bce22efb06a83703)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:02.326319 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71987469-b091-496f-892b-064533441872 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:02.327358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-1a369862-db5d-45e3-bd2d-156676adf131 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:43:02.327358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:02.327358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:02.327358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:02.327358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:02.327358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:02.327358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:02.327358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:02.327358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:02.327358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:02.327358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:02.327358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:02.327358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:02.327358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:02.327358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:02.327358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:02.328199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:02.328199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:02.328199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:02.328199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:02.328199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:02.328199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:02.328199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:02.328199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:02.328199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:02.328199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:02.328199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:02.328199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:02.328199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:02.328199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:02.328199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:02.328199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:02.328962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:02.328962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:02.328962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:02.328962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:02.328962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:02.328962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:02.328962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:02.328962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:02.328962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:02.328962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:02.328962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:43:02.328962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:02.328962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 146/283] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:02.329585 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a369862-db5d-45e3-bd2d-156676adf131 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:02.331436 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 138/284] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:43:02 2022] GET /identity/v3/users/f1c35fc801fe4978bce22efb06a83703 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:02.339772 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71987469-b091-496f-892b-064533441872 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:02.391969 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:02.454043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a369862-db5d-45e3-bd2d-156676adf131 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:02.469182 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71987469-b091-496f-892b-064533441872 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:02.496510 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5d156-f340-48a9-b6c9-210f376b7cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:02.497535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5d156-f340-48a9-b6c9-210f376b7cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:02.498050 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5d156-f340-48a9-b6c9-210f376b7cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:02.498916 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5d156-f340-48a9-b6c9-210f376b7cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:02.499877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5d156-f340-48a9-b6c9-210f376b7cd3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:02.500188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5d156-f340-48a9-b6c9-210f376b7cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:02.502233 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5d156-f340-48a9-b6c9-210f376b7cd3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:02.509745 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e8371-c779-41ee-98d5-bca8241ce4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:02.510508 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e8371-c779-41ee-98d5-bca8241ce4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:02.510940 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e8371-c779-41ee-98d5-bca8241ce4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:02.511420 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e8371-c779-41ee-98d5-bca8241ce4a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:02.512195 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e8371-c779-41ee-98d5-bca8241ce4a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:02.512549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 147/285] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:43:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:02.512659 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e8371-c779-41ee-98d5-bca8241ce4a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:02.514464 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5d156-f340-48a9-b6c9-210f376b7cd3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:02.515188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e8371-c779-41ee-98d5-bca8241ce4a1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:02.529827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 139/286] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:43:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:02.531058 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e8371-c779-41ee-98d5-bca8241ce4a1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:02.547058 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:02.650783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e8371-c779-41ee-98d5-bca8241ce4a1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:02.651296 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5d156-f340-48a9-b6c9-210f376b7cd3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:02.663783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:02.697187 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce669bb0-7e2f-4db0-b9f8-3a1e05918c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:02.697615 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85922c4c-92d9-415d-a0e8-162436e01d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:02.698433 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85922c4c-92d9-415d-a0e8-162436e01d3d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:02.698537 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce669bb0-7e2f-4db0-b9f8-3a1e05918c02 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:02.699026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85922c4c-92d9-415d-a0e8-162436e01d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:02.699300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce669bb0-7e2f-4db0-b9f8-3a1e05918c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:02.699668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85922c4c-92d9-415d-a0e8-162436e01d3d None admin] PATH_INFO: `/v3/users/d7c7c5c733b64acc8cab8a4191191a7a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:02.699985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce669bb0-7e2f-4db0-b9f8-3a1e05918c02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:02.701692 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85922c4c-92d9-415d-a0e8-162436e01d3d None admin] RBAC: Authorizing `identity:get_user(user_id=d7c7c5c733b64acc8cab8a4191191a7a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:02.702079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce669bb0-7e2f-4db0-b9f8-3a1e05918c02 None admin] RBAC: Adding query filter params (role.id=ea851d0cf29e44a1884d7c23431a7481, user.id=f1c35fc801fe4978bce22efb06a83703, scope.system=all) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:02.703360 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce669bb0-7e2f-4db0-b9f8-3a1e05918c02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:02.704499 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85922c4c-92d9-415d-a0e8-162436e01d3d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:02.706397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce669bb0-7e2f-4db0-b9f8-3a1e05918c02 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:02.706886 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 140/287] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:43:02 2022] GET /identity/v3/users/d7c7c5c733b64acc8cab8a4191191a7a => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:02.707993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85922c4c-92d9-415d-a0e8-162436e01d3d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:02.718661 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 148/288] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Aug 11 10:43:02 2022] GET /identity/v3/role_assignments?user.id=f1c35fc801fe4978bce22efb06a83703&scope.system=all&role.id=ea851d0cf29e44a1884d7c23431a7481 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:02.718661 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce669bb0-7e2f-4db0-b9f8-3a1e05918c02 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:02.881118 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:02.895546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce669bb0-7e2f-4db0-b9f8-3a1e05918c02 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:02.925474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85922c4c-92d9-415d-a0e8-162436e01d3d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:02.934046 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68726261-ce55-40fc-8167-c55a35f7018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:02.934663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68726261-ce55-40fc-8167-c55a35f7018a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:02.935018 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68726261-ce55-40fc-8167-c55a35f7018a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:02.935814 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68726261-ce55-40fc-8167-c55a35f7018a None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:02.937114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68726261-ce55-40fc-8167-c55a35f7018a None admin] RBAC: Authorizing `identity:get_project(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:02.938747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68726261-ce55-40fc-8167-c55a35f7018a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:02.940731 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 149/289] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:43:02 2022] GET /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:02.946189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68726261-ce55-40fc-8167-c55a35f7018a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:02.964371 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9dd54-5c49-42e8-8e7c-700537e1955f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:02.965343 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9dd54-5c49-42e8-8e7c-700537e1955f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:02.965822 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9dd54-5c49-42e8-8e7c-700537e1955f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:02.966877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9dd54-5c49-42e8-8e7c-700537e1955f None admin] PATH_INFO: `/v3/users/124a3c498d9f4f25b933b699a6c04e0b` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:02.968419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9dd54-5c49-42e8-8e7c-700537e1955f None admin] RBAC: Authorizing `identity:get_user(user_id=124a3c498d9f4f25b933b699a6c04e0b)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:02.970093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9dd54-5c49-42e8-8e7c-700537e1955f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:02.972299 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 141/290] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:43:02 2022] GET /identity/v3/users/124a3c498d9f4f25b933b699a6c04e0b => generated 297 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:02.981472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9dd54-5c49-42e8-8e7c-700537e1955f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:03.056896 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68726261-ce55-40fc-8167-c55a35f7018a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:03.058791 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:03.122677 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9dd54-5c49-42e8-8e7c-700537e1955f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:03.125336 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e691f1-9e49-49b8-8586-f09a9faf1c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:03.126151 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e691f1-9e49-49b8-8586-f09a9faf1c05 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:03.126437 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e691f1-9e49-49b8-8586-f09a9faf1c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:03.126711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e691f1-9e49-49b8-8586-f09a9faf1c05 None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c/users/d7c7c5c733b64acc8cab8a4191191a7a/roles/cef88e8a775e490a985ff36748d330f4` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:03.133169 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e691f1-9e49-49b8-8586-f09a9faf1c05 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c, user_id=d7c7c5c733b64acc8cab8a4191191a7a, role_id=cef88e8a775e490a985ff36748d330f4)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:03.134786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e691f1-9e49-49b8-8586-f09a9faf1c05 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:03.161104 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a594b6b-742e-45fe-a58f-32825643492e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:03.161720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a594b6b-742e-45fe-a58f-32825643492e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:03.162001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a594b6b-742e-45fe-a58f-32825643492e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:03.162274 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a594b6b-742e-45fe-a58f-32825643492e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:03.225806 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 150/291] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:43:02 2022] PUT /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c/users/d7c7c5c733b64acc8cab8a4191191a7a/roles/cef88e8a775e490a985ff36748d330f4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:43:03.243923 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a594b6b-742e-45fe-a58f-32825643492e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:03.245497 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a594b6b-742e-45fe-a58f-32825643492e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:03.295199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:03.356191 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 142/292] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:43:03.366997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e691f1-9e49-49b8-8586-f09a9faf1c05 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:03.403244 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:03.505963 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e691f1-9e49-49b8-8586-f09a9faf1c05 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:03.542494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3ca68-1eca-4b47-a0bf-709908372f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:03.543155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3ca68-1eca-4b47-a0bf-709908372f27 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:03.543431 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3ca68-1eca-4b47-a0bf-709908372f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:03.543700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3ca68-1eca-4b47-a0bf-709908372f27 None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:03.545415 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3ca68-1eca-4b47-a0bf-709908372f27 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:03.546887 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3ca68-1eca-4b47-a0bf-709908372f27 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:03.548566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 151/293] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:43:03 2022] GET /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:03.556102 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a594b6b-742e-45fe-a58f-32825643492e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:03.713545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a594b6b-742e-45fe-a58f-32825643492e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:03.760679 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f92be-7f08-46ab-ab1e-0058831f5818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:03.761215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f92be-7f08-46ab-ab1e-0058831f5818 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:03.761494 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f92be-7f08-46ab-ab1e-0058831f5818 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:03.761772 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f92be-7f08-46ab-ab1e-0058831f5818 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:03.762500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f92be-7f08-46ab-ab1e-0058831f5818 None admin] RBAC: Adding query filter params (role.id=ea851d0cf29e44a1884d7c23431a7481, scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c, user.id=124a3c498d9f4f25b933b699a6c04e0b) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:03.762833 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f92be-7f08-46ab-ab1e-0058831f5818 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:03.764362 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f92be-7f08-46ab-ab1e-0058831f5818 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:03.775240 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 143/294] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:43:03 2022] GET /identity/v3/role_assignments?user.id=124a3c498d9f4f25b933b699a6c04e0b&scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c&role.id=ea851d0cf29e44a1884d7c23431a7481 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:04.252010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466339b-f7de-4a8c-929b-5161ac7f41d9 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:04.252370 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466339b-f7de-4a8c-929b-5161ac7f41d9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:04.252549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466339b-f7de-4a8c-929b-5161ac7f41d9 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:04.254155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 152/295] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:04.259950 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452b081-e529-497a-9f30-627ea2cf8183 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:04.260233 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452b081-e529-497a-9f30-627ea2cf8183 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:04.260507 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452b081-e529-497a-9f30-627ea2cf8183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:04.281999 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a452b081-e529-497a-9f30-627ea2cf8183 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:04.283211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a452b081-e529-497a-9f30-627ea2cf8183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:04.285318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:04.348667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273e9fa-ac24-42d2-868c-57bc46d19a85 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:04.348971 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273e9fa-ac24-42d2-868c-57bc46d19a85 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:04.349219 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273e9fa-ac24-42d2-868c-57bc46d19a85 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:04.350672 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 153/296] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:43:04.356114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89f5b0-cb76-4095-a566-424809eacd0d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:04.356525 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89f5b0-cb76-4095-a566-424809eacd0d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:04.356710 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89f5b0-cb76-4095-a566-424809eacd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:04.362287 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 144/297] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:04.384235 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-8a89f5b0-cb76-4095-a566-424809eacd0d None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:04.385419 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8a89f5b0-cb76-4095-a566-424809eacd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:04.390244 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452b081-e529-497a-9f30-627ea2cf8183 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:04.477892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 154/298] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:43:04.501186 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89f5b0-cb76-4095-a566-424809eacd0d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:04.510704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452b081-e529-497a-9f30-627ea2cf8183 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:04.516650 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:04.567152 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d1cb5-d2f5-4d14-84a3-5114a14e2357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:04.567707 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d1cb5-d2f5-4d14-84a3-5114a14e2357 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:04.567985 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d1cb5-d2f5-4d14-84a3-5114a14e2357 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:04.568259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d1cb5-d2f5-4d14-84a3-5114a14e2357 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:04.569362 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d1cb5-d2f5-4d14-84a3-5114a14e2357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:04.570836 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d1cb5-d2f5-4d14-84a3-5114a14e2357 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:04.572685 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 145/299] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:04.579095 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d1cb5-d2f5-4d14-84a3-5114a14e2357 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:04.596476 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:04.614155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89f5b0-cb76-4095-a566-424809eacd0d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:04.652168 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55101e82-9a6d-4690-bc01-5a20b99fa387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:04.652979 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55101e82-9a6d-4690-bc01-5a20b99fa387 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:04.653388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55101e82-9a6d-4690-bc01-5a20b99fa387 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:04.653848 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55101e82-9a6d-4690-bc01-5a20b99fa387 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:04.665075 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55101e82-9a6d-4690-bc01-5a20b99fa387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:04.670284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-55101e82-9a6d-4690-bc01-5a20b99fa387 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 10:43:04.670284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:04.670284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:04.670284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:04.670284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:04.670284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:04.670284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:04.670284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:04.670284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:04.670284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:04.670284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:04.670284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:04.670284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:04.670284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:04.670284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:04.670284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:04.671396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:04.671396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:04.671396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:04.671396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:04.671396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:04.671396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:04.671396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:04.671396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:04.671396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:04.671396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:04.671396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:04.671396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:04.671396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:04.671396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:04.671396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:04.671396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:04.672368 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:04.672368 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:04.672368 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:04.672368 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:04.672368 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:04.672368 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:04.672368 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:04.672368 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:04.672368 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:04.672368 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:04.672368 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 10:43:04.672368 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:04.679226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 155/300] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:04.680443 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55101e82-9a6d-4690-bc01-5a20b99fa387 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:04.714251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d1cb5-d2f5-4d14-84a3-5114a14e2357 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:04.754033 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619921e-1bde-4480-8dad-a48aea150653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:04.754820 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619921e-1bde-4480-8dad-a48aea150653 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:04.755203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619921e-1bde-4480-8dad-a48aea150653 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:04.755587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619921e-1bde-4480-8dad-a48aea150653 None admin] PATH_INFO: `/v3/groups` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:04.756304 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619921e-1bde-4480-8dad-a48aea150653 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:04.757848 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619921e-1bde-4480-8dad-a48aea150653 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:04.772276 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:04.797167 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55101e82-9a6d-4690-bc01-5a20b99fa387 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:04.830718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360ceff-48c5-44f0-a03b-9cba402457e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:04.831299 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360ceff-48c5-44f0-a03b-9cba402457e2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:04.831580 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360ceff-48c5-44f0-a03b-9cba402457e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:04.831854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360ceff-48c5-44f0-a03b-9cba402457e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:04.832561 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360ceff-48c5-44f0-a03b-9cba402457e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:04.832876 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360ceff-48c5-44f0-a03b-9cba402457e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:04.834460 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360ceff-48c5-44f0-a03b-9cba402457e2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:04.847133 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 146/301] 10.222.0.43 () {60 vars in 1134 bytes} [Thu Aug 11 10:43:04 2022] POST /identity/v3/groups => generated 229 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:43:04.849878 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 156/302] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:43:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:04.856001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619921e-1bde-4480-8dad-a48aea150653 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:04.934078 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:04.976370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619921e-1bde-4480-8dad-a48aea150653 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:05.015159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd89a23-3485-445a-9c01-3c253c87f372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:05.016347 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd89a23-3485-445a-9c01-3c253c87f372 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:05.016849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd89a23-3485-445a-9c01-3c253c87f372 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:05.017315 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd89a23-3485-445a-9c01-3c253c87f372 None admin] PATH_INFO: `/v3/users/65182904f61a40eea99bbb5379ca8bb0` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:05.033078 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd89a23-3485-445a-9c01-3c253c87f372 None admin] RBAC: Authorizing `identity:get_user(user_id=65182904f61a40eea99bbb5379ca8bb0)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:05.034916 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd89a23-3485-445a-9c01-3c253c87f372 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:05.037376 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 147/303] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:43:04 2022] GET /identity/v3/users/65182904f61a40eea99bbb5379ca8bb0 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:05.043154 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360ceff-48c5-44f0-a03b-9cba402457e2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:05.064407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40fecc-a5e2-482d-bb76-7bbae3a2f948 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:05.064768 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40fecc-a5e2-482d-bb76-7bbae3a2f948 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:05.064953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40fecc-a5e2-482d-bb76-7bbae3a2f948 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:05.066551 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 148/304] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:43:05.071534 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3882c55-80f7-42cf-ac27-7db46cbb4513 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:05.071665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3882c55-80f7-42cf-ac27-7db46cbb4513 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:05.071874 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3882c55-80f7-42cf-ac27-7db46cbb4513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:05.093379 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c3882c55-80f7-42cf-ac27-7db46cbb4513 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:05.094597 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c3882c55-80f7-42cf-ac27-7db46cbb4513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:05.175664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360ceff-48c5-44f0-a03b-9cba402457e2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:05.191454 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 149/305] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:05.211775 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f68af5-d71d-408d-94f7-5e40a1faf29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:05.213410 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3882c55-80f7-42cf-ac27-7db46cbb4513 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:05.219457 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f68af5-d71d-408d-94f7-5e40a1faf29f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:05.220010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f68af5-d71d-408d-94f7-5e40a1faf29f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:05.220481 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f68af5-d71d-408d-94f7-5e40a1faf29f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:05.221475 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f68af5-d71d-408d-94f7-5e40a1faf29f None admin] RBAC: Adding query filter params (role.id=cef88e8a775e490a985ff36748d330f4, user.id=65182904f61a40eea99bbb5379ca8bb0, scope.system=all) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:05.222036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f68af5-d71d-408d-94f7-5e40a1faf29f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:05.223835 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f68af5-d71d-408d-94f7-5e40a1faf29f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:05.227555 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:05.231400 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 157/306] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Aug 11 10:43:05 2022] GET /identity/v3/role_assignments?user.id=65182904f61a40eea99bbb5379ca8bb0&scope.system=all&role.id=cef88e8a775e490a985ff36748d330f4 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:05.284423 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:05.338334 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3882c55-80f7-42cf-ac27-7db46cbb4513 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:05.378277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac70450-cf6c-4a06-8a20-130e9361cde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:05.379798 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac70450-cf6c-4a06-8a20-130e9361cde7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:05.380279 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac70450-cf6c-4a06-8a20-130e9361cde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:05.380749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac70450-cf6c-4a06-8a20-130e9361cde7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:05.393652 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac70450-cf6c-4a06-8a20-130e9361cde7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:05.399227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-8ac70450-cf6c-4a06-8a20-130e9361cde7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:43:05.399227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:05.399227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:05.399227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:05.399227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:05.399227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:05.399227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:05.399227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:05.399227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:05.399227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:05.399227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:05.399227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:05.399227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:05.399227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:05.399227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:05.399227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:05.400096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:05.400096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:05.400096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:05.400096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:05.400096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:05.400096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:05.400096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:05.400096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:05.400096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:05.400096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:05.400096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:05.400096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:05.400096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:05.400096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:05.400096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:05.400096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:05.400884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:05.400884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:05.400884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:05.400884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:05.400884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:05.400884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:05.400884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:05.400884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:05.400884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:05.400884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:05.400884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:43:05.400884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:05.403478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 150/307] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:43:05.409660 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f68af5-d71d-408d-94f7-5e40a1faf29f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:05.518127 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f68af5-d71d-408d-94f7-5e40a1faf29f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:05.553803 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb2405-ce0b-4c7b-93d3-8fcea24fb024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:05.554740 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb2405-ce0b-4c7b-93d3-8fcea24fb024 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:05.555229 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb2405-ce0b-4c7b-93d3-8fcea24fb024 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:05.555699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb2405-ce0b-4c7b-93d3-8fcea24fb024 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:05.556543 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb2405-ce0b-4c7b-93d3-8fcea24fb024 None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:05.557020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb2405-ce0b-4c7b-93d3-8fcea24fb024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:05.558571 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb2405-ce0b-4c7b-93d3-8fcea24fb024 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:05.567643 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 158/308] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:43:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:05.576978 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac70450-cf6c-4a06-8a20-130e9361cde7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:05.672738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142c34f-700d-42ce-9ca3-7febffaa6760 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:05.673353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142c34f-700d-42ce-9ca3-7febffaa6760 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:05.673859 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142c34f-700d-42ce-9ca3-7febffaa6760 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:05.675685 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 159/309] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:05.680667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e9b61-5527-4f52-ac72-0f487bdf793c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:05.681404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e9b61-5527-4f52-ac72-0f487bdf793c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:05.682291 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e9b61-5527-4f52-ac72-0f487bdf793c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:05.685158 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac70450-cf6c-4a06-8a20-130e9361cde7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:05.701233 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:05.708243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-db0e9b61-5527-4f52-ac72-0f487bdf793c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:05.710185 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-db0e9b61-5527-4f52-ac72-0f487bdf793c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:05.722806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91b93c-b107-4f91-9483-e472e25a4a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:05.723837 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91b93c-b107-4f91-9483-e472e25a4a6e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:05.724132 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91b93c-b107-4f91-9483-e472e25a4a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:05.724412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91b93c-b107-4f91-9483-e472e25a4a6e None admin] PATH_INFO: `/v3/users/f1c35fc801fe4978bce22efb06a83703` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:05.725899 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91b93c-b107-4f91-9483-e472e25a4a6e None admin] RBAC: Authorizing `identity:get_user(user_id=f1c35fc801fe4978bce22efb06a83703)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:05.727532 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91b93c-b107-4f91-9483-e472e25a4a6e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:05.731064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 151/310] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:43:05 2022] GET /identity/v3/users/f1c35fc801fe4978bce22efb06a83703 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:05.736823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91b93c-b107-4f91-9483-e472e25a4a6e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:05.797485 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:05.810970 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 160/311] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:43:05.834046 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e9b61-5527-4f52-ac72-0f487bdf793c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:05.859817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91b93c-b107-4f91-9483-e472e25a4a6e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:05.896121 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c439809-5b51-488d-8a86-f54800d3a414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:05.896995 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c439809-5b51-488d-8a86-f54800d3a414 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:05.897360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c439809-5b51-488d-8a86-f54800d3a414 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:05.897643 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c439809-5b51-488d-8a86-f54800d3a414 None admin] PATH_INFO: `/v3/system/users/f1c35fc801fe4978bce22efb06a83703/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:05.899508 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c439809-5b51-488d-8a86-f54800d3a414 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f1c35fc801fe4978bce22efb06a83703, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:05.901290 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c439809-5b51-488d-8a86-f54800d3a414 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:05.937800 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e9b61-5527-4f52-ac72-0f487bdf793c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:05.973061 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62836921-87ee-413e-a095-0559f715912a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:05.973695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62836921-87ee-413e-a095-0559f715912a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:05.973973 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62836921-87ee-413e-a095-0559f715912a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:05.974267 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62836921-87ee-413e-a095-0559f715912a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:05.986164 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62836921-87ee-413e-a095-0559f715912a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:05.991114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-62836921-87ee-413e-a095-0559f715912a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 10:43:05.991114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:05.991114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:05.991114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:05.991114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:05.991114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:05.991114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:05.991114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:05.991114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:05.991114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:05.991114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:05.991114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:05.991114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:05.991114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:05.991114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:05.991114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:05.991961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:05.991961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:05.991961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:05.991961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:05.991961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:05.991961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:05.991961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:05.991961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:05.991961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:05.991961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:05.991961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:05.991961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:05.991961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:05.991961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:05.991961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:05.991961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:05.992771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:05.992771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:05.992771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:05.992771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:05.992771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:05.992771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:05.992771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:05.992771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:05.992771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:05.992771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:05.992771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 10:43:05.992771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:05.992771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 161/312] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:43:05.998666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62836921-87ee-413e-a095-0559f715912a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:06.004018 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 152/313] 10.222.0.43 () {58 vars in 1334 bytes} [Thu Aug 11 10:43:05 2022] PUT /identity/v3/system/users/f1c35fc801fe4978bce22efb06a83703/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:43:06.069710 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:06.123521 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62836921-87ee-413e-a095-0559f715912a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:06.164445 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f5cca-f981-46ff-80cb-4a63c60124c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:06.165457 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f5cca-f981-46ff-80cb-4a63c60124c8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:06.165962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f5cca-f981-46ff-80cb-4a63c60124c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:06.166433 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f5cca-f981-46ff-80cb-4a63c60124c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:06.167325 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f5cca-f981-46ff-80cb-4a63c60124c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:06.167854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f5cca-f981-46ff-80cb-4a63c60124c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:06.169966 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f5cca-f981-46ff-80cb-4a63c60124c8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:06.179532 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 162/314] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:43:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:06.184868 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c439809-5b51-488d-8a86-f54800d3a414 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:06.240001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:06.297713 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c439809-5b51-488d-8a86-f54800d3a414 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:06.334743 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e657132-41d9-4cc6-ab7e-adf4ffa21fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:06.335822 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e657132-41d9-4cc6-ab7e-adf4ffa21fbe None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:06.336356 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e657132-41d9-4cc6-ab7e-adf4ffa21fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:06.336831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e657132-41d9-4cc6-ab7e-adf4ffa21fbe None admin] PATH_INFO: `/v3/users/d7c7c5c733b64acc8cab8a4191191a7a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:06.338401 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e657132-41d9-4cc6-ab7e-adf4ffa21fbe None admin] RBAC: Authorizing `identity:get_user(user_id=d7c7c5c733b64acc8cab8a4191191a7a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:06.340150 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e657132-41d9-4cc6-ab7e-adf4ffa21fbe None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:06.342426 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 153/315] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:43:06 2022] GET /identity/v3/users/d7c7c5c733b64acc8cab8a4191191a7a => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:06.347816 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f5cca-f981-46ff-80cb-4a63c60124c8 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:06.453279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f5cca-f981-46ff-80cb-4a63c60124c8 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:06.467138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:06.487384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8c870-a381-46f9-856b-8491865beaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:06.487996 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8c870-a381-46f9-856b-8491865beaf8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:06.488274 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8c870-a381-46f9-856b-8491865beaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:06.488544 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8c870-a381-46f9-856b-8491865beaf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:06.562703 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8c870-a381-46f9-856b-8491865beaf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:06.564127 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8c870-a381-46f9-856b-8491865beaf8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:06.663783 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 163/316] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:43:06.669557 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e657132-41d9-4cc6-ab7e-adf4ffa21fbe None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:06.777600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e657132-41d9-4cc6-ab7e-adf4ffa21fbe None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:06.793932 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:06.815263 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd8e3b-c6fa-4759-83e8-b4edcec7a1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:06.815794 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd8e3b-c6fa-4759-83e8-b4edcec7a1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:06.816142 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd8e3b-c6fa-4759-83e8-b4edcec7a1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:06.816421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd8e3b-c6fa-4759-83e8-b4edcec7a1e2 None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:06.817634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd8e3b-c6fa-4759-83e8-b4edcec7a1e2 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:06.819121 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd8e3b-c6fa-4759-83e8-b4edcec7a1e2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:06.821070 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 154/317] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:43:06 2022] GET /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:06.828168 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8c870-a381-46f9-856b-8491865beaf8 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:06.845258 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:06.932712 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8c870-a381-46f9-856b-8491865beaf8 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:06.968051 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b038241-5a66-4533-bf8f-3714013a16c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:06.969026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b038241-5a66-4533-bf8f-3714013a16c4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:06.969507 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b038241-5a66-4533-bf8f-3714013a16c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:06.969977 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b038241-5a66-4533-bf8f-3714013a16c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:06.970921 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b038241-5a66-4533-bf8f-3714013a16c4 None admin] RBAC: Adding query filter params (role.id=cef88e8a775e490a985ff36748d330f4, scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c, user.id=d7c7c5c733b64acc8cab8a4191191a7a) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:06.971445 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b038241-5a66-4533-bf8f-3714013a16c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:06.973097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b038241-5a66-4533-bf8f-3714013a16c4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:06.979706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 164/318] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:43:06 2022] GET /identity/v3/role_assignments?user.id=d7c7c5c733b64acc8cab8a4191191a7a&scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c&role.id=cef88e8a775e490a985ff36748d330f4 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:07.136998 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac6bf9-d0fc-4681-b714-83c75bea2a57 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:07.137315 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac6bf9-d0fc-4681-b714-83c75bea2a57 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:07.137564 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac6bf9-d0fc-4681-b714-83c75bea2a57 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:07.139768 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 155/319] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:07.145279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3ac06-a1f7-4fe4-8026-741569f21d8c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:07.145570 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3ac06-a1f7-4fe4-8026-741569f21d8c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:07.145846 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3ac06-a1f7-4fe4-8026-741569f21d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:07.166795 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a4e3ac06-a1f7-4fe4-8026-741569f21d8c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:07.168340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a4e3ac06-a1f7-4fe4-8026-741569f21d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:07.237549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa60c5-225d-43ff-b76c-647649f6dfba None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:07.237852 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa60c5-225d-43ff-b76c-647649f6dfba None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:07.238092 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa60c5-225d-43ff-b76c-647649f6dfba None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:07.239726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 156/320] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:07.245117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b16215-18e5-4404-92f2-bd44a60ab2ba None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:07.245479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b16215-18e5-4404-92f2-bd44a60ab2ba None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:07.245855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b16215-18e5-4404-92f2-bd44a60ab2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:07.249312 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 165/321] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:07.264653 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-98b16215-18e5-4404-92f2-bd44a60ab2ba None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:07.265840 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-98b16215-18e5-4404-92f2-bd44a60ab2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:07.267982 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3ac06-a1f7-4fe4-8026-741569f21d8c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:07.280331 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:07.339962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 157/322] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:43:07.362265 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b16215-18e5-4404-92f2-bd44a60ab2ba None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:07.376709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3ac06-a1f7-4fe4-8026-741569f21d8c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:07.412856 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d0035-4bd5-4ba3-80d2-248b72fb1f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:07.413411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d0035-4bd5-4ba3-80d2-248b72fb1f75 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:07.413693 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d0035-4bd5-4ba3-80d2-248b72fb1f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:07.413969 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d0035-4bd5-4ba3-80d2-248b72fb1f75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:07.415109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d0035-4bd5-4ba3-80d2-248b72fb1f75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:07.416553 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d0035-4bd5-4ba3-80d2-248b72fb1f75 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:07.418113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 166/323] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:07.425922 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d0035-4bd5-4ba3-80d2-248b72fb1f75 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:07.467896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b16215-18e5-4404-92f2-bd44a60ab2ba None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:07.480688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:07.502138 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e9606-4de6-418f-8b30-73363e02b522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:07.503060 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e9606-4de6-418f-8b30-73363e02b522 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:07.503524 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e9606-4de6-418f-8b30-73363e02b522 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:07.503980 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e9606-4de6-418f-8b30-73363e02b522 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:07.514720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e9606-4de6-418f-8b30-73363e02b522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:07.516927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:07.520045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-076e9606-4de6-418f-8b30-73363e02b522 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 10:43:07.520045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:07.520045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:07.520045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:07.520045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:07.520045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:07.520045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:07.520045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:07.520045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:07.520045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:07.520045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:07.520045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:07.520045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:07.520045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:07.520045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:07.520045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:07.520881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:07.520881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:07.520881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:07.520881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:07.520881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:07.520881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:07.520881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:07.520881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:07.520881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:07.520881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:07.520881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:07.520881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:07.520881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:07.520881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:07.520881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:07.520881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:07.521628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:07.521628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:07.521628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:07.521628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:07.521628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:07.521628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:07.521628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:07.521628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:07.521628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:07.521628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:07.521628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 10:43:07.521628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:07.521628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 158/324] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:43:07.527068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e9606-4de6-418f-8b30-73363e02b522 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:07.549952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d0035-4bd5-4ba3-80d2-248b72fb1f75 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:07.588794 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aca5f6-e0e7-4663-87a3-8a40a398551e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:07.590042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aca5f6-e0e7-4663-87a3-8a40a398551e None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:07.590720 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aca5f6-e0e7-4663-87a3-8a40a398551e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:07.591722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aca5f6-e0e7-4663-87a3-8a40a398551e None admin] PATH_INFO: `/v3/groups` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:07.592401 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aca5f6-e0e7-4663-87a3-8a40a398551e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:07.593877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aca5f6-e0e7-4663-87a3-8a40a398551e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:07.633356 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e9606-4de6-418f-8b30-73363e02b522 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:07.668571 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef770a-5f3e-4d67-b293-6eecf391d9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:07.669115 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef770a-5f3e-4d67-b293-6eecf391d9dd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:07.669554 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef770a-5f3e-4d67-b293-6eecf391d9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:07.670062 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef770a-5f3e-4d67-b293-6eecf391d9dd None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:07.670790 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef770a-5f3e-4d67-b293-6eecf391d9dd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:07.671145 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef770a-5f3e-4d67-b293-6eecf391d9dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:07.676990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef770a-5f3e-4d67-b293-6eecf391d9dd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:07.677138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 167/325] 10.222.0.43 () {60 vars in 1134 bytes} [Thu Aug 11 10:43:07 2022] POST /identity/v3/groups => generated 226 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:43:07.682197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 159/326] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:43:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:07.688596 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aca5f6-e0e7-4663-87a3-8a40a398551e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:07.804695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aca5f6-e0e7-4663-87a3-8a40a398551e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:07.846200 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96f0f4-bbe6-43e9-b97d-96be7654a64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:07.847137 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96f0f4-bbe6-43e9-b97d-96be7654a64b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:07.847410 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96f0f4-bbe6-43e9-b97d-96be7654a64b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:07.847678 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96f0f4-bbe6-43e9-b97d-96be7654a64b None admin] PATH_INFO: `/v3/users/65182904f61a40eea99bbb5379ca8bb0` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:07.848798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96f0f4-bbe6-43e9-b97d-96be7654a64b None admin] RBAC: Authorizing `identity:get_user(user_id=65182904f61a40eea99bbb5379ca8bb0)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:07.850240 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96f0f4-bbe6-43e9-b97d-96be7654a64b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:07.851997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 168/327] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:43:07 2022] GET /identity/v3/users/65182904f61a40eea99bbb5379ca8bb0 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:07.857541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef770a-5f3e-4d67-b293-6eecf391d9dd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:07.897435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:07.970586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef770a-5f3e-4d67-b293-6eecf391d9dd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:08.007787 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea38aa6d-6c22-4684-a4d9-52d180764f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:08.008444 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38aa6d-6c22-4684-a4d9-52d180764f97 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:08.008725 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38aa6d-6c22-4684-a4d9-52d180764f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:08.008994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38aa6d-6c22-4684-a4d9-52d180764f97 None admin] PATH_INFO: `/v3/system/users/65182904f61a40eea99bbb5379ca8bb0/roles/cef88e8a775e490a985ff36748d330f4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:08.010426 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38aa6d-6c22-4684-a4d9-52d180764f97 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=65182904f61a40eea99bbb5379ca8bb0, role_id=cef88e8a775e490a985ff36748d330f4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:08.011843 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea38aa6d-6c22-4684-a4d9-52d180764f97 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:08.081397 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 160/328] 10.222.0.43 () {58 vars in 1334 bytes} [Thu Aug 11 10:43:07 2022] PUT /identity/v3/system/users/65182904f61a40eea99bbb5379ca8bb0/roles/cef88e8a775e490a985ff36748d330f4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:43:08.120021 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c54eba-e5ca-4d85-9895-e16bf23ce0e1 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:08.120356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c54eba-e5ca-4d85-9895-e16bf23ce0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:08.120582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c54eba-e5ca-4d85-9895-e16bf23ce0e1 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:08.121962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 169/329] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:08.129677 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5205f-429b-4222-8136-d5be9a5d776f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:08.130102 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5205f-429b-4222-8136-d5be9a5d776f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:08.130472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5205f-429b-4222-8136-d5be9a5d776f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:08.152990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1aa5205f-429b-4222-8136-d5be9a5d776f None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:08.154460 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1aa5205f-429b-4222-8136-d5be9a5d776f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:08.240729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 161/330] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:08.264564 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c54eba-e5ca-4d85-9895-e16bf23ce0e1 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:08.268388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:08.383597 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c54eba-e5ca-4d85-9895-e16bf23ce0e1 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:08.428228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee7451-0c4b-4f8b-bb31-90712aeeae69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:08.428872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee7451-0c4b-4f8b-bb31-90712aeeae69 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:08.429148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee7451-0c4b-4f8b-bb31-90712aeeae69 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:08.429470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee7451-0c4b-4f8b-bb31-90712aeeae69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:08.443655 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee7451-0c4b-4f8b-bb31-90712aeeae69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:08.448449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-deee7451-0c4b-4f8b-bb31-90712aeeae69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:43:08.448449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:08.448449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:08.448449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:08.448449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:08.448449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:08.448449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:08.448449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:08.448449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:08.448449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:08.448449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:08.448449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:08.448449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:08.448449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:08.448449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:08.448449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:08.449288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:08.449288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:08.449288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:08.449288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:08.449288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:08.449288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:08.449288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:08.449288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:08.449288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:08.449288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:08.449288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:08.449288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:08.449288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:08.449288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:08.449288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:08.449288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:08.450199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:08.450199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:08.450199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:08.450199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:08.450199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:08.450199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:08.450199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:08.450199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:08.450199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:08.450199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:08.450199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:43:08.450199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:08.450199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 170/331] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:08.457482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5205f-429b-4222-8136-d5be9a5d776f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:08.494417 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:08.579509 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5205f-429b-4222-8136-d5be9a5d776f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:08.632258 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc6035-128b-4a0d-9fa8-904b142ba7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:08.633285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc6035-128b-4a0d-9fa8-904b142ba7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:08.633772 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc6035-128b-4a0d-9fa8-904b142ba7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:08.634262 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc6035-128b-4a0d-9fa8-904b142ba7f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:08.635437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc6035-128b-4a0d-9fa8-904b142ba7f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:08.635964 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc6035-128b-4a0d-9fa8-904b142ba7f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:08.638462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc6035-128b-4a0d-9fa8-904b142ba7f7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:08.653794 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 162/332] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:43:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:08.662307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee7451-0c4b-4f8b-bb31-90712aeeae69 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:08.753763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:08.789090 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee7451-0c4b-4f8b-bb31-90712aeeae69 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:08.931188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18b4c8-b441-48bb-843e-ca1fc4aba2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:08.931838 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18b4c8-b441-48bb-843e-ca1fc4aba2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:08.932117 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18b4c8-b441-48bb-843e-ca1fc4aba2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:08.932389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18b4c8-b441-48bb-843e-ca1fc4aba2d4 None admin] PATH_INFO: `/v3/users/f1c35fc801fe4978bce22efb06a83703` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:08.933541 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18b4c8-b441-48bb-843e-ca1fc4aba2d4 None admin] RBAC: Authorizing `identity:get_user(user_id=f1c35fc801fe4978bce22efb06a83703)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:08.935633 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18b4c8-b441-48bb-843e-ca1fc4aba2d4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:08.937570 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 171/333] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:43:08 2022] GET /identity/v3/users/f1c35fc801fe4978bce22efb06a83703 => generated 293 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:08.946356 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc6035-128b-4a0d-9fa8-904b142ba7f7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:09.166947 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:09.187790 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc6035-128b-4a0d-9fa8-904b142ba7f7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:09.263896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a626a1a-a28b-46cb-9253-4ce05c4c88d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:09.264916 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a626a1a-a28b-46cb-9253-4ce05c4c88d6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:09.265404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a626a1a-a28b-46cb-9253-4ce05c4c88d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:09.265885 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a626a1a-a28b-46cb-9253-4ce05c4c88d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:09.267196 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a626a1a-a28b-46cb-9253-4ce05c4c88d6 None admin] RBAC: Adding query filter params (role.id=ea851d0cf29e44a1884d7c23431a7481, user.id=f1c35fc801fe4978bce22efb06a83703, scope.system=all) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:09.267728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a626a1a-a28b-46cb-9253-4ce05c4c88d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:09.270357 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a626a1a-a28b-46cb-9253-4ce05c4c88d6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:09.297293 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 163/334] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Aug 11 10:43:08 2022] GET /identity/v3/role_assignments?user.id=f1c35fc801fe4978bce22efb06a83703&scope.system=all&role.id=ea851d0cf29e44a1884d7c23431a7481 => generated 510 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:10.790952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a015bf-c7ef-4517-8e11-054b4a2e7111 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:10.791562 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a015bf-c7ef-4517-8e11-054b4a2e7111 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:10.791562 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a015bf-c7ef-4517-8e11-054b4a2e7111 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:10.793110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 172/335] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:10.795424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821e6bd-a409-49c9-93b3-e8fe17c0775c None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:10.795424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821e6bd-a409-49c9-93b3-e8fe17c0775c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:10.795424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821e6bd-a409-49c9-93b3-e8fe17c0775c None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:10.801429 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 164/336] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:10.801568 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3ec9d-2e9d-4ad1-ba81-f5d76d7e40a0 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:10.801568 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3ec9d-2e9d-4ad1-ba81-f5d76d7e40a0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:10.801568 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3ec9d-2e9d-4ad1-ba81-f5d76d7e40a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:10.823101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ddd3ec9d-2e9d-4ad1-ba81-f5d76d7e40a0 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:10.824703 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ddd3ec9d-2e9d-4ad1-ba81-f5d76d7e40a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:10.843586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40913a2e-6fbb-47e8-a332-f4090b870358 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:10.843921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40913a2e-6fbb-47e8-a332-f4090b870358 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:10.844136 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40913a2e-6fbb-47e8-a332-f4090b870358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:10.873972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-40913a2e-6fbb-47e8-a332-f4090b870358 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:10.875797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-40913a2e-6fbb-47e8-a332-f4090b870358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:10.929679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 173/337] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:43:10.964225 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3ec9d-2e9d-4ad1-ba81-f5d76d7e40a0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:10.986390 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 165/338] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:11.038463 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40913a2e-6fbb-47e8-a332-f4090b870358 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:11.114869 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:11.152552 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:11.180439 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3ec9d-2e9d-4ad1-ba81-f5d76d7e40a0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:11.184164 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40913a2e-6fbb-47e8-a332-f4090b870358 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:11.240923 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e69a9-6bf7-401b-8274-2a08bc49f02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:11.241943 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e69a9-6bf7-401b-8274-2a08bc49f02c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:11.242423 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e69a9-6bf7-401b-8274-2a08bc49f02c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:11.242942 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e69a9-6bf7-401b-8274-2a08bc49f02c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:11.248917 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec20eb-986f-4cb7-aec2-df90411abd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:11.249582 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec20eb-986f-4cb7-aec2-df90411abd47 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:11.249868 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec20eb-986f-4cb7-aec2-df90411abd47 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:11.250145 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ec20eb-986f-4cb7-aec2-df90411abd47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:11.267780 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e69a9-6bf7-401b-8274-2a08bc49f02c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:11.272934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-b99e69a9-6bf7-401b-8274-2a08bc49f02c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 10:43:11.272934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:11.272934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:11.272934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:11.272934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:11.272934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:11.272934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:11.272934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:11.272934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:11.272934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:11.272934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:11.272934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:11.272934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:11.272934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:11.272934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:11.272934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:11.273813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:11.273813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:11.273813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:11.273813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:11.273813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:11.273813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:11.273813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:11.273813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:11.273813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:11.273813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:11.273813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:11.273813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:11.273813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:11.273813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:11.273813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:11.273813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:11.274599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:11.274599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:11.274599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:11.274599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:11.274599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:11.274599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:11.274599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:11.274599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:11.274599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:11.274599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:11.274599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 11 10:43:11.274599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:11.275245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ec20eb-986f-4cb7-aec2-df90411abd47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:11.277253 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 174/339] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:43:11.279518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-56ec20eb-986f-4cb7-aec2-df90411abd47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:43:11.279518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:11.279518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:11.279518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:11.279518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:11.279518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:11.279518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:11.279518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:11.279518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:11.279518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:11.279518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:11.279518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:11.279518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:11.279518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:11.279518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:11.279518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:11.280366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:11.280366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:11.280366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:11.280366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:11.280366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:11.280366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:11.280366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:11.280366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:11.280366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:11.280366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:11.280366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:11.280366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:11.280366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:11.280366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:11.280366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:11.280366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:11.281135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:11.281135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:11.281135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:11.281135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:11.281135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:11.281135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:11.281135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:11.281135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:11.281135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:11.281135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:11.281135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:43:11.281135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:11.282207 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 166/340] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:11.283291 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e69a9-6bf7-401b-8274-2a08bc49f02c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:11.286325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec20eb-986f-4cb7-aec2-df90411abd47 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:11.431908 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ec20eb-986f-4cb7-aec2-df90411abd47 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:11.475910 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff1791-05cf-4958-84d0-94a4880a75d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:11.476957 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff1791-05cf-4958-84d0-94a4880a75d8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:11.478386 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff1791-05cf-4958-84d0-94a4880a75d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:11.478895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff1791-05cf-4958-84d0-94a4880a75d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:11.479775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff1791-05cf-4958-84d0-94a4880a75d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:11.480489 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff1791-05cf-4958-84d0-94a4880a75d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:11.483841 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff1791-05cf-4958-84d0-94a4880a75d8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:11.498923 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 167/341] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:43:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:11.499510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:11.502524 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f04536-7852-4924-876e-10bbf5e33a38 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:11.504181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f04536-7852-4924-876e-10bbf5e33a38 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:11.504181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f04536-7852-4924-876e-10bbf5e33a38 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:11.510366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 168/342] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:11.511288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f04536-7852-4924-876e-10bbf5e33a38 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:11.536248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e69a9-6bf7-401b-8274-2a08bc49f02c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:11.594558 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:11.634047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f2e9c-b693-454c-8e0c-7ca476f425b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:11.635150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f2e9c-b693-454c-8e0c-7ca476f425b6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:11.635665 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f2e9c-b693-454c-8e0c-7ca476f425b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:11.636142 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f2e9c-b693-454c-8e0c-7ca476f425b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:11.637016 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f2e9c-b693-454c-8e0c-7ca476f425b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:11.637526 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f2e9c-b693-454c-8e0c-7ca476f425b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:11.639820 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f2e9c-b693-454c-8e0c-7ca476f425b6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:11.651967 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f04536-7852-4924-876e-10bbf5e33a38 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:11.655201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 175/343] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:43:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:11.656743 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c94f9c-ba92-42d6-a38f-989204aca8b9 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:11.657247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c94f9c-ba92-42d6-a38f-989204aca8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:11.657745 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c94f9c-ba92-42d6-a38f-989204aca8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:11.688911 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e50bd-a43d-46fd-bffc-68769c93f117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:11.689494 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e50bd-a43d-46fd-bffc-68769c93f117 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:11.689774 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e50bd-a43d-46fd-bffc-68769c93f117 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:11.690078 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e50bd-a43d-46fd-bffc-68769c93f117 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:11.692753 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d2c94f9c-ba92-42d6-a38f-989204aca8b9 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:11.694119 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d2c94f9c-ba92-42d6-a38f-989204aca8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:11.761487 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:11.767465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e50bd-a43d-46fd-bffc-68769c93f117 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:11.769156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e50bd-a43d-46fd-bffc-68769c93f117 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:11.884230 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 169/344] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:43:11.885040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e50bd-a43d-46fd-bffc-68769c93f117 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:11.886427 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 176/345] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:11.889652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80273425-0095-4c1d-8612-2b2b0b4e005e None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:11.890184 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80273425-0095-4c1d-8612-2b2b0b4e005e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:11.890670 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80273425-0095-4c1d-8612-2b2b0b4e005e None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:11.896338 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 177/346] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:11.896338 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80273425-0095-4c1d-8612-2b2b0b4e005e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:11.992566 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:11.996439 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e50bd-a43d-46fd-bffc-68769c93f117 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:12.006999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80273425-0095-4c1d-8612-2b2b0b4e005e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:12.021958 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:12.043163 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131fc47-41f7-43d6-930a-7161569a850c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:12.043732 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131fc47-41f7-43d6-930a-7161569a850c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:12.044105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131fc47-41f7-43d6-930a-7161569a850c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:12.044392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131fc47-41f7-43d6-930a-7161569a850c None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:12.045510 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131fc47-41f7-43d6-930a-7161569a850c None admin] RBAC: Authorizing `identity:get_project(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:12.047085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131fc47-41f7-43d6-930a-7161569a850c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:12.049240 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 178/347] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:43:11 2022] GET /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:12.049942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa003b-7c66-416b-93eb-7319a93c27ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:12.050467 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee3698-b57e-479f-a838-c315f951e3ee None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:12.050749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee3698-b57e-479f-a838-c315f951e3ee None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:12.051037 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee3698-b57e-479f-a838-c315f951e3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:12.051587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa003b-7c66-416b-93eb-7319a93c27ba None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:12.052102 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa003b-7c66-416b-93eb-7319a93c27ba None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:12.052584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa003b-7c66-416b-93eb-7319a93c27ba None admin] PATH_INFO: `/v3/users/65182904f61a40eea99bbb5379ca8bb0` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:12.054289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa003b-7c66-416b-93eb-7319a93c27ba None admin] RBAC: Authorizing `identity:get_user(user_id=65182904f61a40eea99bbb5379ca8bb0)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:12.056094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa003b-7c66-416b-93eb-7319a93c27ba None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:12.058122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 170/348] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:43:11 2022] GET /identity/v3/users/65182904f61a40eea99bbb5379ca8bb0 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:12.060141 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa003b-7c66-416b-93eb-7319a93c27ba None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:12.071283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-20ee3698-b57e-479f-a838-c315f951e3ee None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:12.072466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-20ee3698-b57e-479f-a838-c315f951e3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:12.149900 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 179/349] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:12.149900 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee3698-b57e-479f-a838-c315f951e3ee None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:12.180466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa003b-7c66-416b-93eb-7319a93c27ba None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:12.235513 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ab09a-4d0d-4861-8f41-a6af312d2a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:12.236156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ab09a-4d0d-4861-8f41-a6af312d2a58 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:12.236440 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ab09a-4d0d-4861-8f41-a6af312d2a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:12.236708 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ab09a-4d0d-4861-8f41-a6af312d2a58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:12.250611 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ab09a-4d0d-4861-8f41-a6af312d2a58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:12.256609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-a45ab09a-4d0d-4861-8f41-a6af312d2a58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:43:12.256609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:12.256609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:12.256609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:12.256609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:12.256609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:12.256609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:12.256609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:12.256609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:12.256609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:12.256609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:12.256609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:12.256609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:12.256609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:12.256609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:12.256609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:12.257856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:12.257856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:12.257856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:12.257856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:12.257856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:12.257856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:12.257856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:12.257856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:12.257856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:12.257856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:12.257856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:12.257856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:12.257856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:12.257856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:12.257856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:12.257856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:12.258635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:12.258635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:12.258635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:12.258635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:12.258635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:12.258635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:12.258635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:12.258635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:12.258635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:12.258635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:12.258635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:43:12.258635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:12.258635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 171/350] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:43:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:12.258635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ab09a-4d0d-4861-8f41-a6af312d2a58 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:12.284826 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee3698-b57e-479f-a838-c315f951e3ee None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:12.295538 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:12.301180 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:12.327564 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710da8bd-7ed7-4fb4-80f5-2c85310a6f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:12.328815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710da8bd-7ed7-4fb4-80f5-2c85310a6f67 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:12.329249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710da8bd-7ed7-4fb4-80f5-2c85310a6f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:12.329669 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710da8bd-7ed7-4fb4-80f5-2c85310a6f67 None admin] PATH_INFO: `/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:12.337822 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710da8bd-7ed7-4fb4-80f5-2c85310a6f67 None admin] RBAC: Authorizing `identity:get_group(group_id=5cfe934d1d4848ff8b094c3dfa5f88e7)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:12.339678 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710da8bd-7ed7-4fb4-80f5-2c85310a6f67 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:12.342196 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 180/351] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Aug 11 10:43:12 2022] GET /identity/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:12.343266 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53ee3c-2501-4e7c-9e6e-5c81c048cc39 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:12.343559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53ee3c-2501-4e7c-9e6e-5c81c048cc39 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:12.343834 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53ee3c-2501-4e7c-9e6e-5c81c048cc39 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:12.345206 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 181/352] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:12.345912 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53ee3c-2501-4e7c-9e6e-5c81c048cc39 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:12.390310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ab09a-4d0d-4861-8f41-a6af312d2a58 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:12.433243 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a63861-c974-49e8-b6ba-16a3a20fb7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:12.434177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a63861-c974-49e8-b6ba-16a3a20fb7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:12.434664 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a63861-c974-49e8-b6ba-16a3a20fb7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:12.435413 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a63861-c974-49e8-b6ba-16a3a20fb7e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:12.436566 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a63861-c974-49e8-b6ba-16a3a20fb7e8 None admin] RBAC: Adding query filter params (role.id=cef88e8a775e490a985ff36748d330f4, user.id=65182904f61a40eea99bbb5379ca8bb0, scope.system=all) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:12.436888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a63861-c974-49e8-b6ba-16a3a20fb7e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:12.438395 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a63861-c974-49e8-b6ba-16a3a20fb7e8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:12.452821 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 172/353] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Aug 11 10:43:12 2022] GET /identity/v3/role_assignments?user.id=65182904f61a40eea99bbb5379ca8bb0&scope.system=all&role.id=cef88e8a775e490a985ff36748d330f4 => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:12.453984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a63861-c974-49e8-b6ba-16a3a20fb7e8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:12.498706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53ee3c-2501-4e7c-9e6e-5c81c048cc39 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:12.556136 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9e9e7-6968-4c89-86ce-6deeba98bb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:12.556736 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9e9e7-6968-4c89-86ce-6deeba98bb36 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:12.557015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9e9e7-6968-4c89-86ce-6deeba98bb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:12.557310 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9e9e7-6968-4c89-86ce-6deeba98bb36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:12.576033 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9e9e7-6968-4c89-86ce-6deeba98bb36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:12.581084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-cdb9e9e7-6968-4c89-86ce-6deeba98bb36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:43:12.581084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:12.581084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:12.581084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:12.581084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:12.581084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:12.581084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:12.581084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:12.581084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:12.581084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:12.581084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:12.581084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:12.581084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:12.581084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:12.581084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:12.581084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:12.582019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:12.582019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:12.582019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:12.582019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:12.582019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:12.582019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:12.582019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:12.582019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:12.582019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:12.582019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:12.582019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:12.582019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:12.582019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:12.582019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:12.582019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:12.582019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:12.582830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:12.582830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:12.582830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:12.582830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:12.582830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:12.582830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:12.582830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:12.582830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:12.582830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:12.582830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:12.582830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:43:12.582830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:12.582830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 182/354] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:43:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:12.583994 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c071cbb-90d7-4fb6-bc17-b94f2b8cdfcd None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:12.583994 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c071cbb-90d7-4fb6-bc17-b94f2b8cdfcd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:12.583994 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c071cbb-90d7-4fb6-bc17-b94f2b8cdfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:12.601220 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:12.607965 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-7c071cbb-90d7-4fb6-bc17-b94f2b8cdfcd None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:12.612883 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7c071cbb-90d7-4fb6-bc17-b94f2b8cdfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:12.618925 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a63861-c974-49e8-b6ba-16a3a20fb7e8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:12.642082 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:12.660794 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcc4d1-a839-491e-b4ee-52a6a2bce08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:12.661417 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcc4d1-a839-491e-b4ee-52a6a2bce08e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:12.661701 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcc4d1-a839-491e-b4ee-52a6a2bce08e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:12.661972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcc4d1-a839-491e-b4ee-52a6a2bce08e None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:12.664146 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcc4d1-a839-491e-b4ee-52a6a2bce08e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:12.664146 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcc4d1-a839-491e-b4ee-52a6a2bce08e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:12.667120 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcc4d1-a839-491e-b4ee-52a6a2bce08e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:12.674030 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 173/355] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:12.675204 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcc4d1-a839-491e-b4ee-52a6a2bce08e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:12.697861 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 183/356] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:12.699341 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451cef3-b43c-45ff-9815-f0636859595b None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:12.699627 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451cef3-b43c-45ff-9815-f0636859595b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:12.699943 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451cef3-b43c-45ff-9815-f0636859595b None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:12.702572 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 184/357] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:12.703422 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451cef3-b43c-45ff-9815-f0636859595b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:12.815270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcc4d1-a839-491e-b4ee-52a6a2bce08e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:12.827075 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451cef3-b43c-45ff-9815-f0636859595b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:12.861468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152493e9-ea12-48d3-b7ca-c13b67fc4d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:12.862418 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152493e9-ea12-48d3-b7ca-c13b67fc4d34 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:12.862710 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152493e9-ea12-48d3-b7ca-c13b67fc4d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:12.863010 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152493e9-ea12-48d3-b7ca-c13b67fc4d34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:12.864571 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152493e9-ea12-48d3-b7ca-c13b67fc4d34 None admin] RBAC: Adding query filter params (group.id=5cfe934d1d4848ff8b094c3dfa5f88e7, role.id=ea851d0cf29e44a1884d7c23431a7481, scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:12.864571 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152493e9-ea12-48d3-b7ca-c13b67fc4d34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:12.865482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152493e9-ea12-48d3-b7ca-c13b67fc4d34 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:12.871561 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e90b2-0983-48dd-aacc-50f9919365b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:12.872749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 174/358] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Aug 11 10:43:12 2022] GET /identity/v3/role_assignments?group.id=5cfe934d1d4848ff8b094c3dfa5f88e7&scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6&role.id=ea851d0cf29e44a1884d7c23431a7481 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:12.872989 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e90b2-0983-48dd-aacc-50f9919365b4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:12.873277 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e90b2-0983-48dd-aacc-50f9919365b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:12.873580 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e90b2-0983-48dd-aacc-50f9919365b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:12.873794 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152493e9-ea12-48d3-b7ca-c13b67fc4d34 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:12.874229 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e90b2-0983-48dd-aacc-50f9919365b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:12.874537 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e90b2-0983-48dd-aacc-50f9919365b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:12.876009 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e90b2-0983-48dd-aacc-50f9919365b4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:12.887515 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 185/359] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:12.888944 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea1170-dbf4-49e3-abd5-c57ee4ff9032 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:12.889229 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea1170-dbf4-49e3-abd5-c57ee4ff9032 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:12.889506 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea1170-dbf4-49e3-abd5-c57ee4ff9032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:12.891328 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:12.911059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ffea1170-dbf4-49e3-abd5-c57ee4ff9032 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:12.912443 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ffea1170-dbf4-49e3-abd5-c57ee4ff9032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:12.952514 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:13.022538 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 186/360] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:13.022722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea1170-dbf4-49e3-abd5-c57ee4ff9032 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:13.037622 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152493e9-ea12-48d3-b7ca-c13b67fc4d34 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:13.077163 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17206de-f3a0-4392-9f9b-cbf1c8a4cf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:13.077704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17206de-f3a0-4392-9f9b-cbf1c8a4cf03 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:13.077996 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17206de-f3a0-4392-9f9b-cbf1c8a4cf03 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:13.078274 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17206de-f3a0-4392-9f9b-cbf1c8a4cf03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:13.153710 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea1170-dbf4-49e3-abd5-c57ee4ff9032 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:13.179263 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17206de-f3a0-4392-9f9b-cbf1c8a4cf03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:13.181208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17206de-f3a0-4392-9f9b-cbf1c8a4cf03 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:13.195585 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3aec9-29d9-4bfc-8a57-ec455b8c0770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:13.196349 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3aec9-29d9-4bfc-8a57-ec455b8c0770 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:13.196701 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3aec9-29d9-4bfc-8a57-ec455b8c0770 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:13.197043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3aec9-29d9-4bfc-8a57-ec455b8c0770 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:13.201135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:13.210169 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3aec9-29d9-4bfc-8a57-ec455b8c0770 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:13.215238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-77d3aec9-29d9-4bfc-8a57-ec455b8c0770 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:43:13.215238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:13.215238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:13.215238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:13.215238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:13.215238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:13.215238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:13.215238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:13.215238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:13.215238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:13.215238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:13.215238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:13.215238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:13.215238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:13.215238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:13.215238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:13.217847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:13.217847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:13.217847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:13.217847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:13.217847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:13.217847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:13.217847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:13.217847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:13.217847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:13.217847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:13.217847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:13.217847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:13.217847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:13.217847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:13.217847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:13.217847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:13.218857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:13.218857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:13.218857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:13.218857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:13.218857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:13.218857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:13.218857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:13.218857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:13.218857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:13.218857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:13.218857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:43:13.218857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:13.218857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 187/361] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:13.218857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3aec9-29d9-4bfc-8a57-ec455b8c0770 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:13.250303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:13.325399 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 175/362] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:43:13.327105 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17206de-f3a0-4392-9f9b-cbf1c8a4cf03 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:13.358278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3aec9-29d9-4bfc-8a57-ec455b8c0770 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:13.405963 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021e72a-2616-4fc7-976c-1a97b990cf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:13.406590 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021e72a-2616-4fc7-976c-1a97b990cf27 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:13.406956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021e72a-2616-4fc7-976c-1a97b990cf27 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:13.407230 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021e72a-2616-4fc7-976c-1a97b990cf27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:13.458402 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17206de-f3a0-4392-9f9b-cbf1c8a4cf03 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:13.475013 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:13.499919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021e72a-2616-4fc7-976c-1a97b990cf27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:13.501378 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021e72a-2616-4fc7-976c-1a97b990cf27 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:13.505780 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edeaddc-7614-4635-a528-ec9037846b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:13.506423 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edeaddc-7614-4635-a528-ec9037846b2d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:13.506704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edeaddc-7614-4635-a528-ec9037846b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:13.507050 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edeaddc-7614-4635-a528-ec9037846b2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:13.519291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edeaddc-7614-4635-a528-ec9037846b2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:13.521653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:13.523990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-0edeaddc-7614-4635-a528-ec9037846b2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:43:13.523990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:13.523990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:13.523990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:13.523990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:13.523990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:13.523990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:13.523990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:13.523990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:13.523990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:13.523990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:13.523990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:13.523990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:13.523990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:13.523990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:13.523990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:13.524867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:13.524867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:13.524867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:13.524867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:13.524867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:13.524867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:13.524867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:13.524867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:13.524867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:13.524867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:13.524867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:13.524867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:13.524867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:13.524867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:13.524867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:13.524867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:13.526561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:13.526561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:13.526561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:13.526561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:13.526561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:13.526561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:13.526561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:13.526561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:13.526561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:13.526561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:13.526561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:43:13.526561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:13.526561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 176/363] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:43:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:13.532320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edeaddc-7614-4635-a528-ec9037846b2d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:13.630219 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 188/364] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:43:13.634974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021e72a-2616-4fc7-976c-1a97b990cf27 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:13.665384 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edeaddc-7614-4635-a528-ec9037846b2d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:13.713929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e896f-17d3-4000-8d58-85f3003fd1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:13.715717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e896f-17d3-4000-8d58-85f3003fd1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:13.715717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e896f-17d3-4000-8d58-85f3003fd1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:13.715717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e896f-17d3-4000-8d58-85f3003fd1d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:13.716800 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e896f-17d3-4000-8d58-85f3003fd1d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:13.717176 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e896f-17d3-4000-8d58-85f3003fd1d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:13.718576 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e896f-17d3-4000-8d58-85f3003fd1d8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:13.728425 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 177/365] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:43:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:13.729137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e896f-17d3-4000-8d58-85f3003fd1d8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:13.758577 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021e72a-2616-4fc7-976c-1a97b990cf27 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:13.775326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:13.789781 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:13.808832 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcafa9-e773-4220-8051-71ffde52a569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:13.809493 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcafa9-e773-4220-8051-71ffde52a569 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:13.809840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcafa9-e773-4220-8051-71ffde52a569 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:13.810106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bcafa9-e773-4220-8051-71ffde52a569 None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:13.811268 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bcafa9-e773-4220-8051-71ffde52a569 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:13.812706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bcafa9-e773-4220-8051-71ffde52a569 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:13.819025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 189/366] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:43:13 2022] GET /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:13.819885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcafa9-e773-4220-8051-71ffde52a569 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:13.863993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e896f-17d3-4000-8d58-85f3003fd1d8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:13.909614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59540bd-ac9c-4796-976e-9f3dd70779bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:13.911019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59540bd-ac9c-4796-976e-9f3dd70779bf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:13.911305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59540bd-ac9c-4796-976e-9f3dd70779bf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:13.911580 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59540bd-ac9c-4796-976e-9f3dd70779bf None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:13.912255 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59540bd-ac9c-4796-976e-9f3dd70779bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:13.912573 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59540bd-ac9c-4796-976e-9f3dd70779bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:13.913936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59540bd-ac9c-4796-976e-9f3dd70779bf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:13.924690 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 178/367] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:13.925523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59540bd-ac9c-4796-976e-9f3dd70779bf None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:13.945046 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bcafa9-e773-4220-8051-71ffde52a569 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:13.992133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e62a0-1373-4343-893b-26fddbffd41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:13.992774 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e62a0-1373-4343-893b-26fddbffd41f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:13.993050 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e62a0-1373-4343-893b-26fddbffd41f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:13.993318 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e62a0-1373-4343-893b-26fddbffd41f None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:13.995816 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e62a0-1373-4343-893b-26fddbffd41f None admin] RBAC: Authorizing `identity:get_project(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:13.997858 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e62a0-1373-4343-893b-26fddbffd41f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:13.999935 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 190/368] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:43:13 2022] GET /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:14.000636 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e62a0-1373-4343-893b-26fddbffd41f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:14.063413 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:14.070943 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:14.074526 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59540bd-ac9c-4796-976e-9f3dd70779bf None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:14.120836 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cf90f-6f50-482a-a23a-98fad5172036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:14.121503 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cf90f-6f50-482a-a23a-98fad5172036 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:14.121730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cf90f-6f50-482a-a23a-98fad5172036 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:14.122088 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cf90f-6f50-482a-a23a-98fad5172036 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:14.128148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e62a0-1373-4343-893b-26fddbffd41f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:14.180082 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb7c77-9a62-4eae-9bf6-c6bc28a46837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:14.181514 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb7c77-9a62-4eae-9bf6-c6bc28a46837 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:14.182021 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb7c77-9a62-4eae-9bf6-c6bc28a46837 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:14.182914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb7c77-9a62-4eae-9bf6-c6bc28a46837 None admin] PATH_INFO: `/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:14.184642 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb7c77-9a62-4eae-9bf6-c6bc28a46837 None admin] RBAC: Authorizing `identity:get_group(group_id=5cfe934d1d4848ff8b094c3dfa5f88e7)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:14.186484 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb7c77-9a62-4eae-9bf6-c6bc28a46837 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:14.189340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 191/369] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Aug 11 10:43:13 2022] GET /identity/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:14.190677 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb7c77-9a62-4eae-9bf6-c6bc28a46837 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:14.220939 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33cf90f-6f50-482a-a23a-98fad5172036 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:14.222380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33cf90f-6f50-482a-a23a-98fad5172036 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:14.311559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb7c77-9a62-4eae-9bf6-c6bc28a46837 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:14.344072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:14.346917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:14.354462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 179/370] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:43:14.355543 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cf90f-6f50-482a-a23a-98fad5172036 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:14.364421 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a97d8-1859-4c58-ba3e-231e110a0659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:14.365485 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a97d8-1859-4c58-ba3e-231e110a0659 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:14.365968 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a97d8-1859-4c58-ba3e-231e110a0659 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:14.366460 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a97d8-1859-4c58-ba3e-231e110a0659 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:14.452345 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a97d8-1859-4c58-ba3e-231e110a0659 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:14.454148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0a97d8-1859-4c58-ba3e-231e110a0659 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:14.475942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cf90f-6f50-482a-a23a-98fad5172036 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:14.534723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f4131-341d-4ef5-a486-7883554e6d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:14.535542 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f4131-341d-4ef5-a486-7883554e6d5c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:14.535915 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f4131-341d-4ef5-a486-7883554e6d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:14.536305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f4131-341d-4ef5-a486-7883554e6d5c None admin] PATH_INFO: `/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:14.537518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f4131-341d-4ef5-a486-7883554e6d5c None admin] RBAC: Authorizing `identity:get_group(group_id=5cfe934d1d4848ff8b094c3dfa5f88e7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:14.539057 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f4131-341d-4ef5-a486-7883554e6d5c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:14.540695 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 180/371] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Aug 11 10:43:14 2022] GET /identity/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:14.541533 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f4131-341d-4ef5-a486-7883554e6d5c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:14.587027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 192/372] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:43:14.588287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a97d8-1859-4c58-ba3e-231e110a0659 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:14.604134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:14.618167 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:14.645275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f4131-341d-4ef5-a486-7883554e6d5c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:14.689161 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a489763-09bd-4c34-bd56-0797c798ec69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:14.690227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a489763-09bd-4c34-bd56-0797c798ec69 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:14.690650 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a489763-09bd-4c34-bd56-0797c798ec69 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:14.690961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a489763-09bd-4c34-bd56-0797c798ec69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:14.691698 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a489763-09bd-4c34-bd56-0797c798ec69 None admin] RBAC: Adding query filter params (group.id=5cfe934d1d4848ff8b094c3dfa5f88e7, role.id=e9cc929c9958498d8ce27ca88f685549, scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:14.692014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a489763-09bd-4c34-bd56-0797c798ec69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:14.692164 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a97d8-1859-4c58-ba3e-231e110a0659 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:14.693456 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a489763-09bd-4c34-bd56-0797c798ec69 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:14.710917 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 181/373] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Aug 11 10:43:14 2022] GET /identity/v3/role_assignments?group.id=5cfe934d1d4848ff8b094c3dfa5f88e7&scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6&role.id=e9cc929c9958498d8ce27ca88f685549 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:14.710917 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a489763-09bd-4c34-bd56-0797c798ec69 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:14.727787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27a38d-a1b8-4021-aece-b0c595d1a6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:14.728434 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27a38d-a1b8-4021-aece-b0c595d1a6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:14.728711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27a38d-a1b8-4021-aece-b0c595d1a6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:14.728981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27a38d-a1b8-4021-aece-b0c595d1a6a4 None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:14.730160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27a38d-a1b8-4021-aece-b0c595d1a6a4 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:14.731710 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27a38d-a1b8-4021-aece-b0c595d1a6a4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:14.738345 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 193/374] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:43:14 2022] GET /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:14.739333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27a38d-a1b8-4021-aece-b0c595d1a6a4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:14.842710 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a489763-09bd-4c34-bd56-0797c798ec69 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:14.868139 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:14.873728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:14.881722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27a38d-a1b8-4021-aece-b0c595d1a6a4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:14.882752 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbcdb4-a954-446b-b59f-94f204c2a41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:14.883771 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbcdb4-a954-446b-b59f-94f204c2a41d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:14.886199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbcdb4-a954-446b-b59f-94f204c2a41d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:14.886199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbcdb4-a954-446b-b59f-94f204c2a41d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:14.886199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbcdb4-a954-446b-b59f-94f204c2a41d None admin] RBAC: Adding query filter params (group.id=5cfe934d1d4848ff8b094c3dfa5f88e7, role.id=e9cc929c9958498d8ce27ca88f685549, scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:14.886711 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbcdb4-a954-446b-b59f-94f204c2a41d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:14.888516 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbcdb4-a954-446b-b59f-94f204c2a41d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:14.902802 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 182/375] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Aug 11 10:43:14 2022] GET /identity/v3/role_assignments?group.id=5cfe934d1d4848ff8b094c3dfa5f88e7&scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c&role.id=e9cc929c9958498d8ce27ca88f685549 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:14.902802 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbcdb4-a954-446b-b59f-94f204c2a41d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:14.946015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4737eb-0ae0-418a-806e-760104438631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:14.946719 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4737eb-0ae0-418a-806e-760104438631 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:14.947030 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4737eb-0ae0-418a-806e-760104438631 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:14.947306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4737eb-0ae0-418a-806e-760104438631 None admin] PATH_INFO: `/v3/projects/d6947801fa7c4cca9da48801b7ffc014` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:14.949816 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4737eb-0ae0-418a-806e-760104438631 None admin] RBAC: Authorizing `identity:get_project(project_id=d6947801fa7c4cca9da48801b7ffc014)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:14.952470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4737eb-0ae0-418a-806e-760104438631 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:14.955667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 194/376] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:43:14 2022] GET /identity/v3/projects/d6947801fa7c4cca9da48801b7ffc014 => generated 344 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:14.964049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4737eb-0ae0-418a-806e-760104438631 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:15.089199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbcdb4-a954-446b-b59f-94f204c2a41d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:15.116500 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4737eb-0ae0-418a-806e-760104438631 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:15.130666 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c137bcc-cfc2-4625-bb47-f66e7dd35155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:15.131616 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c137bcc-cfc2-4625-bb47-f66e7dd35155 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:15.131898 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c137bcc-cfc2-4625-bb47-f66e7dd35155 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:15.132176 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c137bcc-cfc2-4625-bb47-f66e7dd35155 None admin] PATH_INFO: `/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:15.133423 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c137bcc-cfc2-4625-bb47-f66e7dd35155 None admin] RBAC: Authorizing `identity:get_group(group_id=5cfe934d1d4848ff8b094c3dfa5f88e7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:15.135565 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c137bcc-cfc2-4625-bb47-f66e7dd35155 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:15.138187 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 183/377] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Aug 11 10:43:14 2022] GET /identity/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:15.139392 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26e5b7-89c0-4679-b3b6-5bb9c2d612a7 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:15.139673 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26e5b7-89c0-4679-b3b6-5bb9c2d612a7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:15.139939 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26e5b7-89c0-4679-b3b6-5bb9c2d612a7 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:15.145283 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 184/378] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:15.146076 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26e5b7-89c0-4679-b3b6-5bb9c2d612a7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:15.163760 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934929ff-48d6-4bf7-9f79-5a1453f32c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:15.164398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934929ff-48d6-4bf7-9f79-5a1453f32c08 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:15.164674 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934929ff-48d6-4bf7-9f79-5a1453f32c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:15.165089 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934929ff-48d6-4bf7-9f79-5a1453f32c08 None admin] PATH_INFO: `/v3/groups/8b7a82cab6ee4cd1879e7d1b2056e58b` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:15.171952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934929ff-48d6-4bf7-9f79-5a1453f32c08 None admin] RBAC: Authorizing `identity:get_group(group_id=8b7a82cab6ee4cd1879e7d1b2056e58b)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:15.173846 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934929ff-48d6-4bf7-9f79-5a1453f32c08 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:15.178857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 195/379] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Aug 11 10:43:14 2022] GET /identity/v3/groups/8b7a82cab6ee4cd1879e7d1b2056e58b => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:15.180109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f42afe-e17b-4f18-816a-340b24fac741 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:15.180393 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f42afe-e17b-4f18-816a-340b24fac741 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:15.180667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f42afe-e17b-4f18-816a-340b24fac741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:15.201246 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-40f42afe-e17b-4f18-816a-340b24fac741 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:15.202498 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-40f42afe-e17b-4f18-816a-340b24fac741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:15.218639 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:15.220694 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:15.262022 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26e5b7-89c0-4679-b3b6-5bb9c2d612a7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:15.279085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 196/380] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:15.280012 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f42afe-e17b-4f18-816a-340b24fac741 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:15.298529 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64676fab-6466-4790-85a5-764f1a596aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:15.299171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64676fab-6466-4790-85a5-764f1a596aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:15.299533 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64676fab-6466-4790-85a5-764f1a596aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:15.299814 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64676fab-6466-4790-85a5-764f1a596aa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:15.300544 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64676fab-6466-4790-85a5-764f1a596aa6 None admin] RBAC: Adding query filter params (group.id=5cfe934d1d4848ff8b094c3dfa5f88e7, role.id=ea851d0cf29e44a1884d7c23431a7481, scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:15.300855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64676fab-6466-4790-85a5-764f1a596aa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:15.302390 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64676fab-6466-4790-85a5-764f1a596aa6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:15.307918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 185/381] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Aug 11 10:43:15 2022] GET /identity/v3/role_assignments?group.id=5cfe934d1d4848ff8b094c3dfa5f88e7&scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c&role.id=ea851d0cf29e44a1884d7c23431a7481 => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:15.334340 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64676fab-6466-4790-85a5-764f1a596aa6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:15.408370 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f42afe-e17b-4f18-816a-340b24fac741 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:15.451134 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffaede-55bf-4358-90af-20fe3f2b5104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:15.451872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffaede-55bf-4358-90af-20fe3f2b5104 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:15.452206 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffaede-55bf-4358-90af-20fe3f2b5104 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:15.452483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ffaede-55bf-4358-90af-20fe3f2b5104 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:15.453218 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffaede-55bf-4358-90af-20fe3f2b5104 None admin] RBAC: Adding query filter params (group.id=8b7a82cab6ee4cd1879e7d1b2056e58b, role.id=00c6de5dd6cd4267ba05941ddb91e6ad, scope.project.id=d6947801fa7c4cca9da48801b7ffc014) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:15.453527 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffaede-55bf-4358-90af-20fe3f2b5104 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:15.455246 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ffaede-55bf-4358-90af-20fe3f2b5104 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:15.461340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 197/382] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Aug 11 10:43:15 2022] GET /identity/v3/role_assignments?group.id=8b7a82cab6ee4cd1879e7d1b2056e58b&scope.project.id=d6947801fa7c4cca9da48801b7ffc014&role.id=00c6de5dd6cd4267ba05941ddb91e6ad => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:15.546265 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64676fab-6466-4790-85a5-764f1a596aa6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:15.572811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:15.583688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba724f93-26d6-4da3-8bd9-fd55104a10dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:15.584344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba724f93-26d6-4da3-8bd9-fd55104a10dd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:15.584621 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba724f93-26d6-4da3-8bd9-fd55104a10dd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:15.584894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba724f93-26d6-4da3-8bd9-fd55104a10dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:15.599494 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba724f93-26d6-4da3-8bd9-fd55104a10dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:15.604289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ba724f93-26d6-4da3-8bd9-fd55104a10dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:43:15.604289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:15.604289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:15.604289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:15.604289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:15.604289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:15.604289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:15.604289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:15.604289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:15.604289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:15.604289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:15.604289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:15.604289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:15.604289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:15.604289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:15.604289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:15.605189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:15.605189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:15.605189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:15.605189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:15.605189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:15.605189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:15.605189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:15.605189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:15.605189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:15.605189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:15.605189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:15.605189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:15.605189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:15.605189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:15.605189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:15.605189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:15.605942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:15.605942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:15.605942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:15.605942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:15.605942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:15.605942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:15.605942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:15.605942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:15.605942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:15.605942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:15.605942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:43:15.605942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:15.605942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 186/383] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:15.613923 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffaede-55bf-4358-90af-20fe3f2b5104 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:15.655152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:15.782048 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ffaede-55bf-4358-90af-20fe3f2b5104 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:15.818669 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a062f3-d376-4633-af20-48e8ace42a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:15.819242 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a062f3-d376-4633-af20-48e8ace42a4a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:15.819523 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a062f3-d376-4633-af20-48e8ace42a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:15.819795 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a062f3-d376-4633-af20-48e8ace42a4a None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:15.820456 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a062f3-d376-4633-af20-48e8ace42a4a None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:15.820756 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a062f3-d376-4633-af20-48e8ace42a4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:15.822116 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a062f3-d376-4633-af20-48e8ace42a4a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:15.830536 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 198/384] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:43:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:15.836181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba724f93-26d6-4da3-8bd9-fd55104a10dd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:15.944587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba724f93-26d6-4da3-8bd9-fd55104a10dd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:15.990679 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0af9a2-4ca7-4cf2-83b5-979affa94c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:15.991377 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0af9a2-4ca7-4cf2-83b5-979affa94c74 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:15.991665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0af9a2-4ca7-4cf2-83b5-979affa94c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:15.991943 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0af9a2-4ca7-4cf2-83b5-979affa94c74 None admin] PATH_INFO: `/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:15.993144 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0af9a2-4ca7-4cf2-83b5-979affa94c74 None admin] RBAC: Authorizing `identity:get_group(group_id=5cfe934d1d4848ff8b094c3dfa5f88e7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:15.994580 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0af9a2-4ca7-4cf2-83b5-979affa94c74 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:15.996500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 187/385] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Aug 11 10:43:15 2022] GET /identity/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:16.002282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a062f3-d376-4633-af20-48e8ace42a4a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:16.116696 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:16.147283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a062f3-d376-4633-af20-48e8ace42a4a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:16.192563 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bfe5d-73a5-4d81-85ef-e65e587ccf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:16.193562 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bfe5d-73a5-4d81-85ef-e65e587ccf12 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:16.194072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bfe5d-73a5-4d81-85ef-e65e587ccf12 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:16.194548 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bfe5d-73a5-4d81-85ef-e65e587ccf12 None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:16.199465 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594bfe5d-73a5-4d81-85ef-e65e587ccf12 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:16.201953 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594bfe5d-73a5-4d81-85ef-e65e587ccf12 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:16.204036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 199/386] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:43:16 2022] GET /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:16.211817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0af9a2-4ca7-4cf2-83b5-979affa94c74 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:16.303270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:16.374202 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0af9a2-4ca7-4cf2-83b5-979affa94c74 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:16.417803 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c965637-311e-48b0-98ae-850c6763360d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:16.418478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c965637-311e-48b0-98ae-850c6763360d None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:16.418798 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c965637-311e-48b0-98ae-850c6763360d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:16.419085 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c965637-311e-48b0-98ae-850c6763360d None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6/groups/5cfe934d1d4848ff8b094c3dfa5f88e7/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:16.421121 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c965637-311e-48b0-98ae-850c6763360d None admin] RBAC: Authorizing `identity:create_grant(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6, group_id=5cfe934d1d4848ff8b094c3dfa5f88e7, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:16.422564 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c965637-311e-48b0-98ae-850c6763360d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:16.509585 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 188/387] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Aug 11 10:43:16 2022] PUT /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6/groups/5cfe934d1d4848ff8b094c3dfa5f88e7/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:43:17.082963 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82005d-8e19-49d6-b7c2-817270512729 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:17.082963 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82005d-8e19-49d6-b7c2-817270512729 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:17.082963 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82005d-8e19-49d6-b7c2-817270512729 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:17.083889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 200/388] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:17.096940 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325a2df-c192-49e7-90fe-6d099d69e381 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:17.097471 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325a2df-c192-49e7-90fe-6d099d69e381 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:17.097897 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325a2df-c192-49e7-90fe-6d099d69e381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:17.127154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2325a2df-c192-49e7-90fe-6d099d69e381 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:17.129016 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2325a2df-c192-49e7-90fe-6d099d69e381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:17.249901 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 189/389] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:17.286962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82005d-8e19-49d6-b7c2-817270512729 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:17.405822 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f4106-58b2-4127-9af2-6a47c4fcf771 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:17.406456 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f4106-58b2-4127-9af2-6a47c4fcf771 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:17.406984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f4106-58b2-4127-9af2-6a47c4fcf771 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:17.409797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 190/390] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:43:17.414251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3159548-5396-4691-ba5a-2a64c56d9afa None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:17.414810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3159548-5396-4691-ba5a-2a64c56d9afa None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:17.415290 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3159548-5396-4691-ba5a-2a64c56d9afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:17.428709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82005d-8e19-49d6-b7c2-817270512729 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:17.436849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f3159548-5396-4691-ba5a-2a64c56d9afa None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:17.438384 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f3159548-5396-4691-ba5a-2a64c56d9afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:17.486380 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c38b8-f9aa-42ce-9e5a-a1484f52be0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:17.488283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c38b8-f9aa-42ce-9e5a-a1484f52be0a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:17.488917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c38b8-f9aa-42ce-9e5a-a1484f52be0a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:17.489025 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:17.494492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c38b8-f9aa-42ce-9e5a-a1484f52be0a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:17.520487 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c38b8-f9aa-42ce-9e5a-a1484f52be0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:17.529668 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-761c38b8-f9aa-42ce-9e5a-a1484f52be0a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:43:17.529668 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:17.529668 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:17.529668 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:17.529668 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:17.529668 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:17.529668 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:17.529668 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:17.529668 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:17.529668 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:17.529668 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:17.529668 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:17.529668 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:17.529668 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:17.529668 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:17.529668 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:17.530605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:17.530605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:17.530605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:17.530605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:17.530605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:17.530605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:17.530605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:17.530605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:17.530605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:17.530605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:17.530605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:17.530605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:17.530605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:17.530605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:17.530605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:17.530605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:17.531435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:17.531435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:17.531435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:17.531435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:17.531435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:17.531435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:17.531435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:17.531435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:17.531435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:17.531435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:17.531435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:43:17.531435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:17.536530 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 201/391] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:43:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:17.543030 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c38b8-f9aa-42ce-9e5a-a1484f52be0a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:17.557715 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 191/392] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:43:17.561096 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:17.587065 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3159548-5396-4691-ba5a-2a64c56d9afa None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:17.691212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c38b8-f9aa-42ce-9e5a-a1484f52be0a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:17.730477 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566234d-af40-41e9-a3d7-c9d24952c521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:17.731662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566234d-af40-41e9-a3d7-c9d24952c521 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:17.732342 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566234d-af40-41e9-a3d7-c9d24952c521 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:17.732884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566234d-af40-41e9-a3d7-c9d24952c521 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:17.733786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566234d-af40-41e9-a3d7-c9d24952c521 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:17.734542 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566234d-af40-41e9-a3d7-c9d24952c521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:17.736654 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566234d-af40-41e9-a3d7-c9d24952c521 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:17.747772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 202/393] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:17.753178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566234d-af40-41e9-a3d7-c9d24952c521 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:17.772234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3159548-5396-4691-ba5a-2a64c56d9afa None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:17.848284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:17.873964 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566234d-af40-41e9-a3d7-c9d24952c521 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:17.894467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9264dd4-2134-415e-8712-deff6a01311a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:17.895143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9264dd4-2134-415e-8712-deff6a01311a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:17.895424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9264dd4-2134-415e-8712-deff6a01311a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:17.895696 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9264dd4-2134-415e-8712-deff6a01311a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:17.910349 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9264dd4-2134-415e-8712-deff6a01311a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:17.916335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c9264dd4-2134-415e-8712-deff6a01311a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:43:17.916335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:17.916335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:17.916335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:17.916335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:17.916335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:17.916335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:17.916335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:17.916335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:17.916335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:17.916335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:17.916335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:17.916335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:17.916335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:17.916335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:17.916335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:17.917206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:17.917206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:17.917206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:17.917206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:17.917206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:17.917206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:17.917206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:17.917206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:17.917206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:17.917206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:17.917206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:17.917206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:17.917206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:17.917206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:17.917206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:17.917206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:17.917959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:17.917959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:17.917959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:17.917959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:17.917959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:17.917959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:17.917959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:17.917959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:17.917959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:17.917959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:17.917959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:43:17.917959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:17.918543 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8ab44-5c99-42b5-b205-a7d4e39d27aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:17.918543 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8ab44-5c99-42b5-b205-a7d4e39d27aa None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:17.918752 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 192/394] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:43:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:43:17.918863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8ab44-5c99-42b5-b205-a7d4e39d27aa None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:17.918863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8ab44-5c99-42b5-b205-a7d4e39d27aa None admin] PATH_INFO: `/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:17.919080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdad4c-6542-4d4a-9377-c04f058f3150 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:17.924062 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdad4c-6542-4d4a-9377-c04f058f3150 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:17.924062 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdad4c-6542-4d4a-9377-c04f058f3150 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:17.924255 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8ab44-5c99-42b5-b205-a7d4e39d27aa None admin] RBAC: Authorizing `identity:get_group(group_id=5cfe934d1d4848ff8b094c3dfa5f88e7)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:17.924349 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 193/395] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:17.924419 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8ab44-5c99-42b5-b205-a7d4e39d27aa None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:17.924693 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 203/396] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Aug 11 10:43:17 2022] GET /identity/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:17.927784 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdad4c-6542-4d4a-9377-c04f058f3150 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:17.932267 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0052a9-20b6-41c4-9763-d6abac54a8c3 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:17.932608 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0052a9-20b6-41c4-9763-d6abac54a8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:17.932953 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0052a9-20b6-41c4-9763-d6abac54a8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:17.954161 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-2a0052a9-20b6-41c4-9763-d6abac54a8c3 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:17.955865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2a0052a9-20b6-41c4-9763-d6abac54a8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:17.966220 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:18.050884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 204/397] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 11 10:43:18.050884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0052a9-20b6-41c4-9763-d6abac54a8c3 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:18.080552 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdad4c-6542-4d4a-9377-c04f058f3150 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:18.118800 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fde92-4ae5-40cb-91a5-22af3325eb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:18.119729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fde92-4ae5-40cb-91a5-22af3325eb69 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:18.120211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fde92-4ae5-40cb-91a5-22af3325eb69 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:18.120632 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fde92-4ae5-40cb-91a5-22af3325eb69 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:18.121508 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fde92-4ae5-40cb-91a5-22af3325eb69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:18.122067 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fde92-4ae5-40cb-91a5-22af3325eb69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:18.123676 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fde92-4ae5-40cb-91a5-22af3325eb69 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:18.128539 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:18.135089 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 194/398] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:18.136451 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fde92-4ae5-40cb-91a5-22af3325eb69 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:18.176081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0052a9-20b6-41c4-9763-d6abac54a8c3 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:18.215473 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795b2e4-edbc-4a48-90fc-b63b735f8c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:18.216459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795b2e4-edbc-4a48-90fc-b63b735f8c14 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:18.216746 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795b2e4-edbc-4a48-90fc-b63b735f8c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:18.217021 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795b2e4-edbc-4a48-90fc-b63b735f8c14 None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:18.218191 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795b2e4-edbc-4a48-90fc-b63b735f8c14 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:18.219701 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795b2e4-edbc-4a48-90fc-b63b735f8c14 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:18.221398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 205/399] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:43:18 2022] GET /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:18.222222 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795b2e4-edbc-4a48-90fc-b63b735f8c14 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:18.255734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:18.263442 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fde92-4ae5-40cb-91a5-22af3325eb69 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:18.305195 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973c33d-c889-47d4-95a1-e8c9ddd01105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:18.306329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973c33d-c889-47d4-95a1-e8c9ddd01105 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:18.306618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973c33d-c889-47d4-95a1-e8c9ddd01105 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:18.307071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973c33d-c889-47d4-95a1-e8c9ddd01105 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:18.319368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973c33d-c889-47d4-95a1-e8c9ddd01105 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:18.324086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f973c33d-c889-47d4-95a1-e8c9ddd01105 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:43:18.324086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:18.324086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:18.324086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:18.324086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:18.324086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:18.324086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:18.324086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:18.324086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:18.324086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:18.324086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:18.324086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:18.324086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:18.324086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:18.324086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:18.324086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:18.325051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:18.325051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:18.325051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:18.325051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:18.325051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:18.325051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:18.325051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:18.325051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:18.325051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:18.325051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:18.325051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:18.325051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:18.325051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:18.325051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:18.325051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:18.325051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:18.325807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:18.325807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:18.325807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:18.325807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:18.325807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:18.325807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:18.325807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:18.325807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:18.325807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:18.325807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:18.325807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:43:18.325807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:18.325807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 195/400] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:18.327282 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4b246-2620-4aea-9293-f68180f1f0aa None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:18.327282 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4b246-2620-4aea-9293-f68180f1f0aa None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:18.327282 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4b246-2620-4aea-9293-f68180f1f0aa None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:18.330876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 196/401] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:18.330876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4b246-2620-4aea-9293-f68180f1f0aa None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:18.345714 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795b2e4-edbc-4a48-90fc-b63b735f8c14 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:18.382647 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c62444-d03b-4580-bae6-db14b101e5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:18.383246 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c62444-d03b-4580-bae6-db14b101e5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:18.383511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c62444-d03b-4580-bae6-db14b101e5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:18.383786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c62444-d03b-4580-bae6-db14b101e5c6 None admin] PATH_INFO: `/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:18.384976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c62444-d03b-4580-bae6-db14b101e5c6 None admin] RBAC: Authorizing `identity:get_group(group_id=5cfe934d1d4848ff8b094c3dfa5f88e7)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:18.386881 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c62444-d03b-4580-bae6-db14b101e5c6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:18.393302 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 206/402] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Aug 11 10:43:18 2022] GET /identity/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:18.393302 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c62444-d03b-4580-bae6-db14b101e5c6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:18.395926 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:18.440388 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4b246-2620-4aea-9293-f68180f1f0aa None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:18.476837 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2c645-fd57-4199-9a6d-0275759daaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:18.477495 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2c645-fd57-4199-9a6d-0275759daaaf None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:18.477775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2c645-fd57-4199-9a6d-0275759daaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:18.478277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2c645-fd57-4199-9a6d-0275759daaaf None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6/groups/5cfe934d1d4848ff8b094c3dfa5f88e7/roles/e9cc929c9958498d8ce27ca88f685549` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:18.480209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2c645-fd57-4199-9a6d-0275759daaaf None admin] RBAC: Authorizing `identity:create_grant(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6, group_id=5cfe934d1d4848ff8b094c3dfa5f88e7, role_id=e9cc929c9958498d8ce27ca88f685549)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:18.482064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2c645-fd57-4199-9a6d-0275759daaaf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:18.497236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c62444-d03b-4580-bae6-db14b101e5c6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:18.530377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1464a-e11c-4862-8d7c-cfde0649cb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:18.531010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1464a-e11c-4862-8d7c-cfde0649cb1a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:18.531341 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1464a-e11c-4862-8d7c-cfde0649cb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:18.531616 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1464a-e11c-4862-8d7c-cfde0649cb1a None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:18.532278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1464a-e11c-4862-8d7c-cfde0649cb1a None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:18.532599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1464a-e11c-4862-8d7c-cfde0649cb1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:18.533961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1464a-e11c-4862-8d7c-cfde0649cb1a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:18.541715 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 207/403] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:43:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:18.542935 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f91094-ecf6-4796-be0d-d634a143e5c9 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:18.543195 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f91094-ecf6-4796-be0d-d634a143e5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:18.548521 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f91094-ecf6-4796-be0d-d634a143e5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:18.554533 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 197/404] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Aug 11 10:43:18 2022] PUT /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6/groups/5cfe934d1d4848ff8b094c3dfa5f88e7/roles/e9cc929c9958498d8ce27ca88f685549 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:43:18.555453 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2c645-fd57-4199-9a6d-0275759daaaf None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:18.569339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-56f91094-ecf6-4796-be0d-d634a143e5c9 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:18.570852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-56f91094-ecf6-4796-be0d-d634a143e5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:18.581877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:18.646875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:18.657286 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 208/405] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:18.658680 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f91094-ecf6-4796-be0d-d634a143e5c9 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:18.697728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2c645-fd57-4199-9a6d-0275759daaaf None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:18.741018 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02a00b-f258-4f9e-a3f8-9d35f45ff1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:18.741929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02a00b-f258-4f9e-a3f8-9d35f45ff1ac None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:18.742360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02a00b-f258-4f9e-a3f8-9d35f45ff1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:18.743621 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02a00b-f258-4f9e-a3f8-9d35f45ff1ac None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:18.745519 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02a00b-f258-4f9e-a3f8-9d35f45ff1ac None admin] RBAC: Authorizing `identity:get_project(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:18.747800 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02a00b-f258-4f9e-a3f8-9d35f45ff1ac None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:18.749865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 198/406] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:43:18 2022] GET /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:18.750647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02a00b-f258-4f9e-a3f8-9d35f45ff1ac None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:18.789209 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f91094-ecf6-4796-be0d-d634a143e5c9 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:18.839955 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537be4c-7647-432c-8bfb-c95f31a0cc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:18.841202 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537be4c-7647-432c-8bfb-c95f31a0cc96 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:18.841662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537be4c-7647-432c-8bfb-c95f31a0cc96 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:18.842111 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537be4c-7647-432c-8bfb-c95f31a0cc96 None admin] PATH_INFO: `/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:18.843637 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:18.843981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537be4c-7647-432c-8bfb-c95f31a0cc96 None admin] RBAC: Authorizing `identity:get_group(group_id=5cfe934d1d4848ff8b094c3dfa5f88e7)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:18.846388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2537be4c-7647-432c-8bfb-c95f31a0cc96 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:18.848997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 209/407] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Aug 11 10:43:18 2022] GET /identity/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:18.854800 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537be4c-7647-432c-8bfb-c95f31a0cc96 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:18.868104 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02a00b-f258-4f9e-a3f8-9d35f45ff1ac None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:18.907155 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88eae9f-eca7-46c1-8287-b530826349e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:18.907716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88eae9f-eca7-46c1-8287-b530826349e7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:18.908002 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88eae9f-eca7-46c1-8287-b530826349e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:18.908279 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88eae9f-eca7-46c1-8287-b530826349e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:18.920143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88eae9f-eca7-46c1-8287-b530826349e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:18.925321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f88eae9f-eca7-46c1-8287-b530826349e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:43:18.925321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:18.925321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:18.925321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:18.925321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:18.925321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:18.925321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:18.925321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:18.925321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:18.925321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:18.925321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:18.925321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:18.925321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:18.925321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:18.925321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:18.925321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:18.926177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:18.926177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:18.926177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:18.926177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:18.926177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:18.926177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:18.926177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:18.926177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:18.926177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:18.926177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:18.926177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:18.926177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:18.926177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:18.926177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:18.926177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:18.926177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:18.927066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:18.927066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:18.927066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:18.927066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:18.927066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:18.927066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:18.927066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:18.927066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:18.927066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:18.927066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:18.927066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:43:18.927066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:18.928393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 199/408] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:43:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:18.929217 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88eae9f-eca7-46c1-8287-b530826349e7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:18.942847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:18.986226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537be4c-7647-432c-8bfb-c95f31a0cc96 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:19.025208 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c81746-fe4b-4009-b573-fd543228deba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:19.026247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c81746-fe4b-4009-b573-fd543228deba None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:19.026726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c81746-fe4b-4009-b573-fd543228deba None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:19.027242 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c81746-fe4b-4009-b573-fd543228deba None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c/groups/5cfe934d1d4848ff8b094c3dfa5f88e7/roles/e9cc929c9958498d8ce27ca88f685549` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:19.030125 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c81746-fe4b-4009-b573-fd543228deba None admin] RBAC: Authorizing `identity:create_grant(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c, group_id=5cfe934d1d4848ff8b094c3dfa5f88e7, role_id=e9cc929c9958498d8ce27ca88f685549)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:19.031847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c81746-fe4b-4009-b573-fd543228deba None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:19.056366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88eae9f-eca7-46c1-8287-b530826349e7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:19.095754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d20ea3-6d54-45f3-8101-ec7986f1de97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:19.096394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d20ea3-6d54-45f3-8101-ec7986f1de97 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:19.096679 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d20ea3-6d54-45f3-8101-ec7986f1de97 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:19.096950 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d20ea3-6d54-45f3-8101-ec7986f1de97 None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:19.098082 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d20ea3-6d54-45f3-8101-ec7986f1de97 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:19.099545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d20ea3-6d54-45f3-8101-ec7986f1de97 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:19.106035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 200/409] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:43:18 2022] GET /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:19.106035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d20ea3-6d54-45f3-8101-ec7986f1de97 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:19.120006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:19.126552 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 210/410] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Aug 11 10:43:18 2022] PUT /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c/groups/5cfe934d1d4848ff8b094c3dfa5f88e7/roles/e9cc929c9958498d8ce27ca88f685549 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:43:19.128694 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c81746-fe4b-4009-b573-fd543228deba None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:19.253533 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d20ea3-6d54-45f3-8101-ec7986f1de97 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:19.253901 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c81746-fe4b-4009-b573-fd543228deba None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:19.280671 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:19.293305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa749b-4ce9-4f8a-a3a0-931eb044261e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:19.293896 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd7f7b-139f-4e63-a190-40fd898b3e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:19.294242 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa749b-4ce9-4f8a-a3a0-931eb044261e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:19.294356 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa749b-4ce9-4f8a-a3a0-931eb044261e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:19.294613 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd7f7b-139f-4e63-a190-40fd898b3e73 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:19.294711 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa749b-4ce9-4f8a-a3a0-931eb044261e None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:19.294821 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd7f7b-139f-4e63-a190-40fd898b3e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:19.295871 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd7f7b-139f-4e63-a190-40fd898b3e73 None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c/groups/5cfe934d1d4848ff8b094c3dfa5f88e7/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:19.295993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa749b-4ce9-4f8a-a3a0-931eb044261e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:19.295993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa749b-4ce9-4f8a-a3a0-931eb044261e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:19.297009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa749b-4ce9-4f8a-a3a0-931eb044261e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:19.297118 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd7f7b-139f-4e63-a190-40fd898b3e73 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c, group_id=5cfe934d1d4848ff8b094c3dfa5f88e7, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:19.298661 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd7f7b-139f-4e63-a190-40fd898b3e73 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:19.306164 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 201/411] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:19.308075 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811badb6-ad3d-4b09-8d08-218c62f9278c None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:19.308482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811badb6-ad3d-4b09-8d08-218c62f9278c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:19.308858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811badb6-ad3d-4b09-8d08-218c62f9278c None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:19.311396 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 202/412] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:19.314520 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811badb6-ad3d-4b09-8d08-218c62f9278c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:19.371434 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 211/413] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Aug 11 10:43:19 2022] PUT /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c/groups/5cfe934d1d4848ff8b094c3dfa5f88e7/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:43:19.373123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063414b-0053-45b5-9146-7bf3c8bab32e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:19.373579 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063414b-0053-45b5-9146-7bf3c8bab32e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:19.373992 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063414b-0053-45b5-9146-7bf3c8bab32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:19.405657 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d063414b-0053-45b5-9146-7bf3c8bab32e None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:19.409662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d063414b-0053-45b5-9146-7bf3c8bab32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:19.433607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:19.486854 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811badb6-ad3d-4b09-8d08-218c62f9278c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:19.533031 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320beb9e-9171-4035-908d-2eebb9eec5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:19.533787 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320beb9e-9171-4035-908d-2eebb9eec5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:19.534623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320beb9e-9171-4035-908d-2eebb9eec5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:19.535016 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320beb9e-9171-4035-908d-2eebb9eec5d9 None admin] PATH_INFO: `/v3/groups/8b7a82cab6ee4cd1879e7d1b2056e58b` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:19.536372 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320beb9e-9171-4035-908d-2eebb9eec5d9 None admin] RBAC: Authorizing `identity:get_group(group_id=8b7a82cab6ee4cd1879e7d1b2056e58b)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:19.538043 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320beb9e-9171-4035-908d-2eebb9eec5d9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:19.540316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 203/414] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Aug 11 10:43:19 2022] GET /identity/v3/groups/8b7a82cab6ee4cd1879e7d1b2056e58b => generated 229 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:19.546598 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320beb9e-9171-4035-908d-2eebb9eec5d9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:19.564546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 212/415] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:19.599194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063414b-0053-45b5-9146-7bf3c8bab32e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:19.667665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320beb9e-9171-4035-908d-2eebb9eec5d9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:19.708098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e21f5b-bc45-4e3d-b6e3-9fc2ed756319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:19.708841 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e21f5b-bc45-4e3d-b6e3-9fc2ed756319 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:19.709124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e21f5b-bc45-4e3d-b6e3-9fc2ed756319 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:19.709399 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e21f5b-bc45-4e3d-b6e3-9fc2ed756319 None admin] PATH_INFO: `/v3/projects/d6947801fa7c4cca9da48801b7ffc014` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:19.710786 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e21f5b-bc45-4e3d-b6e3-9fc2ed756319 None admin] RBAC: Authorizing `identity:get_project(project_id=d6947801fa7c4cca9da48801b7ffc014)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:19.712299 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e21f5b-bc45-4e3d-b6e3-9fc2ed756319 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:19.714372 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 204/416] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:43:19 2022] GET /identity/v3/projects/d6947801fa7c4cca9da48801b7ffc014 => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:19.721067 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e21f5b-bc45-4e3d-b6e3-9fc2ed756319 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:19.743795 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063414b-0053-45b5-9146-7bf3c8bab32e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:19.747863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:19.763836 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:19.787779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53861f6a-832f-41e8-b86b-8ddae35f627c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:19.788630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53861f6a-832f-41e8-b86b-8ddae35f627c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:19.789126 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53861f6a-832f-41e8-b86b-8ddae35f627c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:19.789538 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53861f6a-832f-41e8-b86b-8ddae35f627c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:19.802140 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53861f6a-832f-41e8-b86b-8ddae35f627c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:19.807797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-53861f6a-832f-41e8-b86b-8ddae35f627c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:43:19.807797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:19.807797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:19.807797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:19.807797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:19.807797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:19.807797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:19.807797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:19.807797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:19.807797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:19.807797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:19.807797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:19.807797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:19.807797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:19.807797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:19.807797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:19.808865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:19.808865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:19.808865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:19.808865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:19.808865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:19.808865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:19.808865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:19.808865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:19.808865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:19.808865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:19.808865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:19.808865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:19.808865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:19.808865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:19.808865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:19.808865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:19.810102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:19.810102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:19.810102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:19.810102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:19.810102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:19.810102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:19.810102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:19.810102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:19.810102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:19.810102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:19.810102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:43:19.810102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:19.812976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 213/417] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:19.819411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53861f6a-832f-41e8-b86b-8ddae35f627c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:19.957028 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53861f6a-832f-41e8-b86b-8ddae35f627c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:19.963439 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e21f5b-bc45-4e3d-b6e3-9fc2ed756319 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:19.995662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e576618-1591-4eac-8acf-dc31704fd2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:19.997840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e576618-1591-4eac-8acf-dc31704fd2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:19.998400 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e576618-1591-4eac-8acf-dc31704fd2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:19.999642 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e576618-1591-4eac-8acf-dc31704fd2e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:20.000463 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e576618-1591-4eac-8acf-dc31704fd2e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:20.001069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e576618-1591-4eac-8acf-dc31704fd2e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:20.003689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e576618-1591-4eac-8acf-dc31704fd2e3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:20.016529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 214/418] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:43:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:20.025076 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e576618-1591-4eac-8acf-dc31704fd2e3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:20.052634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774c05a-371a-49d6-a49c-59e214c91def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:20.053565 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774c05a-371a-49d6-a49c-59e214c91def None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:20.053992 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774c05a-371a-49d6-a49c-59e214c91def None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:20.054434 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774c05a-371a-49d6-a49c-59e214c91def None admin] PATH_INFO: `/v3/projects/d6947801fa7c4cca9da48801b7ffc014/groups/8b7a82cab6ee4cd1879e7d1b2056e58b/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:20.058940 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774c05a-371a-49d6-a49c-59e214c91def None admin] RBAC: Authorizing `identity:create_grant(project_id=d6947801fa7c4cca9da48801b7ffc014, group_id=8b7a82cab6ee4cd1879e7d1b2056e58b, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:20.061079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774c05a-371a-49d6-a49c-59e214c91def None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:20.080300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:20.149078 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 205/419] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Aug 11 10:43:19 2022] PUT /identity/v3/projects/d6947801fa7c4cca9da48801b7ffc014/groups/8b7a82cab6ee4cd1879e7d1b2056e58b/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:43:20.154186 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e576618-1591-4eac-8acf-dc31704fd2e3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:20.190104 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c4edd-6209-4b32-90e4-6c9e4943e955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:20.190785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c4edd-6209-4b32-90e4-6c9e4943e955 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:20.191065 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c4edd-6209-4b32-90e4-6c9e4943e955 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:20.191373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c4edd-6209-4b32-90e4-6c9e4943e955 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:20.296529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c4edd-6209-4b32-90e4-6c9e4943e955 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:20.298385 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c4edd-6209-4b32-90e4-6c9e4943e955 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:20.339350 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:20.421558 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 215/420] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:43:20.427053 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774c05a-371a-49d6-a49c-59e214c91def None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:20.500755 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:20.536613 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774c05a-371a-49d6-a49c-59e214c91def None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:20.572846 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56197e-5a80-4bf2-a26a-c18092b05cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:20.573497 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56197e-5a80-4bf2-a26a-c18092b05cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:20.573782 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56197e-5a80-4bf2-a26a-c18092b05cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:20.574057 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56197e-5a80-4bf2-a26a-c18092b05cf2 None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:20.575825 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56197e-5a80-4bf2-a26a-c18092b05cf2 None admin] RBAC: Authorizing `identity:get_project(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:20.577464 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56197e-5a80-4bf2-a26a-c18092b05cf2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:20.579567 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 206/421] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:43:20 2022] GET /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:20.587838 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c4edd-6209-4b32-90e4-6c9e4943e955 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:20.721167 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c4edd-6209-4b32-90e4-6c9e4943e955 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:20.761445 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90db28-6661-4ba6-b278-aadf974d1a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:20.762146 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90db28-6661-4ba6-b278-aadf974d1a6f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:20.763153 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90db28-6661-4ba6-b278-aadf974d1a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:20.763596 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90db28-6661-4ba6-b278-aadf974d1a6f None admin] PATH_INFO: `/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:20.764783 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90db28-6661-4ba6-b278-aadf974d1a6f None admin] RBAC: Authorizing `identity:get_group(group_id=5cfe934d1d4848ff8b094c3dfa5f88e7)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:20.766336 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90db28-6661-4ba6-b278-aadf974d1a6f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:20.767972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 216/422] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Aug 11 10:43:20 2022] GET /identity/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:20.775397 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56197e-5a80-4bf2-a26a-c18092b05cf2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:20.889346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56197e-5a80-4bf2-a26a-c18092b05cf2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:20.924722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34811d1-25b7-46ca-a9fb-9a9feb4f763a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:20.925352 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34811d1-25b7-46ca-a9fb-9a9feb4f763a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:20.925707 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34811d1-25b7-46ca-a9fb-9a9feb4f763a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:20.925983 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34811d1-25b7-46ca-a9fb-9a9feb4f763a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:20.926729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34811d1-25b7-46ca-a9fb-9a9feb4f763a None admin] RBAC: Adding query filter params (group.id=5cfe934d1d4848ff8b094c3dfa5f88e7, role.id=ea851d0cf29e44a1884d7c23431a7481, scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:20.927068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34811d1-25b7-46ca-a9fb-9a9feb4f763a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:20.928554 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34811d1-25b7-46ca-a9fb-9a9feb4f763a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:20.936737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 207/423] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Aug 11 10:43:20 2022] GET /identity/v3/role_assignments?group.id=5cfe934d1d4848ff8b094c3dfa5f88e7&scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6&role.id=ea851d0cf29e44a1884d7c23431a7481 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:20.939170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:20.999813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dcd64-4d76-4905-9fb5-88d1e1f4803d None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:20.999986 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dcd64-4d76-4905-9fb5-88d1e1f4803d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:21.000269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dcd64-4d76-4905-9fb5-88d1e1f4803d None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:21.001597 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 217/424] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:21.007336 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb966f6d-62a0-4465-bca6-f057a606ef1a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:21.007616 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb966f6d-62a0-4465-bca6-f057a606ef1a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:21.007890 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb966f6d-62a0-4465-bca6-f057a606ef1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:21.037793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-bb966f6d-62a0-4465-bca6-f057a606ef1a None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:21.039028 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bb966f6d-62a0-4465-bca6-f057a606ef1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:21.136432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 208/425] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:21.158832 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9dcd64-4d76-4905-9fb5-88d1e1f4803d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:21.162138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:21.282434 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9dcd64-4d76-4905-9fb5-88d1e1f4803d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:21.320186 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d2478-8c27-45ac-8143-aad06e54d74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:21.320834 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d2478-8c27-45ac-8143-aad06e54d74f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:21.321112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d2478-8c27-45ac-8143-aad06e54d74f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:21.321384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d2478-8c27-45ac-8143-aad06e54d74f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:21.335070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d2478-8c27-45ac-8143-aad06e54d74f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:21.342406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e69d2478-8c27-45ac-8143-aad06e54d74f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:43:21.342406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:21.342406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:21.342406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:21.342406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:21.342406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:21.342406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:21.342406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:21.342406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:21.342406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:21.342406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:21.342406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:21.342406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:21.342406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:21.342406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:21.342406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:21.343333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:21.343333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:21.343333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:21.343333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:21.343333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:21.343333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:21.343333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:21.343333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:21.343333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:21.343333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:21.343333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:21.343333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:21.343333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:21.343333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:21.343333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:21.343333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:21.344107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:21.344107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:21.344107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:21.344107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:21.344107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:21.344107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:21.344107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:21.344107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:21.344107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:21.344107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:21.344107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:43:21.344107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:21.344107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 218/426] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:43:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:21.351869 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb966f6d-62a0-4465-bca6-f057a606ef1a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:21.440793 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edaacc1-14a2-443d-9f62-0fe02e121101 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:21.440793 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edaacc1-14a2-443d-9f62-0fe02e121101 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:21.441069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edaacc1-14a2-443d-9f62-0fe02e121101 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:21.442590 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 219/427] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:21.447745 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c628a68-7a97-4192-9dee-b8faafe8dce1 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:21.448173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c628a68-7a97-4192-9dee-b8faafe8dce1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:21.448462 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c628a68-7a97-4192-9dee-b8faafe8dce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:21.476056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0c628a68-7a97-4192-9dee-b8faafe8dce1 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:21.477260 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0c628a68-7a97-4192-9dee-b8faafe8dce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:21.479092 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb966f6d-62a0-4465-bca6-f057a606ef1a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:21.515479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:21.520232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6ca53-9d9e-458c-bcd8-2162f0c59849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:21.520949 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6ca53-9d9e-458c-bcd8-2162f0c59849 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:21.521302 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6ca53-9d9e-458c-bcd8-2162f0c59849 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:21.521649 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6ca53-9d9e-458c-bcd8-2162f0c59849 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:21.522396 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6ca53-9d9e-458c-bcd8-2162f0c59849 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:21.522783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6ca53-9d9e-458c-bcd8-2162f0c59849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:21.524238 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6ca53-9d9e-458c-bcd8-2162f0c59849 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:21.535188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 209/428] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:21.543459 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6ca53-9d9e-458c-bcd8-2162f0c59849 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:21.549308 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:21.561652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 220/429] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:43:21.599189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c628a68-7a97-4192-9dee-b8faafe8dce1 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:21.673209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6ca53-9d9e-458c-bcd8-2162f0c59849 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:21.712785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635eafe3-b00e-47fe-8606-a45b4eb61b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:21.713404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635eafe3-b00e-47fe-8606-a45b4eb61b16 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:21.713689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635eafe3-b00e-47fe-8606-a45b4eb61b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:21.713968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635eafe3-b00e-47fe-8606-a45b4eb61b16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:21.716024 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c628a68-7a97-4192-9dee-b8faafe8dce1 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:21.756233 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d91308-fc61-4fa1-ace7-2ec014204c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:21.757566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d91308-fc61-4fa1-ace7-2ec014204c2c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:21.757566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d91308-fc61-4fa1-ace7-2ec014204c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:21.758060 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d91308-fc61-4fa1-ace7-2ec014204c2c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:21.771315 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d91308-fc61-4fa1-ace7-2ec014204c2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:21.776782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-17d91308-fc61-4fa1-ace7-2ec014204c2c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:43:21.776782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:21.776782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:21.776782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:21.776782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:21.776782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:21.776782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:21.776782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:21.776782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:21.776782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:21.776782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:21.776782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:21.776782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:21.776782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:21.776782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:21.776782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:21.777705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:21.777705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:21.777705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:21.777705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:21.777705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:21.777705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:21.777705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:21.777705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:21.777705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:21.777705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:21.777705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:21.777705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:21.777705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:21.777705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:21.777705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:21.777705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:21.779066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:21.779066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:21.779066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:21.779066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:21.779066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:21.779066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:21.779066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:21.779066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:21.779066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:21.779066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:21.779066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:43:21.779066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:21.782265 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 221/430] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:43:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:43:21.783148 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:21.795893 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d91308-fc61-4fa1-ace7-2ec014204c2c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:21.799610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635eafe3-b00e-47fe-8606-a45b4eb61b16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:21.801427 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635eafe3-b00e-47fe-8606-a45b4eb61b16 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:21.858145 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:21.908832 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d91308-fc61-4fa1-ace7-2ec014204c2c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:21.909200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 210/431] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 10:43:21.914712 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635eafe3-b00e-47fe-8606-a45b4eb61b16 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:21.946397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795e9f0-d97d-4d48-8cfb-25ab5d5c1945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:21.947273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795e9f0-d97d-4d48-8cfb-25ab5d5c1945 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:21.947716 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795e9f0-d97d-4d48-8cfb-25ab5d5c1945 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:21.948242 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795e9f0-d97d-4d48-8cfb-25ab5d5c1945 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:21.949182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795e9f0-d97d-4d48-8cfb-25ab5d5c1945 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:21.949621 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795e9f0-d97d-4d48-8cfb-25ab5d5c1945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:21.951803 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795e9f0-d97d-4d48-8cfb-25ab5d5c1945 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:21.961877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 222/432] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:21.971433 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795e9f0-d97d-4d48-8cfb-25ab5d5c1945 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:22.020378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:22.030032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635eafe3-b00e-47fe-8606-a45b4eb61b16 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:22.067719 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fededf-0aad-479b-a108-6806ba4311ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:22.068276 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fededf-0aad-479b-a108-6806ba4311ba None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:22.068706 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fededf-0aad-479b-a108-6806ba4311ba None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:22.068894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fededf-0aad-479b-a108-6806ba4311ba None admin] PATH_INFO: `/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:22.070042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fededf-0aad-479b-a108-6806ba4311ba None admin] RBAC: Authorizing `identity:get_project(project_id=cfdb75925ea24ff4bf7f29a1ed2b0ef6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:22.071534 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fededf-0aad-479b-a108-6806ba4311ba None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:22.078658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 211/433] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:43:21 2022] GET /identity/v3/projects/cfdb75925ea24ff4bf7f29a1ed2b0ef6 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:22.079776 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64226dfc-b953-4421-ad90-d8cfd5e88d1d None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:22.080068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64226dfc-b953-4421-ad90-d8cfd5e88d1d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:22.080349 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64226dfc-b953-4421-ad90-d8cfd5e88d1d None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:22.081566 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 212/434] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:22.082266 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64226dfc-b953-4421-ad90-d8cfd5e88d1d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:22.094937 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795e9f0-d97d-4d48-8cfb-25ab5d5c1945 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:22.110087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:22.132026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04ed49-443c-477e-ae70-8f68dc9e693b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:22.133084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04ed49-443c-477e-ae70-8f68dc9e693b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:22.133839 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04ed49-443c-477e-ae70-8f68dc9e693b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:22.134482 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04ed49-443c-477e-ae70-8f68dc9e693b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:22.191307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64226dfc-b953-4421-ad90-d8cfd5e88d1d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:22.204967 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04ed49-443c-477e-ae70-8f68dc9e693b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:22.206478 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04ed49-443c-477e-ae70-8f68dc9e693b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:22.230473 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a2be5-e2bc-489b-9f4d-baf2a2f036e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:22.231195 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a2be5-e2bc-489b-9f4d-baf2a2f036e4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:22.231694 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a2be5-e2bc-489b-9f4d-baf2a2f036e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:22.232109 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a2be5-e2bc-489b-9f4d-baf2a2f036e4 None admin] PATH_INFO: `/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:22.233238 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a2be5-e2bc-489b-9f4d-baf2a2f036e4 None admin] RBAC: Authorizing `identity:get_group(group_id=5cfe934d1d4848ff8b094c3dfa5f88e7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:22.234955 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a2be5-e2bc-489b-9f4d-baf2a2f036e4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:22.241531 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 213/435] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Aug 11 10:43:22 2022] GET /identity/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:22.242745 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a55f9-8b7b-4d7c-b4f9-bb20e7c0cfd8 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:22.243052 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a55f9-8b7b-4d7c-b4f9-bb20e7c0cfd8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:22.243329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a55f9-8b7b-4d7c-b4f9-bb20e7c0cfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:22.261937 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-fc3a55f9-8b7b-4d7c-b4f9-bb20e7c0cfd8 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:22.263422 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fc3a55f9-8b7b-4d7c-b4f9-bb20e7c0cfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:22.287402 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:22.313436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 223/436] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 10:43:22.314276 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04ed49-443c-477e-ae70-8f68dc9e693b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:22.332152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:22.340811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 214/437] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:22.341880 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a55f9-8b7b-4d7c-b4f9-bb20e7c0cfd8 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:22.427504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04ed49-443c-477e-ae70-8f68dc9e693b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:22.460820 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a55f9-8b7b-4d7c-b4f9-bb20e7c0cfd8 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:22.461802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70915d2f-bdf2-4035-8ee4-db0dfa600dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:22.462412 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70915d2f-bdf2-4035-8ee4-db0dfa600dac None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:22.462689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70915d2f-bdf2-4035-8ee4-db0dfa600dac None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:22.462987 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70915d2f-bdf2-4035-8ee4-db0dfa600dac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:22.463702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70915d2f-bdf2-4035-8ee4-db0dfa600dac None admin] RBAC: Adding query filter params (group.id=5cfe934d1d4848ff8b094c3dfa5f88e7, role.id=e9cc929c9958498d8ce27ca88f685549, scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:22.464003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70915d2f-bdf2-4035-8ee4-db0dfa600dac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:22.465956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70915d2f-bdf2-4035-8ee4-db0dfa600dac None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:22.471661 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 224/438] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Aug 11 10:43:22 2022] GET /identity/v3/role_assignments?group.id=5cfe934d1d4848ff8b094c3dfa5f88e7&scope.project.id=cfdb75925ea24ff4bf7f29a1ed2b0ef6&role.id=e9cc929c9958498d8ce27ca88f685549 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:22.472450 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70915d2f-bdf2-4035-8ee4-db0dfa600dac None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:22.510995 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad1e58-f8a2-4054-8146-7a2d8e46bcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:22.513185 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad1e58-f8a2-4054-8146-7a2d8e46bcd4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:22.513650 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad1e58-f8a2-4054-8146-7a2d8e46bcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:22.514072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad1e58-f8a2-4054-8146-7a2d8e46bcd4 None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:22.515478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad1e58-f8a2-4054-8146-7a2d8e46bcd4 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:22.517327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad1e58-f8a2-4054-8146-7a2d8e46bcd4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:22.519151 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 215/439] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:43:22 2022] GET /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:22.524798 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad1e58-f8a2-4054-8146-7a2d8e46bcd4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:22.558200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:22.569308 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:22.597546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70915d2f-bdf2-4035-8ee4-db0dfa600dac None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:22.639945 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd419d00-1716-4228-bdc0-993a39ed2a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:22.640696 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd419d00-1716-4228-bdc0-993a39ed2a18 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:22.641051 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd419d00-1716-4228-bdc0-993a39ed2a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:22.641478 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd419d00-1716-4228-bdc0-993a39ed2a18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:22.651049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad1e58-f8a2-4054-8146-7a2d8e46bcd4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:22.654914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd419d00-1716-4228-bdc0-993a39ed2a18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:22.661086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-cd419d00-1716-4228-bdc0-993a39ed2a18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:43:22.661086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:22.661086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:22.661086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:22.661086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:22.661086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:22.661086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:22.661086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:22.661086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:22.661086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:22.661086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:22.661086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:22.661086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:22.661086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:22.661086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:22.661086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:22.661948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:22.661948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:22.661948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:22.661948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:22.661948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:22.661948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:22.661948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:22.661948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:22.661948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:22.661948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:22.661948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:22.661948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:22.661948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:22.661948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:22.661948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:22.661948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:22.662699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:22.662699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:22.662699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:22.662699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:22.662699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:22.662699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:22.662699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:22.662699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:22.662699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:22.662699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:22.662699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 11 10:43:22.662699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:22.666828 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 225/440] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:22.669598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd419d00-1716-4228-bdc0-993a39ed2a18 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:22.692658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14a7c2-ff13-462d-b795-00db337e1362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:22.693344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14a7c2-ff13-462d-b795-00db337e1362 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:22.693634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14a7c2-ff13-462d-b795-00db337e1362 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:22.693904 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14a7c2-ff13-462d-b795-00db337e1362 None admin] PATH_INFO: `/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:22.695447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14a7c2-ff13-462d-b795-00db337e1362 None admin] RBAC: Authorizing `identity:get_group(group_id=5cfe934d1d4848ff8b094c3dfa5f88e7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:22.696459 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d14a7c2-ff13-462d-b795-00db337e1362 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:22.698077 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 216/441] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Aug 11 10:43:22 2022] GET /identity/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:22.708147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14a7c2-ff13-462d-b795-00db337e1362 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:22.782484 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd419d00-1716-4228-bdc0-993a39ed2a18 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:22.823913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a8687-c676-4351-a87d-626dd5f8b939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:22.824112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:22.824215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a8687-c676-4351-a87d-626dd5f8b939 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:22.824215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a8687-c676-4351-a87d-626dd5f8b939 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:22.824215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a8687-c676-4351-a87d-626dd5f8b939 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:22.824215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a8687-c676-4351-a87d-626dd5f8b939 None admin] RBAC: Adding query filter params (name=member) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:22.824215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a8687-c676-4351-a87d-626dd5f8b939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:22.825827 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a8687-c676-4351-a87d-626dd5f8b939 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:22.830332 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14a7c2-ff13-462d-b795-00db337e1362 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:22.832213 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:22.836327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 226/442] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:43:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:22.837583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bf2e9-ba79-4ff4-98a9-c75b8a499d5c None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:22.838218 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bf2e9-ba79-4ff4-98a9-c75b8a499d5c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:22.838517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8bf2e9-ba79-4ff4-98a9-c75b8a499d5c None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:22.839900 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 227/443] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:22.844428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bf2e9-ba79-4ff4-98a9-c75b8a499d5c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:22.871624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93359bf3-57ca-4ff1-b30a-c80bc4a97560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:22.872457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93359bf3-57ca-4ff1-b30a-c80bc4a97560 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:22.872740 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93359bf3-57ca-4ff1-b30a-c80bc4a97560 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:22.873014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93359bf3-57ca-4ff1-b30a-c80bc4a97560 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:22.873733 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93359bf3-57ca-4ff1-b30a-c80bc4a97560 None admin] RBAC: Adding query filter params (group.id=5cfe934d1d4848ff8b094c3dfa5f88e7, role.id=e9cc929c9958498d8ce27ca88f685549, scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:22.874037 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93359bf3-57ca-4ff1-b30a-c80bc4a97560 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:22.875484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93359bf3-57ca-4ff1-b30a-c80bc4a97560 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:22.881946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 217/444] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Aug 11 10:43:22 2022] GET /identity/v3/role_assignments?group.id=5cfe934d1d4848ff8b094c3dfa5f88e7&scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c&role.id=e9cc929c9958498d8ce27ca88f685549 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:22.883323 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dd585-132b-4213-af4e-9ff2c98bdc67 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:22.883613 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dd585-132b-4213-af4e-9ff2c98bdc67 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:22.883888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dd585-132b-4213-af4e-9ff2c98bdc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:22.905748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5c8dd585-132b-4213-af4e-9ff2c98bdc67 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:22.907513 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5c8dd585-132b-4213-af4e-9ff2c98bdc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:22.978824 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8bf2e9-ba79-4ff4-98a9-c75b8a499d5c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:22.991532 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 218/445] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:23.016517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8dd585-132b-4213-af4e-9ff2c98bdc67 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:23.017529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7df6e4-a2eb-4e75-93a7-cf8e47c9ddef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:23.018150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7df6e4-a2eb-4e75-93a7-cf8e47c9ddef None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:23.018568 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7df6e4-a2eb-4e75-93a7-cf8e47c9ddef None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:23.018882 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7df6e4-a2eb-4e75-93a7-cf8e47c9ddef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:23.096050 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:23.098436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7df6e4-a2eb-4e75-93a7-cf8e47c9ddef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:23.100294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7df6e4-a2eb-4e75-93a7-cf8e47c9ddef None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:23.124712 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:23.136107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8dd585-132b-4213-af4e-9ff2c98bdc67 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:23.171170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab64b0-4586-4aa3-aed3-71d3978ead2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:23.171796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab64b0-4586-4aa3-aed3-71d3978ead2b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:23.172074 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab64b0-4586-4aa3-aed3-71d3978ead2b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:23.172345 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab64b0-4586-4aa3-aed3-71d3978ead2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:23.182293 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab64b0-4586-4aa3-aed3-71d3978ead2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:23.187156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b7ab64b0-4586-4aa3-aed3-71d3978ead2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:43:23.187156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:23.187156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:23.187156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:23.187156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:23.187156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:23.187156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:23.187156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:23.187156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:23.187156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:23.187156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:23.187156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:23.187156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:23.187156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:23.187156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:23.187156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:23.188181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:23.188181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:23.188181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:23.188181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:23.188181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:23.188181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:23.188181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:23.188181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:23.188181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:23.188181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:23.188181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:23.188181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:23.188181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:23.188181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:23.188181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:23.188181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:23.188963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:23.188963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:23.188963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:23.188963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:23.188963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:23.188963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:23.188963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:23.188963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:23.188963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:23.188963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:23.188963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:43:23.188963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:23.190906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 219/446] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:43:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:43:23.193992 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab64b0-4586-4aa3-aed3-71d3978ead2b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:23.198339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 228/447] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 10:43:23.204257 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7df6e4-a2eb-4e75-93a7-cf8e47c9ddef None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:23.294989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab64b0-4586-4aa3-aed3-71d3978ead2b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:23.305902 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:23.308764 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7df6e4-a2eb-4e75-93a7-cf8e47c9ddef None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:23.328118 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3467d-6235-4367-b719-11e76fffd03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:23.328727 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3467d-6235-4367-b719-11e76fffd03d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:23.329006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3467d-6235-4367-b719-11e76fffd03d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:23.329276 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3467d-6235-4367-b719-11e76fffd03d None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:23.329930 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3467d-6235-4367-b719-11e76fffd03d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:23.330231 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3467d-6235-4367-b719-11e76fffd03d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:23.331636 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3467d-6235-4367-b719-11e76fffd03d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:23.339474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 220/448] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:23.341825 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010341cd-ca1a-468f-a2f1-2803330979b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:23.342537 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010341cd-ca1a-468f-a2f1-2803330979b4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:23.342854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010341cd-ca1a-468f-a2f1-2803330979b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:23.343126 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010341cd-ca1a-468f-a2f1-2803330979b4 None admin] PATH_INFO: `/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:23.344245 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010341cd-ca1a-468f-a2f1-2803330979b4 None admin] RBAC: Authorizing `identity:get_project(project_id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:23.345671 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010341cd-ca1a-468f-a2f1-2803330979b4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:23.345770 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3467d-6235-4367-b719-11e76fffd03d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:23.347455 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 229/449] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:43:23 2022] GET /identity/v3/projects/9fa0b2ae9cdb4e94b07dfb1cf77ff01c => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:23.352545 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010341cd-ca1a-468f-a2f1-2803330979b4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:23.358124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:23.444399 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3467d-6235-4367-b719-11e76fffd03d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:23.448533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010341cd-ca1a-468f-a2f1-2803330979b4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:23.477393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1908b-a261-423c-97bf-a8c38163f3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:23.477994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1908b-a261-423c-97bf-a8c38163f3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:23.478275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1908b-a261-423c-97bf-a8c38163f3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:23.478541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1908b-a261-423c-97bf-a8c38163f3e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:23.483480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379414d0-77e3-44f0-967b-7950370f793f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:23.484351 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379414d0-77e3-44f0-967b-7950370f793f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:23.484623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379414d0-77e3-44f0-967b-7950370f793f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:23.484885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379414d0-77e3-44f0-967b-7950370f793f None admin] PATH_INFO: `/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:23.485954 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379414d0-77e3-44f0-967b-7950370f793f None admin] RBAC: Authorizing `identity:get_group(group_id=5cfe934d1d4848ff8b094c3dfa5f88e7)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:23.487419 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379414d0-77e3-44f0-967b-7950370f793f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:23.488953 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 230/450] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Aug 11 10:43:23 2022] GET /identity/v3/groups/5cfe934d1d4848ff8b094c3dfa5f88e7 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:23.494778 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379414d0-77e3-44f0-967b-7950370f793f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:23.528953 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:23.545193 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1908b-a261-423c-97bf-a8c38163f3e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:23.555158 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1908b-a261-423c-97bf-a8c38163f3e9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:23.557567 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:23.593143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379414d0-77e3-44f0-967b-7950370f793f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:23.626251 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c21e40-0e8c-49a9-9f57-3f4ec4c30aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:23.626885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c21e40-0e8c-49a9-9f57-3f4ec4c30aac None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:23.627168 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c21e40-0e8c-49a9-9f57-3f4ec4c30aac None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:23.627444 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c21e40-0e8c-49a9-9f57-3f4ec4c30aac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:23.628167 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c21e40-0e8c-49a9-9f57-3f4ec4c30aac None admin] RBAC: Adding query filter params (group.id=5cfe934d1d4848ff8b094c3dfa5f88e7, role.id=ea851d0cf29e44a1884d7c23431a7481, scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:23.628511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c21e40-0e8c-49a9-9f57-3f4ec4c30aac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:23.629978 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c21e40-0e8c-49a9-9f57-3f4ec4c30aac None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:23.635698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 231/451] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Aug 11 10:43:23 2022] GET /identity/v3/role_assignments?group.id=5cfe934d1d4848ff8b094c3dfa5f88e7&scope.project.id=9fa0b2ae9cdb4e94b07dfb1cf77ff01c&role.id=ea851d0cf29e44a1884d7c23431a7481 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:23.644667 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 221/452] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 10:43:23.650573 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c21e40-0e8c-49a9-9f57-3f4ec4c30aac None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:23.756523 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:23.756523 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c21e40-0e8c-49a9-9f57-3f4ec4c30aac None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:23.791309 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978fa1a-2de2-43d4-b345-583c9e378387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:23.791929 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978fa1a-2de2-43d4-b345-583c9e378387 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:23.792211 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978fa1a-2de2-43d4-b345-583c9e378387 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:23.792479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978fa1a-2de2-43d4-b345-583c9e378387 None admin] PATH_INFO: `/v3/projects/d6947801fa7c4cca9da48801b7ffc014` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:23.794654 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978fa1a-2de2-43d4-b345-583c9e378387 None admin] RBAC: Authorizing `identity:get_project(project_id=d6947801fa7c4cca9da48801b7ffc014)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:23.795779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978fa1a-2de2-43d4-b345-583c9e378387 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:23.797552 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 232/453] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:43:23 2022] GET /identity/v3/projects/d6947801fa7c4cca9da48801b7ffc014 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:23.803292 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1908b-a261-423c-97bf-a8c38163f3e9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:23.902055 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1908b-a261-423c-97bf-a8c38163f3e9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:23.913538 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:23.936751 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a47194-0045-4651-987f-b8866e66eafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:23.937383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a47194-0045-4651-987f-b8866e66eafb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:23.937661 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a47194-0045-4651-987f-b8866e66eafb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:23.937935 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a47194-0045-4651-987f-b8866e66eafb None admin] PATH_INFO: `/v3/groups/8b7a82cab6ee4cd1879e7d1b2056e58b` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:23.939073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a47194-0045-4651-987f-b8866e66eafb None admin] RBAC: Authorizing `identity:get_group(group_id=8b7a82cab6ee4cd1879e7d1b2056e58b)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:23.940502 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a47194-0045-4651-987f-b8866e66eafb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:23.942063 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 222/454] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Aug 11 10:43:23 2022] GET /identity/v3/groups/8b7a82cab6ee4cd1879e7d1b2056e58b => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:23.947967 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978fa1a-2de2-43d4-b345-583c9e378387 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:24.051337 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978fa1a-2de2-43d4-b345-583c9e378387 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:24.085916 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6a2e2-5580-43c3-85b0-3be74e4f466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:24.086513 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6a2e2-5580-43c3-85b0-3be74e4f466b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:24.086817 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6a2e2-5580-43c3-85b0-3be74e4f466b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:24.087089 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6a2e2-5580-43c3-85b0-3be74e4f466b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:24.087810 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6a2e2-5580-43c3-85b0-3be74e4f466b None admin] RBAC: Adding query filter params (group.id=8b7a82cab6ee4cd1879e7d1b2056e58b, role.id=00c6de5dd6cd4267ba05941ddb91e6ad, scope.project.id=d6947801fa7c4cca9da48801b7ffc014) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:24.088113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6a2e2-5580-43c3-85b0-3be74e4f466b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:24.089535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6a2e2-5580-43c3-85b0-3be74e4f466b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:24.097302 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 233/455] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Aug 11 10:43:23 2022] GET /identity/v3/role_assignments?group.id=8b7a82cab6ee4cd1879e7d1b2056e58b&scope.project.id=d6947801fa7c4cca9da48801b7ffc014&role.id=00c6de5dd6cd4267ba05941ddb91e6ad => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:26.524381 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543de41a-504e-4adf-92fd-78bf560723a1 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:26.524903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543de41a-504e-4adf-92fd-78bf560723a1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:26.524903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543de41a-504e-4adf-92fd-78bf560723a1 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:26.526547 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 223/456] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:26.532564 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69a4c3-8abc-4c9f-a2ec-d709b5fb4245 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:26.533453 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69a4c3-8abc-4c9f-a2ec-d709b5fb4245 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:26.533932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a69a4c3-8abc-4c9f-a2ec-d709b5fb4245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:26.563757 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-9a69a4c3-8abc-4c9f-a2ec-d709b5fb4245 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:26.565392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9a69a4c3-8abc-4c9f-a2ec-d709b5fb4245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:26.595088 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:26.644859 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 234/457] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:26.664812 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543de41a-504e-4adf-92fd-78bf560723a1 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:26.770934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74646c3e-5c30-41e3-8d34-f8810b341c12 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:26.771377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74646c3e-5c30-41e3-8d34-f8810b341c12 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:26.771657 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74646c3e-5c30-41e3-8d34-f8810b341c12 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:26.773470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 235/458] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:26.780992 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479ae79-af8c-4efc-97a3-3932bb674226 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:26.781218 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479ae79-af8c-4efc-97a3-3932bb674226 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:26.781474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479ae79-af8c-4efc-97a3-3932bb674226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:26.798858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543de41a-504e-4adf-92fd-78bf560723a1 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:26.804462 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-b479ae79-af8c-4efc-97a3-3932bb674226 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:26.805642 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b479ae79-af8c-4efc-97a3-3932bb674226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:26.860403 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08856810-16ef-47a7-ae9b-4076b5152774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:26.861049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08856810-16ef-47a7-ae9b-4076b5152774 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:26.861329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08856810-16ef-47a7-ae9b-4076b5152774 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:26.861605 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08856810-16ef-47a7-ae9b-4076b5152774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:26.885207 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08856810-16ef-47a7-ae9b-4076b5152774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:26.886691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08856810-16ef-47a7-ae9b-4076b5152774 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:26.911971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-08856810-16ef-47a7-ae9b-4076b5152774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:26.911971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:26.911971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:26.911971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:26.911971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:26.911971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:26.911971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:26.911971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:26.911971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:26.911971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:26.911971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:26.911971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:26.911971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:26.911971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:26.911971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:26.911971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:26.912893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:26.912893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:26.912893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:26.912893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:26.912893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:26.912893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:26.912893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:26.912893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:26.912893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:26.912893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:26.912893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:26.912893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:26.912893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:26.912893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:26.912893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:26.912893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:26.912893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:26.913689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:26.913689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:26.913689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:26.915654 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 224/459] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:26.928460 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08856810-16ef-47a7-ae9b-4076b5152774 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:26.934788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 236/460] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:43:26.967207 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:26.973140 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479ae79-af8c-4efc-97a3-3932bb674226 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:27.087433 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08856810-16ef-47a7-ae9b-4076b5152774 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:27.101971 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:27.113776 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479ae79-af8c-4efc-97a3-3932bb674226 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:27.139821 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e456c-524a-430e-ad2f-fd30fccfd470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:27.140434 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e456c-524a-430e-ad2f-fd30fccfd470 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:27.140720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e456c-524a-430e-ad2f-fd30fccfd470 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:27.140999 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e456c-524a-430e-ad2f-fd30fccfd470 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:27.142197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e456c-524a-430e-ad2f-fd30fccfd470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:27.142513 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e456c-524a-430e-ad2f-fd30fccfd470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:27.144254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e456c-524a-430e-ad2f-fd30fccfd470 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:27.158712 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741bc92-1aa8-4283-b79e-0641f7b08897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:27.159456 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741bc92-1aa8-4283-b79e-0641f7b08897 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:27.159803 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741bc92-1aa8-4283-b79e-0641f7b08897 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:27.160142 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741bc92-1aa8-4283-b79e-0641f7b08897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:27.162852 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 225/461] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:27.164132 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78804ccd-d443-4871-9dda-1348339a1d24 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:27.164418 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78804ccd-d443-4871-9dda-1348339a1d24 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:27.164692 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78804ccd-d443-4871-9dda-1348339a1d24 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:27.167280 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 226/462] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:27.167986 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78804ccd-d443-4871-9dda-1348339a1d24 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:27.175684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741bc92-1aa8-4283-b79e-0641f7b08897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:27.177276 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741bc92-1aa8-4283-b79e-0641f7b08897 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:27.194234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-6741bc92-1aa8-4283-b79e-0641f7b08897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:27.194234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:27.194234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:27.194234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:27.194234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:27.194234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:27.194234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:27.194234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:27.194234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:27.194234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:27.194234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:27.194234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:27.194234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:27.194234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:27.194234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:27.194234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:27.195179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:27.195179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:27.195179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:27.195179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:27.195179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:27.195179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:27.195179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:27.195179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:27.195179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:27.195179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:27.195179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:27.195179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:27.195179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:27.195179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:27.195179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:27.195179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:27.195179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:27.195991 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:27.195991 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:27.195991 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:27.195991 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 237/463] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:43:27.197078 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad99b4-6e71-4cc9-a0de-ba19337006d9 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:27.197365 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad99b4-6e71-4cc9-a0de-ba19337006d9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:27.197640 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad99b4-6e71-4cc9-a0de-ba19337006d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:27.216442 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5bad99b4-6e71-4cc9-a0de-ba19337006d9 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:27.217657 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5bad99b4-6e71-4cc9-a0de-ba19337006d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:27.275955 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:27.288454 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78804ccd-d443-4871-9dda-1348339a1d24 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:27.295394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 238/464] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:27.296436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad99b4-6e71-4cc9-a0de-ba19337006d9 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:27.345789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24e5cf-8c8d-4902-baa1-a7e5b4b3dc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:27.346403 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24e5cf-8c8d-4902-baa1-a7e5b4b3dc1b None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:27.346681 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24e5cf-8c8d-4902-baa1-a7e5b4b3dc1b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:27.350773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24e5cf-8c8d-4902-baa1-a7e5b4b3dc1b None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:27.351442 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24e5cf-8c8d-4902-baa1-a7e5b4b3dc1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:27.352885 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24e5cf-8c8d-4902-baa1-a7e5b4b3dc1b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:27.378182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:27.403854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad99b4-6e71-4cc9-a0de-ba19337006d9 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:27.435684 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 227/465] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Aug 11 10:43:27 2022] POST /identity/v3/users => generated 246 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:43:27.436631 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24e5cf-8c8d-4902-baa1-a7e5b4b3dc1b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:27.443745 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f2529-9317-4a82-afea-ffa92ea6d0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:27.444379 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f2529-9317-4a82-afea-ffa92ea6d0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:27.444658 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f2529-9317-4a82-afea-ffa92ea6d0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:27.444926 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f2529-9317-4a82-afea-ffa92ea6d0a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:27.447232 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f2529-9317-4a82-afea-ffa92ea6d0a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:27.448698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f2529-9317-4a82-afea-ffa92ea6d0a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:27.451381 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f2529-9317-4a82-afea-ffa92ea6d0a2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:27.473951 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 239/466] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:27.475641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c63483-c6d9-46b8-9397-f564c978ffe8 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:27.476070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c63483-c6d9-46b8-9397-f564c978ffe8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:27.476698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c63483-c6d9-46b8-9397-f564c978ffe8 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:27.482374 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 240/467] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:27.482374 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c63483-c6d9-46b8-9397-f564c978ffe8 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:27.558744 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24e5cf-8c8d-4902-baa1-a7e5b4b3dc1b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:27.600280 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000691d-1ad3-4422-8eee-f69143896992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:27.601386 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000691d-1ad3-4422-8eee-f69143896992 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:27.601765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000691d-1ad3-4422-8eee-f69143896992 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:27.602133 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000691d-1ad3-4422-8eee-f69143896992 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:27.614247 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000691d-1ad3-4422-8eee-f69143896992 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:27.615942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000691d-1ad3-4422-8eee-f69143896992 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:27.616738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c63483-c6d9-46b8-9397-f564c978ffe8 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:27.624668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:27.633237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-7000691d-1ad3-4422-8eee-f69143896992 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:27.633237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:27.633237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:27.633237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:27.633237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:27.633237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:27.633237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:27.633237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:27.633237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:27.633237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:27.633237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:27.633237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:27.633237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:27.633237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:27.633237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:27.633237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:27.637921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:27.637921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:27.637921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:27.637921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:27.637921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:27.637921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:27.637921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:27.637921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:27.637921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:27.637921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:27.637921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:27.637921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:27.637921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:27.637921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:27.637921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:27.637921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:27.637921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:27.638742 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:27.638742 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:27.638742 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:27.638742 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 228/468] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:27.638742 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade1aea-cfdd-4d5c-8bfc-4a0c7a4001d7 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:27.638742 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade1aea-cfdd-4d5c-8bfc-4a0c7a4001d7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:27.638742 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade1aea-cfdd-4d5c-8bfc-4a0c7a4001d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:27.658282 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-cade1aea-cfdd-4d5c-8bfc-4a0c7a4001d7 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:27.660122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cade1aea-cfdd-4d5c-8bfc-4a0c7a4001d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:27.673546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08040ff-318c-4caf-9f63-d5cc8a333f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:27.674176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08040ff-318c-4caf-9f63-d5cc8a333f00 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:27.674462 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08040ff-318c-4caf-9f63-d5cc8a333f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:27.676618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08040ff-318c-4caf-9f63-d5cc8a333f00 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:27.676618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08040ff-318c-4caf-9f63-d5cc8a333f00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:27.676888 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08040ff-318c-4caf-9f63-d5cc8a333f00 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:27.685537 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:27.741552 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 229/469] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:27.742404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade1aea-cfdd-4d5c-8bfc-4a0c7a4001d7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:27.761545 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 241/470] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Aug 11 10:43:27 2022] POST /identity/v3/users => generated 248 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:43:27.773866 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08040ff-318c-4caf-9f63-d5cc8a333f00 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:27.876678 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade1aea-cfdd-4d5c-8bfc-4a0c7a4001d7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:27.931571 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:27.940364 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08040ff-318c-4caf-9f63-d5cc8a333f00 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:27.951826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43379989-54f5-4d21-a9bf-1614c0c6582d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:27.952466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43379989-54f5-4d21-a9bf-1614c0c6582d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:27.952741 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43379989-54f5-4d21-a9bf-1614c0c6582d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:27.953012 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43379989-54f5-4d21-a9bf-1614c0c6582d None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:27.953664 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43379989-54f5-4d21-a9bf-1614c0c6582d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:27.953964 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43379989-54f5-4d21-a9bf-1614c0c6582d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:27.955514 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43379989-54f5-4d21-a9bf-1614c0c6582d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:27.986458 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 230/471] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:27.990480 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43379989-54f5-4d21-a9bf-1614c0c6582d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:28.011793 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d0f5e-c6fe-4561-be11-a9c036e202c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:28.013875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d0f5e-c6fe-4561-be11-a9c036e202c6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:28.015056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d0f5e-c6fe-4561-be11-a9c036e202c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:28.015647 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d0f5e-c6fe-4561-be11-a9c036e202c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:28.029603 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d0f5e-c6fe-4561-be11-a9c036e202c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:28.031742 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d0f5e-c6fe-4561-be11-a9c036e202c6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:28.051509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-fc8d0f5e-c6fe-4561-be11-a9c036e202c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:28.051509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:28.051509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:28.051509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:28.051509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:28.051509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:28.051509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:28.051509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:28.051509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:28.051509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:28.051509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:28.051509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:28.051509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:28.051509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:28.051509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:28.051509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:28.052648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:28.052648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:28.052648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:28.052648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:28.052648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:28.052648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:28.052648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:28.052648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:28.052648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:28.052648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:28.052648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:28.052648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:28.052648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:28.052648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:28.052648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:28.052648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:28.052648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:28.053583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:28.053583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:28.053583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:28.054649 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 242/472] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:28.063780 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d0f5e-c6fe-4561-be11-a9c036e202c6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:28.125137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43379989-54f5-4d21-a9bf-1614c0c6582d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:28.132827 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:28.167834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f25df0-626b-4cdb-a870-2291849532f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:28.169512 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f25df0-626b-4cdb-a870-2291849532f2 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:28.170065 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f25df0-626b-4cdb-a870-2291849532f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:28.170520 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f25df0-626b-4cdb-a870-2291849532f2 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:28.171339 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f25df0-626b-4cdb-a870-2291849532f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:28.173040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f25df0-626b-4cdb-a870-2291849532f2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:28.203519 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d0f5e-c6fe-4561-be11-a9c036e202c6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:28.243281 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143b482-86ac-4a30-ac86-3f3024995471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:28.243890 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143b482-86ac-4a30-ac86-3f3024995471 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:28.244170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143b482-86ac-4a30-ac86-3f3024995471 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:28.244459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143b482-86ac-4a30-ac86-3f3024995471 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:28.245139 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143b482-86ac-4a30-ac86-3f3024995471 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:28.245435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143b482-86ac-4a30-ac86-3f3024995471 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:28.246868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143b482-86ac-4a30-ac86-3f3024995471 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:28.259464 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 243/473] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:28.260744 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e216dd7-1987-470e-bc7a-48b024fd0aee None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:28.261027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e216dd7-1987-470e-bc7a-48b024fd0aee None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:28.261297 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e216dd7-1987-470e-bc7a-48b024fd0aee None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:28.263342 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 244/474] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:28.264983 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e216dd7-1987-470e-bc7a-48b024fd0aee None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:28.274291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 231/475] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Aug 11 10:43:27 2022] POST /identity/v3/users => generated 248 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:43:28.275766 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e1024-16d2-4e3b-8644-8e43103a2d5d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:28.276059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e1024-16d2-4e3b-8644-8e43103a2d5d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:28.276391 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e1024-16d2-4e3b-8644-8e43103a2d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:28.300068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ec4e1024-16d2-4e3b-8644-8e43103a2d5d None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:28.301345 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ec4e1024-16d2-4e3b-8644-8e43103a2d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:28.350775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:28.387274 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 232/476] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:28.415266 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e1024-16d2-4e3b-8644-8e43103a2d5d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:28.444618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e216dd7-1987-470e-bc7a-48b024fd0aee None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:28.446732 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:28.516703 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d280f3c-47ef-4177-afd3-7134088fc4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:28.517663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d280f3c-47ef-4177-afd3-7134088fc4ba None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:28.518082 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d280f3c-47ef-4177-afd3-7134088fc4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:28.519022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d280f3c-47ef-4177-afd3-7134088fc4ba None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:28.519809 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d280f3c-47ef-4177-afd3-7134088fc4ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:28.522138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d280f3c-47ef-4177-afd3-7134088fc4ba None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:28.548274 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e1024-16d2-4e3b-8644-8e43103a2d5d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:28.588095 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10f0d6-2021-4e58-88c4-26b891168152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:28.588732 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10f0d6-2021-4e58-88c4-26b891168152 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:28.588732 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10f0d6-2021-4e58-88c4-26b891168152 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:28.588732 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10f0d6-2021-4e58-88c4-26b891168152 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:28.589311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10f0d6-2021-4e58-88c4-26b891168152 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:28.591363 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10f0d6-2021-4e58-88c4-26b891168152 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:28.669729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 245/477] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Aug 11 10:43:28 2022] POST /identity/v3/users => generated 249 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:43:28.670826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.sql.core [None req-da10f0d6-2021-4e58-88c4-26b891168152 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 11 10:43:28.670826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 11 10:43:28.670826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [parameters: {'id': '05b745801be64893add2a89ba07383e8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 11 10:43:28.670826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81638) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 11 10:43:28.688005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-da10f0d6-2021-4e58-88c4-26b891168152 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 11 10:43:28.688005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:28.688005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 10:43:28.688005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 10:43:28.688005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 10:43:28.688005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 10:43:28.688005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 10:43:28.688005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 10:43:28.688005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 10:43:28.688005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application conn.query(q) Aug 11 10:43:28.688005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 10:43:28.688005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 10:43:28.688005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 10:43:28.688005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application result.read() Aug 11 10:43:28.688005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 10:43:28.688997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 10:43:28.688997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 10:43:28.688997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 10:43:28.688997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 10:43:28.688997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 10:43:28.688997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 10:43:28.688997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 10:43:28.688997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 11 10:43:28.688997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:28.688997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 11 10:43:28.688997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:28.688997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:28.688997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 11 10:43:28.688997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 11 10:43:28.688997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 11 10:43:28.688997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return ref.to_dict() Aug 11 10:43:28.688997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 10:43:28.688997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application next(self.gen) Aug 11 10:43:28.689877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 11 10:43:28.689877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application yield resource Aug 11 10:43:28.689877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 10:43:28.689877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application next(self.gen) Aug 11 10:43:28.689877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 11 10:43:28.689877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.session.rollback() Aug 11 10:43:28.689877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 11 10:43:28.689877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.force_reraise() Aug 11 10:43:28.689877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 11 10:43:28.689877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise self.value Aug 11 10:43:28.689877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 11 10:43:28.689877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 11 10:43:28.689877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 11 10:43:28.689877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application session.commit() Aug 11 10:43:28.689877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 11 10:43:28.689877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 11 10:43:28.689877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 11 10:43:28.690704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._prepare_impl() Aug 11 10:43:28.690704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 11 10:43:28.690704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.session.flush() Aug 11 10:43:28.690704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 11 10:43:28.690704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._flush(objects) Aug 11 10:43:28.690704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 11 10:43:28.690704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 11 10:43:28.690704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 11 10:43:28.690704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application compat.raise_( Aug 11 10:43:28.690704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 10:43:28.690704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception Aug 11 10:43:28.690704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 11 10:43:28.690704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application flush_context.execute() Aug 11 10:43:28.690704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 11 10:43:28.690704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rec.execute(self) Aug 11 10:43:28.690704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 11 10:43:28.690704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 11 10:43:28.691623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 11 10:43:28.691623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 11 10:43:28.691623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 11 10:43:28.691623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 11 10:43:28.691623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 11 10:43:28.691623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 11 10:43:28.691623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 11 10:43:28.691623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 11 10:43:28.691623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 11 10:43:28.691623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 11 10:43:28.691623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 11 10:43:28.691623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 11 10:43:28.691623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 11 10:43:28.691623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 11 10:43:28.691623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 10:43:28.691623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception Aug 11 10:43:28.692437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 10:43:28.692437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 10:43:28.692437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 10:43:28.692437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 10:43:28.692437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 10:43:28.692437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 10:43:28.692437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 10:43:28.692437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application conn.query(q) Aug 11 10:43:28.692437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 10:43:28.692437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 10:43:28.692437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 10:43:28.692437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application result.read() Aug 11 10:43:28.692437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 10:43:28.692437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 10:43:28.692437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 10:43:28.692437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 10:43:28.693219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 10:43:28.693219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 10:43:28.693219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 10:43:28.693219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 10:43:28.693219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 11 10:43:28.693219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 11 10:43:28.693219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [parameters: {'id': '05b745801be64893add2a89ba07383e8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 11 10:43:28.693219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 11 10:43:28.693219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:28.693219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:43:28.693219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:28.693219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:28.693219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:28.693219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:28.693219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:28.693219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:28.693988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:28.693988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:28.693988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:28.693988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:28.693988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:28.693988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:28.693988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 11 10:43:28.693988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 11 10:43:28.693988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:28.693988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:28.693988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 11 10:43:28.693988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 11 10:43:28.693988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 11 10:43:28.693988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 11 10:43:28.693988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 11 10:43:28.693988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:28.696263 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 233/478] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Aug 11 10:43:28 2022] POST /identity/v3/roles => generated 144 bytes in 275 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:28.703461 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d280f3c-47ef-4177-afd3-7134088fc4ba None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:28.813650 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d280f3c-47ef-4177-afd3-7134088fc4ba None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:28.898335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56882120-58ae-4986-911e-d34ea0222bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:28.899020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56882120-58ae-4986-911e-d34ea0222bfe None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:28.899304 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56882120-58ae-4986-911e-d34ea0222bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:28.899578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56882120-58ae-4986-911e-d34ea0222bfe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:28.914842 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56882120-58ae-4986-911e-d34ea0222bfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:28.920788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-56882120-58ae-4986-911e-d34ea0222bfe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:43:28.920788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:28.920788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:28.920788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:28.920788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:28.920788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:28.920788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:28.920788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:28.920788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:28.920788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:28.920788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:28.920788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:28.920788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:28.920788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:28.920788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:28.920788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:28.921684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:28.921684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:28.921684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:28.921684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:28.921684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:28.921684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:28.921684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:28.921684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:28.921684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:28.921684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:28.921684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:28.921684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:28.921684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:28.921684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:28.921684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:28.921684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:28.923087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:28.923087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:28.923087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:28.923087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:28.923087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:28.923087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:28.923087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:28.923087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:28.923087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:28.923087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:28.923087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 11 10:43:28.923087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:28.923087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 246/479] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:43:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:28.927668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10f0d6-2021-4e58-88c4-26b891168152 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:28.976264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:29.060937 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10f0d6-2021-4e58-88c4-26b891168152 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:29.099730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af2a02-c000-4cd9-afe4-7ce494c7f3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:29.100725 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af2a02-c000-4cd9-afe4-7ce494c7f3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:29.101203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af2a02-c000-4cd9-afe4-7ce494c7f3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:29.101667 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af2a02-c000-4cd9-afe4-7ce494c7f3b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:29.102546 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af2a02-c000-4cd9-afe4-7ce494c7f3b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:29.103260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af2a02-c000-4cd9-afe4-7ce494c7f3b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:29.105814 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af2a02-c000-4cd9-afe4-7ce494c7f3b3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:29.116257 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 234/480] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:29.892700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5de499-b51a-4207-af17-35293ae6a18a None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:29.893223 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5de499-b51a-4207-af17-35293ae6a18a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:29.893223 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5de499-b51a-4207-af17-35293ae6a18a None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:29.894831 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 247/481] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:29.900064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b09edd-bd85-4c28-aa95-6321a040498a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:29.900491 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b09edd-bd85-4c28-aa95-6321a040498a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:29.900690 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b09edd-bd85-4c28-aa95-6321a040498a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:29.922914 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-86b09edd-bd85-4c28-aa95-6321a040498a None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:29.924151 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-86b09edd-bd85-4c28-aa95-6321a040498a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:30.013309 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 235/482] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:30.045116 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5de499-b51a-4207-af17-35293ae6a18a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:30.065210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:30.177837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5de499-b51a-4207-af17-35293ae6a18a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:30.228471 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe3ceb-d138-4ae9-8ad5-49e756134a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:30.229482 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe3ceb-d138-4ae9-8ad5-49e756134a6b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:30.229967 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe3ceb-d138-4ae9-8ad5-49e756134a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:30.230460 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe3ceb-d138-4ae9-8ad5-49e756134a6b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:30.251654 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe3ceb-d138-4ae9-8ad5-49e756134a6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:30.256687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-3ffe3ceb-d138-4ae9-8ad5-49e756134a6b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:30.256687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:30.256687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:30.256687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:30.256687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:30.256687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:30.256687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:30.256687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:30.256687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:30.256687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:30.256687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:30.256687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:30.256687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:30.256687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:30.256687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:30.256687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:30.257525 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:30.257525 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:30.257525 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:30.257525 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:30.257525 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:30.257525 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:30.257525 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:30.257525 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:30.257525 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:30.257525 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:30.257525 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:30.257525 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:30.257525 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:30.257525 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:30.257525 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:30.257525 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:30.258273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:30.258273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:30.258273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:30.258273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:30.258273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:30.258273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:30.258273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:30.258273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:30.258273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:30.258273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:30.258273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:30.258273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:30.260620 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 248/483] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:43:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:30.267533 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b09edd-bd85-4c28-aa95-6321a040498a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:30.323108 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:30.429657 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b09edd-bd85-4c28-aa95-6321a040498a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:30.444308 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51545dee-da5d-430f-a31d-579ae102dc85 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:30.444911 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51545dee-da5d-430f-a31d-579ae102dc85 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:30.445416 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51545dee-da5d-430f-a31d-579ae102dc85 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:30.451363 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 249/484] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:43:30.466910 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b4a8c-77da-47ab-8383-acc7924e24e8 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:30.467279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b4a8c-77da-47ab-8383-acc7924e24e8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:30.467738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b4a8c-77da-47ab-8383-acc7924e24e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:30.471063 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6aa72-ebf9-4231-8359-d1a240cd191e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:30.471908 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6aa72-ebf9-4231-8359-d1a240cd191e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:30.472352 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6aa72-ebf9-4231-8359-d1a240cd191e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:30.472789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6aa72-ebf9-4231-8359-d1a240cd191e None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:30.473618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6aa72-ebf9-4231-8359-d1a240cd191e None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:30.474085 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6aa72-ebf9-4231-8359-d1a240cd191e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:30.475648 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6aa72-ebf9-4231-8359-d1a240cd191e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:30.485146 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 236/485] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Aug 11 10:43:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:30.494802 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6aa72-ebf9-4231-8359-d1a240cd191e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:30.502051 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f46b4a8c-77da-47ab-8383-acc7924e24e8 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:30.503295 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f46b4a8c-77da-47ab-8383-acc7924e24e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:30.615245 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 250/486] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:30.642875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b4a8c-77da-47ab-8383-acc7924e24e8 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:30.656260 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:30.657197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:30.671073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6aa72-ebf9-4231-8359-d1a240cd191e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:30.732636 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e33ae6-1fcd-4943-bf79-d003744cee32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:30.733205 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e33ae6-1fcd-4943-bf79-d003744cee32 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:30.733490 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e33ae6-1fcd-4943-bf79-d003744cee32 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:30.733764 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e33ae6-1fcd-4943-bf79-d003744cee32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:30.752765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e33ae6-1fcd-4943-bf79-d003744cee32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:30.755274 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e33ae6-1fcd-4943-bf79-d003744cee32 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:30.785619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e0e33ae6-1fcd-4943-bf79-d003744cee32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:30.785619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:30.785619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:30.785619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:30.785619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:30.785619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:30.785619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:30.785619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:30.785619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:30.785619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:30.785619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:30.785619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:30.785619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:30.785619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:30.785619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:30.785619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:30.786563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:30.786563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:30.786563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:30.786563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:30.786563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:30.786563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:30.786563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:30.786563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:30.786563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:30.786563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:30.786563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:30.786563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:30.786563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:30.786563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:30.786563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:30.786563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:30.786563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:30.787415 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:30.787415 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:30.787415 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:30.790673 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 237/487] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:30.792046 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546196b8-ec3f-47e9-b8e3-c938060bbb88 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:30.792344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546196b8-ec3f-47e9-b8e3-c938060bbb88 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:30.792627 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546196b8-ec3f-47e9-b8e3-c938060bbb88 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:30.794508 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 238/488] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:30.798594 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546196b8-ec3f-47e9-b8e3-c938060bbb88 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:30.820027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b4a8c-77da-47ab-8383-acc7924e24e8 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:30.860273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e07a48-c215-4e25-9c02-d3d3e16e52b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:30.861604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e07a48-c215-4e25-9c02-d3d3e16e52b6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:30.862369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e07a48-c215-4e25-9c02-d3d3e16e52b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:30.863046 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e07a48-c215-4e25-9c02-d3d3e16e52b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:30.877672 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e07a48-c215-4e25-9c02-d3d3e16e52b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:30.883799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-a7e07a48-c215-4e25-9c02-d3d3e16e52b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:30.883799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:30.883799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:30.883799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:30.883799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:30.883799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:30.883799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:30.883799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:30.883799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:30.883799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:30.883799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:30.883799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:30.883799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:30.883799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:30.883799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:30.883799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:30.884875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:30.884875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:30.884875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:30.884875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:30.884875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:30.884875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:30.884875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:30.884875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:30.884875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:30.884875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:30.884875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:30.884875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:30.884875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:30.884875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:30.884875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:30.884875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:30.885753 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:30.885753 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:30.885753 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:30.885753 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:30.885753 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:30.885753 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:30.885753 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:30.885753 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:30.885753 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:30.885753 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:30.885753 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:30.885753 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:30.889478 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 251/489] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:43:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:30.891308 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d77392-3017-44b8-84f5-9530b358dbb4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:30.891752 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d77392-3017-44b8-84f5-9530b358dbb4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:30.892266 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d77392-3017-44b8-84f5-9530b358dbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:30.917675 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-66d77392-3017-44b8-84f5-9530b358dbb4 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:30.920126 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-66d77392-3017-44b8-84f5-9530b358dbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:30.920871 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546196b8-ec3f-47e9-b8e3-c938060bbb88 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:30.967782 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a530cd7-1bae-4cd9-a18e-93674f237694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:30.968395 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a530cd7-1bae-4cd9-a18e-93674f237694 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:30.968678 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a530cd7-1bae-4cd9-a18e-93674f237694 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:30.968951 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a530cd7-1bae-4cd9-a18e-93674f237694 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:30.969595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a530cd7-1bae-4cd9-a18e-93674f237694 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:30.969898 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a530cd7-1bae-4cd9-a18e-93674f237694 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:30.971328 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a530cd7-1bae-4cd9-a18e-93674f237694 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:30.990187 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 239/490] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:30.991335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a530cd7-1bae-4cd9-a18e-93674f237694 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:30.997200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:31.012351 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:31.022780 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 252/491] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:31.022780 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d77392-3017-44b8-84f5-9530b358dbb4 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:31.127413 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a530cd7-1bae-4cd9-a18e-93674f237694 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:31.149955 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d77392-3017-44b8-84f5-9530b358dbb4 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:31.163149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8eb23-f291-4351-97c9-3d60d0778b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:31.164052 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8eb23-f291-4351-97c9-3d60d0778b3b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:31.164535 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8eb23-f291-4351-97c9-3d60d0778b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:31.165012 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8eb23-f291-4351-97c9-3d60d0778b3b None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:31.165944 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8eb23-f291-4351-97c9-3d60d0778b3b None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:31.166450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8eb23-f291-4351-97c9-3d60d0778b3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:31.168595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8eb23-f291-4351-97c9-3d60d0778b3b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:31.177581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 240/492] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Aug 11 10:43:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:31.183261 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8eb23-f291-4351-97c9-3d60d0778b3b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:31.187068 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c95545-b6eb-440b-a59a-2abeb112854d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:31.187708 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c95545-b6eb-440b-a59a-2abeb112854d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:31.187992 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c95545-b6eb-440b-a59a-2abeb112854d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:31.188265 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c95545-b6eb-440b-a59a-2abeb112854d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:31.197445 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c95545-b6eb-440b-a59a-2abeb112854d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:31.199067 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c95545-b6eb-440b-a59a-2abeb112854d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:31.212862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-a3c95545-b6eb-440b-a59a-2abeb112854d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 10:43:31.212862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:31.212862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:31.212862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:31.212862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:31.212862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:31.212862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:31.212862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:31.212862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:31.212862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:31.212862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:31.212862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:31.212862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:43:31.212862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:43:31.212862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:43:31.212862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:43:31.213771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:31.213771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:31.213771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:43:31.213771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:31.213771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:43:31.213771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:31.213771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:31.213771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:31.213771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:31.213771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:31.213771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:31.213771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:31.213771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:31.213771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:31.213771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:31.213771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:31.213771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:31.213771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:31.214640 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:31.214640 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:31.214640 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:43:31.214640 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:43:31.214640 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:43:31.214640 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:43:31.214640 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:43:31.214640 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:43:31.214640 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 10:43:31.214640 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:31.219435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 253/493] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Aug 11 10:43:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:31.220505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c95545-b6eb-440b-a59a-2abeb112854d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:31.259064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:31.286132 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:31.297520 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8eb23-f291-4351-97c9-3d60d0778b3b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:31.334449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d4c6d-85d2-42bc-8578-1aeddc88bde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:31.335482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d4c6d-85d2-42bc-8578-1aeddc88bde6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:31.335847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c95545-b6eb-440b-a59a-2abeb112854d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:31.336224 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d4c6d-85d2-42bc-8578-1aeddc88bde6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:31.336698 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d4c6d-85d2-42bc-8578-1aeddc88bde6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:31.348592 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d4c6d-85d2-42bc-8578-1aeddc88bde6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:31.354047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-105d4c6d-85d2-42bc-8578-1aeddc88bde6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:31.354047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:31.354047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:31.354047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:31.354047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:31.354047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:31.354047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:31.354047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:31.354047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:31.354047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:31.354047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:31.354047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:31.354047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:31.354047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:31.354047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:31.354047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:31.355232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:31.355232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:31.355232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:31.355232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:31.355232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:31.355232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:31.355232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:31.355232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:31.355232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:31.355232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:31.355232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:31.355232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:31.355232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:31.355232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:31.355232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:31.355232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:31.356971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:31.356971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:31.356971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:31.356971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:31.356971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:31.356971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:31.356971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:31.356971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:31.356971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:31.356971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:31.356971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:31.356971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:31.359839 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 241/494] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:43:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:31.360877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d4c6d-85d2-42bc-8578-1aeddc88bde6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:31.381679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007db40-e2ef-4522-9739-f9dd8c729dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:31.382902 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007db40-e2ef-4522-9739-f9dd8c729dae None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:31.383413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007db40-e2ef-4522-9739-f9dd8c729dae None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:31.384164 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007db40-e2ef-4522-9739-f9dd8c729dae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:31.398733 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007db40-e2ef-4522-9739-f9dd8c729dae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:31.400518 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007db40-e2ef-4522-9739-f9dd8c729dae None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:31.415492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-5007db40-e2ef-4522-9739-f9dd8c729dae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:31.415492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:31.415492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:31.415492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:31.415492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:31.415492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:31.415492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:31.415492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:31.415492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:31.415492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:31.415492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:31.415492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:31.415492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:31.415492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:31.415492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:31.415492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:31.416405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:31.416405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:31.416405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:31.416405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:31.416405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:31.416405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:31.416405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:31.416405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:31.416405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:31.416405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:31.416405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:31.416405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:31.416405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:31.416405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:31.416405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:31.416405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:31.416405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:31.423666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:31.423666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:31.423666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:31.423666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 254/495] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:31.423666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae76110-8d13-45ff-831f-9b1388ced5c8 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:31.423666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae76110-8d13-45ff-831f-9b1388ced5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:31.423666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae76110-8d13-45ff-831f-9b1388ced5c8 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:31.423666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 255/496] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:31.423666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae76110-8d13-45ff-831f-9b1388ced5c8 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:31.476408 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d4c6d-85d2-42bc-8578-1aeddc88bde6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:31.503962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:31.523582 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb6cc4-8fb3-4cbc-9014-5290e080824b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:31.523582 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb6cc4-8fb3-4cbc-9014-5290e080824b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:31.523582 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb6cc4-8fb3-4cbc-9014-5290e080824b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:31.523582 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb6cc4-8fb3-4cbc-9014-5290e080824b None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:31.523960 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb6cc4-8fb3-4cbc-9014-5290e080824b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:31.523960 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb6cc4-8fb3-4cbc-9014-5290e080824b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:31.523960 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb6cc4-8fb3-4cbc-9014-5290e080824b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:31.537614 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae76110-8d13-45ff-831f-9b1388ced5c8 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:31.548836 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:31.564508 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 242/497] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Aug 11 10:43:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:31.564508 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb6cc4-8fb3-4cbc-9014-5290e080824b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:31.578688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b76f98-3632-4d2e-b6e5-5a65bf02ae93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:31.579753 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b76f98-3632-4d2e-b6e5-5a65bf02ae93 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:31.580516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b76f98-3632-4d2e-b6e5-5a65bf02ae93 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:31.580814 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b76f98-3632-4d2e-b6e5-5a65bf02ae93 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:31.581484 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b76f98-3632-4d2e-b6e5-5a65bf02ae93 None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:31.581782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b76f98-3632-4d2e-b6e5-5a65bf02ae93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:31.583189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b76f98-3632-4d2e-b6e5-5a65bf02ae93 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:31.595978 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 256/498] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Aug 11 10:43:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:31.595978 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa30aa-7d85-4708-a573-8d364bfa38b9 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:31.595978 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa30aa-7d85-4708-a573-8d364bfa38b9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:31.595978 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa30aa-7d85-4708-a573-8d364bfa38b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:31.612894 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-cbfa30aa-7d85-4708-a573-8d364bfa38b9 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:31.614080 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-cbfa30aa-7d85-4708-a573-8d364bfa38b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:31.675260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb6cc4-8fb3-4cbc-9014-5290e080824b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:31.691082 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 257/499] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:31.691082 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa30aa-7d85-4708-a573-8d364bfa38b9 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:31.717010 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3074f64-c472-4026-832e-d9aedb9ccec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:31.717630 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3074f64-c472-4026-832e-d9aedb9ccec4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:31.717911 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3074f64-c472-4026-832e-d9aedb9ccec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:31.718184 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3074f64-c472-4026-832e-d9aedb9ccec4 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:31.718859 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3074f64-c472-4026-832e-d9aedb9ccec4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:31.719166 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3074f64-c472-4026-832e-d9aedb9ccec4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:31.720742 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3074f64-c472-4026-832e-d9aedb9ccec4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:31.739548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 243/500] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:31.739548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3074f64-c472-4026-832e-d9aedb9ccec4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:31.787656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:31.807365 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa30aa-7d85-4708-a573-8d364bfa38b9 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:31.809497 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:31.846242 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3074f64-c472-4026-832e-d9aedb9ccec4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:31.849106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3294b-7539-4aa5-ad65-52b9f8f1bfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:31.849808 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3294b-7539-4aa5-ad65-52b9f8f1bfbd None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:31.850093 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3294b-7539-4aa5-ad65-52b9f8f1bfbd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:31.850364 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3294b-7539-4aa5-ad65-52b9f8f1bfbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:31.879613 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e43a3-74d3-4f43-9c48-5d476e3a5eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:31.880243 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e43a3-74d3-4f43-9c48-5d476e3a5eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:31.880529 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e43a3-74d3-4f43-9c48-5d476e3a5eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:31.880812 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e43a3-74d3-4f43-9c48-5d476e3a5eb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:31.892126 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e43a3-74d3-4f43-9c48-5d476e3a5eb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:31.893597 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e43a3-74d3-4f43-9c48-5d476e3a5eb1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:31.908140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-875e43a3-74d3-4f43-9c48-5d476e3a5eb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:31.908140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:31.908140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:31.908140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:31.908140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:31.908140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:31.908140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:31.908140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:31.908140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:31.908140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:31.908140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:31.908140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:31.908140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:31.908140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:31.908140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:31.908140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:31.909178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:31.909178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:31.909178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:31.909178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:31.909178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:31.909178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:31.909178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:31.909178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:31.909178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:31.909178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:31.909178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:31.909178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:31.909178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:31.909178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:31.909178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:31.909178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:31.909178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:31.910251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:31.910251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:31.910251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:31.910251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 244/501] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:31.910251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e43a3-74d3-4f43-9c48-5d476e3a5eb1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:31.920892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3294b-7539-4aa5-ad65-52b9f8f1bfbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:31.922351 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3294b-7539-4aa5-ad65-52b9f8f1bfbd None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:32.001849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:32.007533 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e43a3-74d3-4f43-9c48-5d476e3a5eb1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:32.020721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 258/502] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:43:32.025474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3294b-7539-4aa5-ad65-52b9f8f1bfbd None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:32.025474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:32.050067 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4be16-bd7d-4c8a-a446-b8ff696c72bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:32.050639 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4be16-bd7d-4c8a-a446-b8ff696c72bb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:32.050963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4be16-bd7d-4c8a-a446-b8ff696c72bb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:32.051241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4be16-bd7d-4c8a-a446-b8ff696c72bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:32.062185 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4be16-bd7d-4c8a-a446-b8ff696c72bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:32.066896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-58d4be16-bd7d-4c8a-a446-b8ff696c72bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:32.066896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:32.066896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:32.066896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:32.066896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:32.066896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:32.066896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:32.066896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:32.066896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:32.066896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:32.066896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:32.066896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:32.066896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:32.066896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:32.066896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:32.066896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:32.067876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:32.067876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:32.067876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:32.067876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:32.067876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:32.067876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:32.067876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:32.067876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:32.067876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:32.067876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:32.067876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:32.067876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:32.067876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:32.067876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:32.067876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:32.067876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:32.069171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:32.069171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:32.069171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:32.069171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:32.069171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:32.069171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:32.069171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:32.069171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:32.069171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:32.069171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:32.069171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:32.069171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:32.069171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 245/503] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:43:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:32.069171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701bf9f-2191-4ee7-a877-a645f855df61 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:32.069861 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701bf9f-2191-4ee7-a877-a645f855df61 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:32.069861 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701bf9f-2191-4ee7-a877-a645f855df61 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:32.070889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 246/504] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:32.075918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701bf9f-2191-4ee7-a877-a645f855df61 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:32.127950 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3294b-7539-4aa5-ad65-52b9f8f1bfbd None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:32.161147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374a445-952a-4c50-9896-9322994d2c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:32.161764 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a445-952a-4c50-9896-9322994d2c29 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:32.162043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a445-952a-4c50-9896-9322994d2c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:32.162312 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a445-952a-4c50-9896-9322994d2c29 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:32.170060 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374a445-952a-4c50-9896-9322994d2c29 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:32.171529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374a445-952a-4c50-9896-9322994d2c29 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:32.176839 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701bf9f-2191-4ee7-a877-a645f855df61 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:32.182611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-8374a445-952a-4c50-9896-9322994d2c29 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 11 10:43:32.182611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:32.182611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:32.182611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:32.182611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:32.182611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:32.182611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:32.182611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:32.182611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:32.182611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:32.182611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:32.182611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:32.182611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:43:32.182611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:43:32.182611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:43:32.182611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:43:32.183679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:32.183679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:32.183679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:43:32.183679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:32.183679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:43:32.183679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:32.183679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:32.183679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:32.183679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:32.183679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:32.183679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:32.183679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:32.183679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:32.183679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:32.183679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:32.183679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:32.183679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:32.183679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:32.184646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:32.184646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:32.184646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:43:32.184646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:43:32.184646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:43:32.184646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:43:32.184646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:43:32.184646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:43:32.184646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 11 10:43:32.184646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:32.184646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 259/505] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:32.185190 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374a445-952a-4c50-9896-9322994d2c29 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:32.213137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72afe0e-fa27-493a-ace4-705f1f2dcbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:32.213745 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72afe0e-fa27-493a-ace4-705f1f2dcbaf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:32.214028 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72afe0e-fa27-493a-ace4-705f1f2dcbaf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:32.214305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72afe0e-fa27-493a-ace4-705f1f2dcbaf None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:32.216022 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72afe0e-fa27-493a-ace4-705f1f2dcbaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:32.216338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72afe0e-fa27-493a-ace4-705f1f2dcbaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:32.217718 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72afe0e-fa27-493a-ace4-705f1f2dcbaf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:32.229066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 247/506] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:32.229776 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72afe0e-fa27-493a-ace4-705f1f2dcbaf None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:32.248771 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:32.250304 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:32.288883 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374a445-952a-4c50-9896-9322994d2c29 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:32.322568 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d70ce1-b0bb-4d1f-952b-7a73596a2502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:32.323144 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d70ce1-b0bb-4d1f-952b-7a73596a2502 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:32.323421 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d70ce1-b0bb-4d1f-952b-7a73596a2502 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:32.323691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d70ce1-b0bb-4d1f-952b-7a73596a2502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:32.328628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72afe0e-fa27-493a-ace4-705f1f2dcbaf None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:32.334726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d70ce1-b0bb-4d1f-952b-7a73596a2502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:32.336198 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d70ce1-b0bb-4d1f-952b-7a73596a2502 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:32.350918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-49d70ce1-b0bb-4d1f-952b-7a73596a2502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:32.350918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:32.350918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:32.350918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:32.350918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:32.350918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:32.350918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:32.350918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:32.350918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:32.350918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:32.350918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:32.350918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:32.350918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:32.350918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:32.350918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:32.350918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:32.351855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:32.351855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:32.351855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:32.351855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:32.351855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:32.351855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:32.351855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:32.351855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:32.351855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:32.351855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:32.351855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:32.351855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:32.351855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:32.351855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:32.351855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:32.351855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:32.351855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:32.352671 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:32.352671 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:32.352671 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:32.352671 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 260/507] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:32.353554 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a1ed9-7c22-4987-88e7-0fe7172ef0d8 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:32.353841 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a1ed9-7c22-4987-88e7-0fe7172ef0d8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:32.354113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a1ed9-7c22-4987-88e7-0fe7172ef0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:32.367418 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f78c5-5091-4e20-b18d-61c45f39faee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:32.368016 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f78c5-5091-4e20-b18d-61c45f39faee None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:32.368299 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f78c5-5091-4e20-b18d-61c45f39faee None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:32.368571 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f78c5-5091-4e20-b18d-61c45f39faee None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:32.369224 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f78c5-5091-4e20-b18d-61c45f39faee None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:32.369520 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f78c5-5091-4e20-b18d-61c45f39faee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:32.370924 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f78c5-5091-4e20-b18d-61c45f39faee None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:32.372235 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-015a1ed9-7c22-4987-88e7-0fe7172ef0d8 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:32.373392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-015a1ed9-7c22-4987-88e7-0fe7172ef0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:32.378893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 248/508] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Aug 11 10:43:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:32.379679 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f78c5-5091-4e20-b18d-61c45f39faee None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:32.440344 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 261/509] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:32.441169 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a1ed9-7c22-4987-88e7-0fe7172ef0d8 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:32.457739 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:32.478208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f78c5-5091-4e20-b18d-61c45f39faee None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:32.495022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:32.513700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811671c-36e6-49bd-9527-a723817d5ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:32.514298 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811671c-36e6-49bd-9527-a723817d5ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:32.514580 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811671c-36e6-49bd-9527-a723817d5ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:32.514886 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811671c-36e6-49bd-9527-a723817d5ee1 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:32.515605 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811671c-36e6-49bd-9527-a723817d5ee1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:32.515908 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811671c-36e6-49bd-9527-a723817d5ee1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:32.517339 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811671c-36e6-49bd-9527-a723817d5ee1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:32.535600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 249/510] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Aug 11 10:43:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:32.536408 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811671c-36e6-49bd-9527-a723817d5ee1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:32.548391 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a1ed9-7c22-4987-88e7-0fe7172ef0d8 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:32.583703 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd064e-63da-4a7c-ab4f-e476b2bec17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:32.584257 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd064e-63da-4a7c-ab4f-e476b2bec17a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:32.584538 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd064e-63da-4a7c-ab4f-e476b2bec17a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:32.584811 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd064e-63da-4a7c-ab4f-e476b2bec17a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:32.592759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd064e-63da-4a7c-ab4f-e476b2bec17a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:32.594292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd064e-63da-4a7c-ab4f-e476b2bec17a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:32.605997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-dfdd064e-63da-4a7c-ab4f-e476b2bec17a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 10:43:32.605997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:32.605997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:32.605997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:32.605997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:32.605997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:32.605997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:32.605997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:32.605997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:32.605997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:32.605997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:32.605997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:32.605997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:43:32.605997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:43:32.605997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:43:32.605997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:43:32.606875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:32.606875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:32.606875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:43:32.606875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:32.606875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:43:32.606875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:32.606875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:32.606875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:32.606875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:32.606875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:32.606875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:32.606875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:32.606875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:32.606875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:32.606875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:32.606875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:32.606875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:32.606875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:32.607729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:32.607729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:32.607729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:43:32.607729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:43:32.607729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:43:32.607729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:43:32.607729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:43:32.607729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:43:32.607729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 10:43:32.607729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:32.607729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 262/511] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:32.608255 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd064e-63da-4a7c-ab4f-e476b2bec17a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:32.636161 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811671c-36e6-49bd-9527-a723817d5ee1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:32.671168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a931f66-c2c1-4952-9bb2-2e865916107a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:32.671775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a931f66-c2c1-4952-9bb2-2e865916107a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:32.672061 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a931f66-c2c1-4952-9bb2-2e865916107a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:32.672334 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a931f66-c2c1-4952-9bb2-2e865916107a None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:32.672983 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a931f66-c2c1-4952-9bb2-2e865916107a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:32.673273 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a931f66-c2c1-4952-9bb2-2e865916107a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:32.674670 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a931f66-c2c1-4952-9bb2-2e865916107a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:32.677097 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:32.686468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 250/512] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:32.687316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a931f66-c2c1-4952-9bb2-2e865916107a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:32.709934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd064e-63da-4a7c-ab4f-e476b2bec17a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:32.712219 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:32.743395 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b650b4b-2b34-4fea-b8e2-3b052506dc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:32.744025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b650b4b-2b34-4fea-b8e2-3b052506dc39 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:32.744303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b650b4b-2b34-4fea-b8e2-3b052506dc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:32.744573 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b650b4b-2b34-4fea-b8e2-3b052506dc39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:32.755508 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b650b4b-2b34-4fea-b8e2-3b052506dc39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:32.756941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b650b4b-2b34-4fea-b8e2-3b052506dc39 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:32.771330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-9b650b4b-2b34-4fea-b8e2-3b052506dc39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:32.771330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:32.771330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:32.771330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:32.771330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:32.771330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:32.771330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:32.771330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:32.771330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:32.771330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:32.771330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:32.771330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:32.771330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:32.771330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:32.771330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:32.771330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:32.772327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:32.772327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:32.772327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:32.772327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:32.772327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:32.772327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:32.772327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:32.772327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:32.772327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:32.772327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:32.772327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:32.772327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:32.772327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:32.772327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:32.772327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:32.772327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:32.772327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:32.773162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:32.773162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:32.773162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:32.773162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 263/513] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:32.773162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b650b4b-2b34-4fea-b8e2-3b052506dc39 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:32.793547 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a931f66-c2c1-4952-9bb2-2e865916107a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:32.828235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abce3ba-839d-4e35-b30a-97eb497e005c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:32.828864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abce3ba-839d-4e35-b30a-97eb497e005c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:32.829148 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abce3ba-839d-4e35-b30a-97eb497e005c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:32.829424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abce3ba-839d-4e35-b30a-97eb497e005c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:32.840120 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abce3ba-839d-4e35-b30a-97eb497e005c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:32.841780 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abce3ba-839d-4e35-b30a-97eb497e005c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:32.855660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-9abce3ba-839d-4e35-b30a-97eb497e005c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:32.855660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:32.855660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:32.855660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:32.855660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:32.855660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:32.855660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:32.855660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:32.855660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:32.855660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:32.855660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:32.855660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:32.855660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:32.855660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:32.855660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:32.855660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:32.856620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:32.856620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:32.856620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:32.856620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:32.856620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:32.856620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:32.856620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:32.856620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:32.856620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:32.856620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:32.856620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:32.856620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:32.856620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:32.856620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:32.856620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:32.856620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:32.856620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:32.857482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:32.857482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:32.857482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:32.857482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 251/514] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:32.857753 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abce3ba-839d-4e35-b30a-97eb497e005c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:32.879508 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b650b4b-2b34-4fea-b8e2-3b052506dc39 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:32.907318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:32.912198 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309d12f-dc39-4c99-a44c-71c94576a4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:32.912807 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309d12f-dc39-4c99-a44c-71c94576a4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:32.913090 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309d12f-dc39-4c99-a44c-71c94576a4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:32.913364 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309d12f-dc39-4c99-a44c-71c94576a4a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:32.938628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:32.959529 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abce3ba-839d-4e35-b30a-97eb497e005c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:32.982295 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309d12f-dc39-4c99-a44c-71c94576a4a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:32.984636 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309d12f-dc39-4c99-a44c-71c94576a4a7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:32.993125 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db264c8-5f35-4576-8e0c-2aba6ce00d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:32.993733 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db264c8-5f35-4576-8e0c-2aba6ce00d6f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:32.994016 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db264c8-5f35-4576-8e0c-2aba6ce00d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:32.994292 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db264c8-5f35-4576-8e0c-2aba6ce00d6f None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:32.995038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db264c8-5f35-4576-8e0c-2aba6ce00d6f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:32.995345 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db264c8-5f35-4576-8e0c-2aba6ce00d6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:32.997387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db264c8-5f35-4576-8e0c-2aba6ce00d6f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:33.013880 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 252/515] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Aug 11 10:43:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:33.015393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db264c8-5f35-4576-8e0c-2aba6ce00d6f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:33.086057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 264/516] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:43:33.087321 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309d12f-dc39-4c99-a44c-71c94576a4a7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:33.121755 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db264c8-5f35-4576-8e0c-2aba6ce00d6f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:33.129079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:33.140329 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:33.154464 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e1ec0-a21a-41fc-9245-9c4fdb86bc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:33.155112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e1ec0-a21a-41fc-9245-9c4fdb86bc48 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:33.155394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e1ec0-a21a-41fc-9245-9c4fdb86bc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:33.155668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e1ec0-a21a-41fc-9245-9c4fdb86bc48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:33.162098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e1ec0-a21a-41fc-9245-9c4fdb86bc48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:33.163561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925e1ec0-a21a-41fc-9245-9c4fdb86bc48 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:33.177197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-925e1ec0-a21a-41fc-9245-9c4fdb86bc48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:33.177197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:33.177197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:33.177197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:33.177197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:33.177197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:33.177197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:33.177197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:33.177197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:33.177197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:33.177197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:33.177197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:33.177197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:43:33.177197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:43:33.177197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:43:33.185432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:43:33.185432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:33.185432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:33.185432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:33.185432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:33.185432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:33.185432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:33.185432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:33.185432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:33.185432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:33.185432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:33.185432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:33.185432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:33.185432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:33.185432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:33.185432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:33.185432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:33.186277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:43:33.186277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:43:33.186277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:43:33.186277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:43:33.186277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:43:33.186277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:43:33.186277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:33.186277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:33.186277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 253/517] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:33.186277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e1ec0-a21a-41fc-9245-9c4fdb86bc48 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:33.186833 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309d12f-dc39-4c99-a44c-71c94576a4a7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:33.216298 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30636ae2-b17e-46bb-b041-5f1b8dcff606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:33.216909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30636ae2-b17e-46bb-b041-5f1b8dcff606 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:33.217192 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30636ae2-b17e-46bb-b041-5f1b8dcff606 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:33.217467 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30636ae2-b17e-46bb-b041-5f1b8dcff606 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:33.218110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30636ae2-b17e-46bb-b041-5f1b8dcff606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:33.218411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30636ae2-b17e-46bb-b041-5f1b8dcff606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:33.219789 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30636ae2-b17e-46bb-b041-5f1b8dcff606 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:33.231877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 265/518] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:33.232667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30636ae2-b17e-46bb-b041-5f1b8dcff606 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:33.280249 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e1ec0-a21a-41fc-9245-9c4fdb86bc48 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:33.314562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f3ae7-58b0-4702-9af1-4fcbba5d9043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:33.315308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f3ae7-58b0-4702-9af1-4fcbba5d9043 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:33.315697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f3ae7-58b0-4702-9af1-4fcbba5d9043 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:33.315972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f3ae7-58b0-4702-9af1-4fcbba5d9043 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:33.316609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f3ae7-58b0-4702-9af1-4fcbba5d9043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:33.316909 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f3ae7-58b0-4702-9af1-4fcbba5d9043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:33.318261 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f3ae7-58b0-4702-9af1-4fcbba5d9043 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:33.329518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 254/519] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:33.330151 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f3ae7-58b0-4702-9af1-4fcbba5d9043 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:33.337602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30636ae2-b17e-46bb-b041-5f1b8dcff606 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:33.356982 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:33.357114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:33.374977 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5543b-b0c6-49fe-a483-ed0f416e0b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:33.375608 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5543b-b0c6-49fe-a483-ed0f416e0b1e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:33.375893 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5543b-b0c6-49fe-a483-ed0f416e0b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:33.376234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5543b-b0c6-49fe-a483-ed0f416e0b1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:33.428773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f3ae7-58b0-4702-9af1-4fcbba5d9043 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:33.442923 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5543b-b0c6-49fe-a483-ed0f416e0b1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:33.444382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5543b-b0c6-49fe-a483-ed0f416e0b1e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:33.462272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b63c2-01c7-4146-a39d-20ecb90b8f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:33.462922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b63c2-01c7-4146-a39d-20ecb90b8f23 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:33.463205 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b63c2-01c7-4146-a39d-20ecb90b8f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:33.463479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b63c2-01c7-4146-a39d-20ecb90b8f23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:33.473817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b63c2-01c7-4146-a39d-20ecb90b8f23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:33.475384 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b63c2-01c7-4146-a39d-20ecb90b8f23 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:33.489808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-6d9b63c2-01c7-4146-a39d-20ecb90b8f23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:33.489808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:33.489808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:33.489808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:33.489808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:33.489808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:33.489808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:33.489808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:33.489808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:33.489808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:33.489808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:33.489808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:33.489808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:33.489808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:33.489808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:33.489808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:33.490847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:33.490847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:33.490847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:33.490847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:33.490847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:33.490847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:33.490847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:33.490847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:33.490847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:33.490847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:33.490847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:33.490847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:33.490847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:33.490847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:33.490847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:33.490847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:33.490847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:33.491804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:33.491804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:33.491804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:33.491804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 255/520] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:33.491804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b63c2-01c7-4146-a39d-20ecb90b8f23 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:33.541217 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 266/521] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:43:33.542085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5543b-b0c6-49fe-a483-ed0f416e0b1e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:33.560988 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:33.571060 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:33.592479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b63c2-01c7-4146-a39d-20ecb90b8f23 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:33.628302 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e867f12-6343-48a6-abbd-7d15c5061380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:33.628893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e867f12-6343-48a6-abbd-7d15c5061380 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:33.629293 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e867f12-6343-48a6-abbd-7d15c5061380 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:33.629572 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e867f12-6343-48a6-abbd-7d15c5061380 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:33.630259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e867f12-6343-48a6-abbd-7d15c5061380 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:33.630586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e867f12-6343-48a6-abbd-7d15c5061380 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:33.632041 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e867f12-6343-48a6-abbd-7d15c5061380 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:33.639892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5543b-b0c6-49fe-a483-ed0f416e0b1e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:33.651645 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 256/522] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:43:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:33.653086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e867f12-6343-48a6-abbd-7d15c5061380 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:33.673150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dd289-3214-4c43-8a70-7fe87b493d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:33.673923 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dd289-3214-4c43-8a70-7fe87b493d0a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:33.674206 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dd289-3214-4c43-8a70-7fe87b493d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:33.674479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080dd289-3214-4c43-8a70-7fe87b493d0a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:33.681771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dd289-3214-4c43-8a70-7fe87b493d0a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:33.683258 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080dd289-3214-4c43-8a70-7fe87b493d0a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:33.695574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-080dd289-3214-4c43-8a70-7fe87b493d0a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 10:43:33.695574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:33.695574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:33.695574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:33.695574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:33.695574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:33.695574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:33.695574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:33.695574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:33.695574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:33.695574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:33.695574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:33.695574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:43:33.695574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:43:33.695574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:43:33.695574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:43:33.696583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:33.696583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:33.696583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:43:33.696583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:33.696583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:43:33.696583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:33.696583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:33.696583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:33.696583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:33.696583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:33.696583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:33.696583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:33.696583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:33.696583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:33.696583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:33.696583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:33.696583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:33.696583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:33.697695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:33.697695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:33.697695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:43:33.697695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:43:33.697695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:43:33.697695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:43:33.697695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:43:33.697695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:43:33.697695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 10:43:33.697695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:33.697695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 267/523] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:43:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:33.697695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dd289-3214-4c43-8a70-7fe87b493d0a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:33.757644 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e867f12-6343-48a6-abbd-7d15c5061380 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:33.772223 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:33.792222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48275213-944f-4f96-8c64-bb69d73375d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:33.793705 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48275213-944f-4f96-8c64-bb69d73375d9 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:33.794093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48275213-944f-4f96-8c64-bb69d73375d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:33.794381 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48275213-944f-4f96-8c64-bb69d73375d9 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:33.795076 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48275213-944f-4f96-8c64-bb69d73375d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:33.796515 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48275213-944f-4f96-8c64-bb69d73375d9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:33.796605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080dd289-3214-4c43-8a70-7fe87b493d0a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:33.828084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:33.830488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d888218-be35-44b2-92a0-95f60855c58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:33.831126 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d888218-be35-44b2-92a0-95f60855c58d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:33.831410 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d888218-be35-44b2-92a0-95f60855c58d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:33.831686 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d888218-be35-44b2-92a0-95f60855c58d None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:33.832324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d888218-be35-44b2-92a0-95f60855c58d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:33.832627 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d888218-be35-44b2-92a0-95f60855c58d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:33.834000 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d888218-be35-44b2-92a0-95f60855c58d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:33.845804 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 268/524] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:33.846724 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d888218-be35-44b2-92a0-95f60855c58d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:33.897614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 257/525] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Aug 11 10:43:33 2022] POST /identity/v3/users => generated 247 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:43:33.898444 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48275213-944f-4f96-8c64-bb69d73375d9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:33.952336 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d888218-be35-44b2-92a0-95f60855c58d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:33.997628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1673f33-44c4-49d9-bfdd-dfbf07dad253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:33.998280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1673f33-44c4-49d9-bfdd-dfbf07dad253 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:33.998656 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1673f33-44c4-49d9-bfdd-dfbf07dad253 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:33.998860 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1673f33-44c4-49d9-bfdd-dfbf07dad253 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:34.002588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:34.010186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48275213-944f-4f96-8c64-bb69d73375d9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:34.010835 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1673f33-44c4-49d9-bfdd-dfbf07dad253 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:34.013928 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1673f33-44c4-49d9-bfdd-dfbf07dad253 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:34.038026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-c1673f33-44c4-49d9-bfdd-dfbf07dad253 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:34.038026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:34.038026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:34.038026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:34.038026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:34.038026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:34.038026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:34.038026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:34.038026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:34.038026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:34.038026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:34.038026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:34.038026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:34.038026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:34.038026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:34.038026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:34.039322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:34.039322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:34.039322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:34.039322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:34.039322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:34.039322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:34.039322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:34.039322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:34.039322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:34.039322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:34.039322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:34.039322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:34.039322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:34.039322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:34.039322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:34.039322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:34.039322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:34.040173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:34.040173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:34.040173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:34.040173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 269/526] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:34.041025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1673f33-44c4-49d9-bfdd-dfbf07dad253 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:34.056549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7982e2-2d9c-4036-a560-70d07d2b9bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:34.056549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7982e2-2d9c-4036-a560-70d07d2b9bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:34.056549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7982e2-2d9c-4036-a560-70d07d2b9bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:34.057193 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7982e2-2d9c-4036-a560-70d07d2b9bd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:34.057451 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7982e2-2d9c-4036-a560-70d07d2b9bd3 None admin] RBAC: Adding query filter params (role.id=6de833fef4c9456cb5d8ad66caf96586, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=9267752ac6724013bc1edcdecff48dd7) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:34.057760 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7982e2-2d9c-4036-a560-70d07d2b9bd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:34.059517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7982e2-2d9c-4036-a560-70d07d2b9bd3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:34.070797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 258/527] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:43:33 2022] GET /identity/v3/role_assignments?user.id=9267752ac6724013bc1edcdecff48dd7&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=6de833fef4c9456cb5d8ad66caf96586 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:34.070797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7982e2-2d9c-4036-a560-70d07d2b9bd3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:34.155690 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:34.183833 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1673f33-44c4-49d9-bfdd-dfbf07dad253 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:34.204247 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7982e2-2d9c-4036-a560-70d07d2b9bd3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:34.230578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad6b27-b257-4ae1-9a5a-2c68d860d952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:34.231711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad6b27-b257-4ae1-9a5a-2c68d860d952 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:34.231711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad6b27-b257-4ae1-9a5a-2c68d860d952 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:34.231976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad6b27-b257-4ae1-9a5a-2c68d860d952 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:34.232653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad6b27-b257-4ae1-9a5a-2c68d860d952 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:34.232958 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad6b27-b257-4ae1-9a5a-2c68d860d952 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:34.234721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad6b27-b257-4ae1-9a5a-2c68d860d952 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:34.247658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4ffb5-32eb-4cdb-bb00-49cfa2519404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:34.248349 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4ffb5-32eb-4cdb-bb00-49cfa2519404 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:34.248687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4ffb5-32eb-4cdb-bb00-49cfa2519404 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:34.248968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4ffb5-32eb-4cdb-bb00-49cfa2519404 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:34.256128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4ffb5-32eb-4cdb-bb00-49cfa2519404 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:34.257619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4ffb5-32eb-4cdb-bb00-49cfa2519404 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:34.269484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-15d4ffb5-32eb-4cdb-bb00-49cfa2519404 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:34.269484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:34.269484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:34.269484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:34.269484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:34.269484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:34.269484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:34.269484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:34.269484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:34.269484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:34.269484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:34.269484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:34.269484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:43:34.269484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:43:34.269484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:43:34.270341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:43:34.270341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:34.270341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:34.270341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:34.270341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:34.270341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:34.270341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:34.270341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:34.270341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:34.270341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:34.270341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:34.270341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:34.270341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:34.270341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:34.270341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:34.270341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:34.270341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:34.271238 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:43:34.271238 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:43:34.271238 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:43:34.271238 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:43:34.271238 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:43:34.271238 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:43:34.271238 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:34.271238 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:34.271238 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 259/528] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:34.272138 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4ffb5-32eb-4cdb-bb00-49cfa2519404 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:34.274403 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 270/529] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Aug 11 10:43:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:34.280379 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad6b27-b257-4ae1-9a5a-2c68d860d952 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:34.332362 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:34.393503 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4ffb5-32eb-4cdb-bb00-49cfa2519404 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:34.399064 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad6b27-b257-4ae1-9a5a-2c68d860d952 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:34.412026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:34.430081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fc979-5eaf-4a9f-85db-081d64d87e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:34.430738 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fc979-5eaf-4a9f-85db-081d64d87e60 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:34.431060 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fc979-5eaf-4a9f-85db-081d64d87e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:34.431377 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fc979-5eaf-4a9f-85db-081d64d87e60 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:34.432021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fc979-5eaf-4a9f-85db-081d64d87e60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:34.432321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fc979-5eaf-4a9f-85db-081d64d87e60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:34.434269 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fc979-5eaf-4a9f-85db-081d64d87e60 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:34.446520 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360c8e2-cbe9-4fd5-b26e-e169049e73b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:34.447420 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360c8e2-cbe9-4fd5-b26e-e169049e73b8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:34.447958 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360c8e2-cbe9-4fd5-b26e-e169049e73b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:34.448062 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 260/530] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:34.448136 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360c8e2-cbe9-4fd5-b26e-e169049e73b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:34.448657 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360c8e2-cbe9-4fd5-b26e-e169049e73b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:34.449108 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fc979-5eaf-4a9f-85db-081d64d87e60 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:34.449300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360c8e2-cbe9-4fd5-b26e-e169049e73b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:34.450643 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3360c8e2-cbe9-4fd5-b26e-e169049e73b8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:34.475178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 271/531] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:43:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:34.476064 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360c8e2-cbe9-4fd5-b26e-e169049e73b8 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:34.559284 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fc979-5eaf-4a9f-85db-081d64d87e60 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:34.581366 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360c8e2-cbe9-4fd5-b26e-e169049e73b8 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:34.590674 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:34.595645 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7831bed-2a9b-4b3d-813d-96b43a4623f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:34.596423 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7831bed-2a9b-4b3d-813d-96b43a4623f0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:34.596842 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7831bed-2a9b-4b3d-813d-96b43a4623f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:34.597283 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7831bed-2a9b-4b3d-813d-96b43a4623f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:34.633555 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a2a8a-1951-47d1-8541-faff232f427d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:34.634696 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a2a8a-1951-47d1-8541-faff232f427d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:34.635136 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a2a8a-1951-47d1-8541-faff232f427d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:34.635543 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a2a8a-1951-47d1-8541-faff232f427d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:34.645599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a2a8a-1951-47d1-8541-faff232f427d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:34.647766 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a2a8a-1951-47d1-8541-faff232f427d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:34.653395 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:34.665646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-f01a2a8a-1951-47d1-8541-faff232f427d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:34.665646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:34.665646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:34.665646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:34.665646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:34.665646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:34.665646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:34.665646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:34.665646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:34.665646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:34.665646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:34.665646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:34.665646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:43:34.665646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:43:34.665646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:43:34.666747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:43:34.666747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:34.666747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:34.666747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:34.666747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:34.666747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:34.666747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:34.666747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:34.666747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:34.666747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:34.666747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:34.666747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:34.666747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:34.666747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:34.666747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:34.666747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:34.666747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:34.668359 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:43:34.668359 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:43:34.668359 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:43:34.668359 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:43:34.668359 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:43:34.668359 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:43:34.668359 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:34.668359 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:34.671015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 272/532] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:34.672055 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a2a8a-1951-47d1-8541-faff232f427d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:34.688295 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7831bed-2a9b-4b3d-813d-96b43a4623f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:34.691436 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7831bed-2a9b-4b3d-813d-96b43a4623f0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:34.800298 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a2a8a-1951-47d1-8541-faff232f427d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:34.829340 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 261/533] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:43:34.829340 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7831bed-2a9b-4b3d-813d-96b43a4623f0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:34.844279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7a699-9377-4028-95ee-f143ece41e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:34.845607 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7a699-9377-4028-95ee-f143ece41e98 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:34.846247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7a699-9377-4028-95ee-f143ece41e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:34.846864 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7a699-9377-4028-95ee-f143ece41e98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:34.847779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7a699-9377-4028-95ee-f143ece41e98 None admin] RBAC: Adding query filter params (role.id=6de833fef4c9456cb5d8ad66caf96586, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=d4fe013f66e2452eaaf84d4b52eca489) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:34.848551 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7a699-9377-4028-95ee-f143ece41e98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:34.851001 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7a699-9377-4028-95ee-f143ece41e98 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:34.859324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 273/534] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:43:34 2022] GET /identity/v3/role_assignments?user.id=d4fe013f66e2452eaaf84d4b52eca489&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=6de833fef4c9456cb5d8ad66caf96586 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:34.861084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7a699-9377-4028-95ee-f143ece41e98 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:34.904907 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:34.935951 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:34.968223 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7831bed-2a9b-4b3d-813d-96b43a4623f0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:34.984087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7a699-9377-4028-95ee-f143ece41e98 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:35.026785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a27c44-448f-4321-a3de-f7e663d02b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:35.026785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a27c44-448f-4321-a3de-f7e663d02b23 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:35.026785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a27c44-448f-4321-a3de-f7e663d02b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:35.026785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a27c44-448f-4321-a3de-f7e663d02b23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:35.035656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73eb42-6d47-4e97-9c91-9ab8b93e008c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:35.036290 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73eb42-6d47-4e97-9c91-9ab8b93e008c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:35.036568 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73eb42-6d47-4e97-9c91-9ab8b93e008c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:35.036837 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73eb42-6d47-4e97-9c91-9ab8b93e008c None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:35.037542 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73eb42-6d47-4e97-9c91-9ab8b93e008c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:35.037850 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73eb42-6d47-4e97-9c91-9ab8b93e008c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:35.039531 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73eb42-6d47-4e97-9c91-9ab8b93e008c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:35.052697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a27c44-448f-4321-a3de-f7e663d02b23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:35.054263 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a27c44-448f-4321-a3de-f7e663d02b23 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:35.060276 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 262/535] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:43:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:35.072513 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73eb42-6d47-4e97-9c91-9ab8b93e008c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:35.078411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-07a27c44-448f-4321-a3de-f7e663d02b23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:35.078411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:35.078411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:35.078411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:35.078411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:35.078411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:35.078411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:35.078411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:35.078411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:35.078411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:35.078411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:35.078411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:35.078411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:35.078411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:35.078411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:35.078411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:35.079474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:35.079474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:35.079474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:35.079474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:35.079474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:35.079474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:35.079474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:35.079474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:35.079474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:35.079474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:35.079474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:35.079474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:35.079474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:35.079474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:35.079474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:35.079474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:35.079474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:35.080264 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:35.080264 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:35.080264 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:35.080264 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 274/536] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:35.086176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a27c44-448f-4321-a3de-f7e663d02b23 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:35.198741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:35.219313 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a27c44-448f-4321-a3de-f7e663d02b23 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:35.265898 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9daabbf-c7fe-4c14-8bb5-7322ab1fae08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:35.266514 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daabbf-c7fe-4c14-8bb5-7322ab1fae08 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:35.266815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daabbf-c7fe-4c14-8bb5-7322ab1fae08 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:35.267091 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daabbf-c7fe-4c14-8bb5-7322ab1fae08 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:35.267735 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9daabbf-c7fe-4c14-8bb5-7322ab1fae08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:35.268036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9daabbf-c7fe-4c14-8bb5-7322ab1fae08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:35.271911 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9daabbf-c7fe-4c14-8bb5-7322ab1fae08 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:35.292401 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 275/537] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:35.296353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9daabbf-c7fe-4c14-8bb5-7322ab1fae08 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:35.310978 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73eb42-6d47-4e97-9c91-9ab8b93e008c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:35.391993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4fe2c-0759-4d6c-8d77-9944f536fdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:35.393015 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4fe2c-0759-4d6c-8d77-9944f536fdaf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:35.393488 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4fe2c-0759-4d6c-8d77-9944f536fdaf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:35.393950 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4fe2c-0759-4d6c-8d77-9944f536fdaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:35.394885 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4fe2c-0759-4d6c-8d77-9944f536fdaf None admin] RBAC: Adding query filter params (role.id=6de833fef4c9456cb5d8ad66caf96586, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=85551eadb87f496f882c4d6e984144c8) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:35.395438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4fe2c-0759-4d6c-8d77-9944f536fdaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:35.397049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4fe2c-0759-4d6c-8d77-9944f536fdaf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:35.409729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 263/538] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:43:35 2022] GET /identity/v3/role_assignments?user.id=85551eadb87f496f882c4d6e984144c8&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=6de833fef4c9456cb5d8ad66caf96586 => generated 259 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:35.431324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9daabbf-c7fe-4c14-8bb5-7322ab1fae08 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:35.470008 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34e873-1925-4f06-829a-1283611261c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:35.470569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34e873-1925-4f06-829a-1283611261c9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:35.470877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34e873-1925-4f06-829a-1283611261c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:35.471149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34e873-1925-4f06-829a-1283611261c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:35.479016 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34e873-1925-4f06-829a-1283611261c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:35.480681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d34e873-1925-4f06-829a-1283611261c9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:35.492897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-7d34e873-1925-4f06-829a-1283611261c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:35.492897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:35.492897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:35.492897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:35.492897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:35.492897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:35.492897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:35.492897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:35.492897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:35.492897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:35.492897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:35.492897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:35.492897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:43:35.492897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:43:35.492897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:43:35.493721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:43:35.493721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:35.493721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:35.493721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:35.493721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:35.493721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:35.493721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:35.493721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:35.493721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:35.493721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:35.493721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:35.493721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:35.493721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:35.493721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:35.493721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:35.493721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:35.493721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:35.494516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:43:35.494516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:43:35.494516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:43:35.494516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:43:35.494516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:43:35.494516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:43:35.494516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:35.494516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:35.494516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 276/539] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:35.500798 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4fe2c-0759-4d6c-8d77-9944f536fdaf None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:35.509589 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:35.654095 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4fe2c-0759-4d6c-8d77-9944f536fdaf None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:35.710048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e6f04-962e-4271-b49c-ea43d9de0f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:35.710661 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e6f04-962e-4271-b49c-ea43d9de0f7c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:35.711004 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e6f04-962e-4271-b49c-ea43d9de0f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:35.711226 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e6f04-962e-4271-b49c-ea43d9de0f7c None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:35.711916 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e6f04-962e-4271-b49c-ea43d9de0f7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:35.712223 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e6f04-962e-4271-b49c-ea43d9de0f7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:35.713654 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e6f04-962e-4271-b49c-ea43d9de0f7c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:35.731284 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 264/540] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:43:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:35.737885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34e873-1925-4f06-829a-1283611261c9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:35.742333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:35.871564 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d34e873-1925-4f06-829a-1283611261c9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:35.923440 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2ff7f-80b4-4827-a7ad-34e6254a0ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:35.924048 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2ff7f-80b4-4827-a7ad-34e6254a0ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:35.924323 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2ff7f-80b4-4827-a7ad-34e6254a0ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:35.924586 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2ff7f-80b4-4827-a7ad-34e6254a0ec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:35.925307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2ff7f-80b4-4827-a7ad-34e6254a0ec6 None admin] RBAC: Adding query filter params (role.id=6de833fef4c9456cb5d8ad66caf96586, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=6302b1f98544470a8986055a68bcd948) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:35.925608 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2ff7f-80b4-4827-a7ad-34e6254a0ec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:35.927060 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2ff7f-80b4-4827-a7ad-34e6254a0ec6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:35.932754 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 277/541] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:43:35 2022] GET /identity/v3/role_assignments?user.id=6302b1f98544470a8986055a68bcd948&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=6de833fef4c9456cb5d8ad66caf96586 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:36.296306 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f2980-46e7-4918-8e00-225c4a2d68db None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:36.296793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f2980-46e7-4918-8e00-225c4a2d68db None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:36.296793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f2980-46e7-4918-8e00-225c4a2d68db None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:36.298361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 265/542] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:36.303591 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fe3a0-80f7-4577-8499-c74e5ea6c04b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:36.304013 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fe3a0-80f7-4577-8499-c74e5ea6c04b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:36.304197 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525fe3a0-80f7-4577-8499-c74e5ea6c04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:36.322338 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-525fe3a0-80f7-4577-8499-c74e5ea6c04b None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:36.323578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-525fe3a0-80f7-4577-8499-c74e5ea6c04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:36.359715 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e1a35-2094-460b-b820-21b86f9b1fbb None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:36.360328 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e1a35-2094-460b-b820-21b86f9b1fbb None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:36.360794 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e1a35-2094-460b-b820-21b86f9b1fbb None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:36.362545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 266/543] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:36.368211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416116d-47ff-4289-9d10-6746860783a2 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:36.368767 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416116d-47ff-4289-9d10-6746860783a2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:36.369238 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416116d-47ff-4289-9d10-6746860783a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:36.398098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0416116d-47ff-4289-9d10-6746860783a2 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:36.399343 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0416116d-47ff-4289-9d10-6746860783a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:36.402272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:36.422528 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 278/544] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:36.481538 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fe3a0-80f7-4577-8499-c74e5ea6c04b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:36.507214 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:36.529598 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 267/545] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 11 10:43:36.555913 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416116d-47ff-4289-9d10-6746860783a2 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:36.630962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525fe3a0-80f7-4577-8499-c74e5ea6c04b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:36.693008 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1852e5d-49b9-4a54-b9fc-3dc41ec0fb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:36.694016 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1852e5d-49b9-4a54-b9fc-3dc41ec0fb3d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:36.694494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1852e5d-49b9-4a54-b9fc-3dc41ec0fb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:36.695167 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1852e5d-49b9-4a54-b9fc-3dc41ec0fb3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:36.713298 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1852e5d-49b9-4a54-b9fc-3dc41ec0fb3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:36.719664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e1852e5d-49b9-4a54-b9fc-3dc41ec0fb3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:36.719664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:36.719664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:36.719664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:36.719664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:36.719664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:36.719664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:36.719664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:36.719664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:36.719664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:36.719664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:36.719664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:36.719664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:36.719664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:36.719664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:36.719664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:36.720511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:36.720511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:36.720511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:36.720511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:36.720511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:36.720511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:36.720511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:36.720511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:36.720511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:36.720511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:36.720511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:36.720511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:36.720511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:36.720511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:36.720511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:36.720511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:36.721261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:36.721261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:36.721261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:36.721261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:36.721261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:36.721261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:36.721261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:36.721261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:36.721261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:36.721261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:36.721261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:36.721261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:36.729628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 279/546] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:43:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:36.732624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416116d-47ff-4289-9d10-6746860783a2 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:36.735341 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1852e5d-49b9-4a54-b9fc-3dc41ec0fb3d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:36.795918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2266d6-809e-4349-883c-61fa2d20e7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:36.796567 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2266d6-809e-4349-883c-61fa2d20e7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:36.796845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2266d6-809e-4349-883c-61fa2d20e7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:36.797110 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2266d6-809e-4349-883c-61fa2d20e7d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:36.820231 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2266d6-809e-4349-883c-61fa2d20e7d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:36.823683 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:36.824927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-cd2266d6-809e-4349-883c-61fa2d20e7d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:36.824927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:36.824927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:36.824927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:36.824927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:36.824927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:36.824927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:36.824927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:36.824927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:36.824927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:36.824927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:36.824927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:36.824927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:36.824927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:36.824927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:36.824927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:36.826335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:36.826335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:36.826335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:36.826335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:36.826335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:36.826335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:36.826335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:36.826335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:36.826335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:36.826335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:36.826335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:36.826335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:36.826335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:36.826335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:36.826335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:36.826335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:36.827278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:36.827278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:36.827278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:36.827278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:36.827278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:36.827278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:36.827278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:36.827278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:36.827278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:36.827278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:36.827278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:36.827278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:36.835279 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 268/547] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:43:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:43:36.841775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2266d6-809e-4349-883c-61fa2d20e7d9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:36.885294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1852e5d-49b9-4a54-b9fc-3dc41ec0fb3d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:36.923201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:36.935162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c2064-e34c-40e2-93c6-056f3367d736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:36.937700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c2064-e34c-40e2-93c6-056f3367d736 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:36.937700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c2064-e34c-40e2-93c6-056f3367d736 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:36.937700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c2064-e34c-40e2-93c6-056f3367d736 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:36.937700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c2064-e34c-40e2-93c6-056f3367d736 None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:36.937700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c2064-e34c-40e2-93c6-056f3367d736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:36.942784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c2064-e34c-40e2-93c6-056f3367d736 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:36.959230 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 280/548] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Aug 11 10:43:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:36.960123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c2064-e34c-40e2-93c6-056f3367d736 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:36.972404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2266d6-809e-4349-883c-61fa2d20e7d9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:37.028262 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745770f8-4015-4318-95b6-99c58e216372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:37.028886 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745770f8-4015-4318-95b6-99c58e216372 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:37.029171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745770f8-4015-4318-95b6-99c58e216372 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:37.034586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745770f8-4015-4318-95b6-99c58e216372 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:37.034848 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745770f8-4015-4318-95b6-99c58e216372 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:37.035161 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745770f8-4015-4318-95b6-99c58e216372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:37.036685 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745770f8-4015-4318-95b6-99c58e216372 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:37.046545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 269/549] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Aug 11 10:43:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:37.055723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745770f8-4015-4318-95b6-99c58e216372 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:37.081057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c2064-e34c-40e2-93c6-056f3367d736 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:37.099377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:37.133080 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1767c7-b4a6-42a0-b173-0971d38bf72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:37.133966 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1767c7-b4a6-42a0-b173-0971d38bf72a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:37.134390 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1767c7-b4a6-42a0-b173-0971d38bf72a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:37.134825 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1767c7-b4a6-42a0-b173-0971d38bf72a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:37.155386 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1767c7-b4a6-42a0-b173-0971d38bf72a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:37.157073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1767c7-b4a6-42a0-b173-0971d38bf72a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:37.181618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-7c1767c7-b4a6-42a0-b173-0971d38bf72a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:37.181618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:37.181618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:37.181618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:37.181618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:37.181618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:37.181618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:37.181618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:37.181618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:37.181618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:37.181618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:37.181618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:37.181618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:37.181618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:37.181618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:37.181618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:37.182738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:37.182738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:37.182738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:37.182738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:37.182738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:37.182738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:37.182738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:37.182738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:37.182738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:37.182738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:37.182738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:37.182738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:37.182738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:37.182738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:37.182738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:37.182738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:37.182738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:37.183820 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:37.183820 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:37.183820 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:37.190126 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745770f8-4015-4318-95b6-99c58e216372 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:37.190552 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 281/550] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:37.196307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1767c7-b4a6-42a0-b173-0971d38bf72a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:37.201788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:37.240042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fb971-1ab4-48b4-80fe-7c766d86c280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:37.240694 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fb971-1ab4-48b4-80fe-7c766d86c280 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:37.240974 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fb971-1ab4-48b4-80fe-7c766d86c280 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:37.241255 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fb971-1ab4-48b4-80fe-7c766d86c280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:37.266009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fb971-1ab4-48b4-80fe-7c766d86c280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:37.268177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fb971-1ab4-48b4-80fe-7c766d86c280 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:37.298194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-4c9fb971-1ab4-48b4-80fe-7c766d86c280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:37.298194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:37.298194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:37.298194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:37.298194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:37.298194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:37.298194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:37.298194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:37.298194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:37.298194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:37.298194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:37.298194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:37.298194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:37.298194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:37.298194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:37.298194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:37.299865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:37.299865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:37.299865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:37.299865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:37.299865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:37.299865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:37.299865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:37.299865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:37.299865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:37.299865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:37.299865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:37.299865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:37.299865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:37.299865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:37.299865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:37.299865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:37.299865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:37.300886 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:37.300886 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:37.300886 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:37.307339 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 270/551] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:37.313158 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fb971-1ab4-48b4-80fe-7c766d86c280 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:37.382984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1767c7-b4a6-42a0-b173-0971d38bf72a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:37.440338 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b771400-5fec-44a9-8165-d169f9926328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:37.441337 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b771400-5fec-44a9-8165-d169f9926328 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:37.441839 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b771400-5fec-44a9-8165-d169f9926328 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:37.442305 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b771400-5fec-44a9-8165-d169f9926328 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:37.443176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b771400-5fec-44a9-8165-d169f9926328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:37.444029 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b771400-5fec-44a9-8165-d169f9926328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:37.445746 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b771400-5fec-44a9-8165-d169f9926328 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:37.459873 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 282/552] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:37.467504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b771400-5fec-44a9-8165-d169f9926328 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:37.502236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:37.545825 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fb971-1ab4-48b4-80fe-7c766d86c280 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:37.586993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d76ca-b1cd-42ee-82b3-75b62068a1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:37.588340 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d76ca-b1cd-42ee-82b3-75b62068a1eb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:37.588876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d76ca-b1cd-42ee-82b3-75b62068a1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:37.589299 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d76ca-b1cd-42ee-82b3-75b62068a1eb None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:37.591345 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d76ca-b1cd-42ee-82b3-75b62068a1eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:37.592225 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d76ca-b1cd-42ee-82b3-75b62068a1eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:37.594199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d76ca-b1cd-42ee-82b3-75b62068a1eb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:37.594601 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b771400-5fec-44a9-8165-d169f9926328 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:37.612777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 271/553] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:37.614989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c9552-1d94-4d51-8821-5b8fc1b0ac35 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:37.615461 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c9552-1d94-4d51-8821-5b8fc1b0ac35 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:37.615935 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c9552-1d94-4d51-8821-5b8fc1b0ac35 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:37.618284 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 272/554] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:37.619259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c9552-1d94-4d51-8821-5b8fc1b0ac35 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:37.641490 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309e0b2-a04f-4829-aa60-90d302ecb375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:37.642677 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309e0b2-a04f-4829-aa60-90d302ecb375 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:37.643554 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309e0b2-a04f-4829-aa60-90d302ecb375 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:37.644010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309e0b2-a04f-4829-aa60-90d302ecb375 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:37.652721 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:37.656586 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309e0b2-a04f-4829-aa60-90d302ecb375 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:37.659041 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309e0b2-a04f-4829-aa60-90d302ecb375 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:37.675377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-f309e0b2-a04f-4829-aa60-90d302ecb375 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 10:43:37.675377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:37.675377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:37.675377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:37.675377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:37.675377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:37.675377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:37.675377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:37.675377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:37.675377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:37.675377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:37.675377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:37.675377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:43:37.675377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:43:37.675377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:43:37.675377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:43:37.676320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:37.676320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:37.676320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:43:37.676320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:37.676320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:43:37.676320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:37.676320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:37.676320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:37.676320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:37.676320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:37.676320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:37.676320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:37.676320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:37.676320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:37.676320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:37.676320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:37.676320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:37.676320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:37.677225 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:37.677225 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:37.677225 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:43:37.677225 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:43:37.677225 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:43:37.677225 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:43:37.677225 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:43:37.677225 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:43:37.677225 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 10:43:37.677225 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:37.684605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 283/555] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Aug 11 10:43:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:43:37.684605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1c9c4-b0dc-4799-90a7-6831459af3a8 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:37.684605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1c9c4-b0dc-4799-90a7-6831459af3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:37.684964 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1c9c4-b0dc-4799-90a7-6831459af3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:37.704953 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-8bd1c9c4-b0dc-4799-90a7-6831459af3a8 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:37.706219 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8bd1c9c4-b0dc-4799-90a7-6831459af3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:37.759506 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408c9552-1d94-4d51-8821-5b8fc1b0ac35 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:37.787938 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 284/556] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:37.794079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1c9c4-b0dc-4799-90a7-6831459af3a8 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:37.809919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035774d-d5e8-4c6d-b1af-7279c93238f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:37.810953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035774d-d5e8-4c6d-b1af-7279c93238f8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:37.811457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035774d-d5e8-4c6d-b1af-7279c93238f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:37.811951 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035774d-d5e8-4c6d-b1af-7279c93238f8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:37.819867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035774d-d5e8-4c6d-b1af-7279c93238f8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:37.821585 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035774d-d5e8-4c6d-b1af-7279c93238f8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:37.830377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:37.848717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b035774d-d5e8-4c6d-b1af-7279c93238f8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 11 10:43:37.848717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:37.848717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:37.848717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:37.848717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:37.848717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:37.848717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:37.848717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:37.848717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:37.848717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:37.848717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:37.848717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:37.848717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:43:37.848717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:43:37.848717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:43:37.848717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:43:37.849686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:37.849686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:37.849686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:43:37.849686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:37.849686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:43:37.849686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:37.849686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:37.849686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:37.849686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:37.849686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:37.849686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:37.849686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:37.849686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:37.849686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:37.849686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:37.849686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:37.849686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:37.849686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:37.851127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:37.851127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:37.851127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:43:37.851127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:43:37.851127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:43:37.851127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:43:37.851127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:43:37.851127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:43:37.851127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 11 10:43:37.851127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:37.853442 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 273/557] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:43:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:37.854488 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035774d-d5e8-4c6d-b1af-7279c93238f8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:37.924539 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1c9c4-b0dc-4799-90a7-6831459af3a8 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:37.948899 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:37.962152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72ec13-2fa9-4ab4-bc40-a7a4532584d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:37.963021 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72ec13-2fa9-4ab4-bc40-a7a4532584d1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:37.963445 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72ec13-2fa9-4ab4-bc40-a7a4532584d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:37.963763 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035774d-d5e8-4c6d-b1af-7279c93238f8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:37.964047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72ec13-2fa9-4ab4-bc40-a7a4532584d1 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:37.965555 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72ec13-2fa9-4ab4-bc40-a7a4532584d1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:37.966004 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72ec13-2fa9-4ab4-bc40-a7a4532584d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:37.967628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72ec13-2fa9-4ab4-bc40-a7a4532584d1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:37.991711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 285/558] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Aug 11 10:43:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:37.992926 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72ec13-2fa9-4ab4-bc40-a7a4532584d1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:37.999375 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d7d57-73b6-48c5-8e17-9b50ee745799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:38.000003 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d7d57-73b6-48c5-8e17-9b50ee745799 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:38.000282 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d7d57-73b6-48c5-8e17-9b50ee745799 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:38.000553 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d7d57-73b6-48c5-8e17-9b50ee745799 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:38.010824 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d7d57-73b6-48c5-8e17-9b50ee745799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:38.015500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-541d7d57-73b6-48c5-8e17-9b50ee745799 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:38.015500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:38.015500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:38.015500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:38.015500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:38.015500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:38.015500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:38.015500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:38.015500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:38.015500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:38.015500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:38.015500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:38.015500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:38.015500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:38.015500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:38.015500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:38.021325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:38.021325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:38.021325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:38.021325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:38.021325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:38.021325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:38.021325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:38.021325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:38.021325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:38.021325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:38.021325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:38.021325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:38.021325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:38.021325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:38.021325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:38.021325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:38.022172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:38.022172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:38.022172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:38.022172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:38.022172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:38.022172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:38.022172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:38.022172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:38.022172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:38.022172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:38.022172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:38.022172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:38.022172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 274/559] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:43:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:38.022172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8972cfd-ce84-4e7d-9d3b-fa349d5d1899 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:38.022922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8972cfd-ce84-4e7d-9d3b-fa349d5d1899 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:38.022922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8972cfd-ce84-4e7d-9d3b-fa349d5d1899 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:38.022922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 275/560] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:38.022922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8972cfd-ce84-4e7d-9d3b-fa349d5d1899 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:38.080157 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:38.102140 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72ec13-2fa9-4ab4-bc40-a7a4532584d1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:38.136588 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8972cfd-ce84-4e7d-9d3b-fa349d5d1899 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:38.138175 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8417d-6f4a-49d0-a34e-23bfc3802ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:38.138804 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8417d-6f4a-49d0-a34e-23bfc3802ebd None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:38.139084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8417d-6f4a-49d0-a34e-23bfc3802ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:38.139353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8417d-6f4a-49d0-a34e-23bfc3802ebd None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:38.140088 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8417d-6f4a-49d0-a34e-23bfc3802ebd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:38.140389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8417d-6f4a-49d0-a34e-23bfc3802ebd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:38.141804 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8417d-6f4a-49d0-a34e-23bfc3802ebd None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:38.166548 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 286/561] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Aug 11 10:43:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:38.166548 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8417d-6f4a-49d0-a34e-23bfc3802ebd None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:38.175845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90962c1-3472-4394-bd9d-84f51a5fbac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:38.176413 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90962c1-3472-4394-bd9d-84f51a5fbac3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:38.176692 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90962c1-3472-4394-bd9d-84f51a5fbac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:38.176966 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90962c1-3472-4394-bd9d-84f51a5fbac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:38.187558 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90962c1-3472-4394-bd9d-84f51a5fbac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:38.189006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90962c1-3472-4394-bd9d-84f51a5fbac3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:38.196845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:38.204360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f90962c1-3472-4394-bd9d-84f51a5fbac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:38.204360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:38.204360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:38.204360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:38.204360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:38.204360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:38.204360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:38.204360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:38.204360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:38.204360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:38.204360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:38.204360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:38.204360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:38.204360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:38.204360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:38.204360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:38.205361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:38.205361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:38.205361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:38.205361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:38.205361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:38.205361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:38.205361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:38.205361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:38.205361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:38.205361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:38.205361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:38.205361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:38.205361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:38.205361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:38.205361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:38.205361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:38.205361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:38.206601 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:38.206601 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:38.206601 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:38.209031 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 276/562] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:38.210328 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e40380-ef9d-465a-80a6-12f3327e8aa4 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:38.211794 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e40380-ef9d-465a-80a6-12f3327e8aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:38.211794 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e40380-ef9d-465a-80a6-12f3327e8aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:38.229012 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-06e40380-ef9d-465a-80a6-12f3327e8aa4 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:38.231070 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-06e40380-ef9d-465a-80a6-12f3327e8aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:38.268400 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8417d-6f4a-49d0-a34e-23bfc3802ebd None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:38.298380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 277/563] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:38.299241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e40380-ef9d-465a-80a6-12f3327e8aa4 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:38.311295 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b844b24-ebff-4fe4-bba4-12e0f9034b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:38.312201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b844b24-ebff-4fe4-bba4-12e0f9034b58 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:38.312543 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b844b24-ebff-4fe4-bba4-12e0f9034b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:38.312810 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b844b24-ebff-4fe4-bba4-12e0f9034b58 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:38.313486 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b844b24-ebff-4fe4-bba4-12e0f9034b58 None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:38.313789 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b844b24-ebff-4fe4-bba4-12e0f9034b58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:38.315189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b844b24-ebff-4fe4-bba4-12e0f9034b58 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:38.317750 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:38.324621 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 287/564] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Aug 11 10:43:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:38.325819 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508ec81-6e48-4e4f-9aad-b29fcc10a1e1 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:38.329686 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508ec81-6e48-4e4f-9aad-b29fcc10a1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:38.329686 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508ec81-6e48-4e4f-9aad-b29fcc10a1e1 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:38.329686 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 288/565] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:38.329686 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508ec81-6e48-4e4f-9aad-b29fcc10a1e1 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:38.403852 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e40380-ef9d-465a-80a6-12f3327e8aa4 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:38.430282 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:38.430734 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508ec81-6e48-4e4f-9aad-b29fcc10a1e1 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:38.438006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fb714-402b-4737-bf40-ed5f7fb61ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:38.438608 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fb714-402b-4737-bf40-ed5f7fb61ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:38.438917 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fb714-402b-4737-bf40-ed5f7fb61ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:38.439190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fb714-402b-4737-bf40-ed5f7fb61ad5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:38.463554 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d971fa-e1a3-4e05-9908-ba708319b177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:38.464156 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d971fa-e1a3-4e05-9908-ba708319b177 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:38.465288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d971fa-e1a3-4e05-9908-ba708319b177 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:38.465288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d971fa-e1a3-4e05-9908-ba708319b177 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:38.465992 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d971fa-e1a3-4e05-9908-ba708319b177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:38.466294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d971fa-e1a3-4e05-9908-ba708319b177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:38.467740 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d971fa-e1a3-4e05-9908-ba708319b177 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:38.479008 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 289/566] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:38.479797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d971fa-e1a3-4e05-9908-ba708319b177 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:38.507987 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fb714-402b-4737-bf40-ed5f7fb61ad5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:38.509436 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8fb714-402b-4737-bf40-ed5f7fb61ad5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:38.536623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:38.576771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d971fa-e1a3-4e05-9908-ba708319b177 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:38.609381 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 278/567] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:43:38.610219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fb714-402b-4737-bf40-ed5f7fb61ad5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:38.610708 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b02f3-a6ef-4c12-ad73-81b5e8e1488f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:38.611387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b02f3-a6ef-4c12-ad73-81b5e8e1488f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:38.611666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b02f3-a6ef-4c12-ad73-81b5e8e1488f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:38.611935 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b02f3-a6ef-4c12-ad73-81b5e8e1488f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:38.622742 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232b02f3-a6ef-4c12-ad73-81b5e8e1488f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:38.627404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-232b02f3-a6ef-4c12-ad73-81b5e8e1488f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:38.627404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:38.627404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:38.627404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:38.627404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:38.627404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:38.627404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:38.627404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:38.627404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:38.627404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:38.627404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:38.627404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:38.627404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:38.627404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:38.627404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:38.627404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:38.628271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:38.628271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:38.628271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:38.628271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:38.628271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:38.628271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:38.628271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:38.628271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:38.628271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:38.628271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:38.628271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:38.628271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:38.628271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:38.628271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:38.628271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:38.628271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:38.629292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:38.629292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:38.629292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:38.629292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:38.629292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:38.629292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:38.629292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:38.629292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:38.629292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:38.629292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:38.629292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:38.629292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:38.629292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 290/568] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:43:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:38.630176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc0df6-de78-4679-b81c-c1ca39edbd7c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:38.630176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc0df6-de78-4679-b81c-c1ca39edbd7c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:38.630429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc0df6-de78-4679-b81c-c1ca39edbd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:38.640531 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:38.647710 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-edfc0df6-de78-4679-b81c-c1ca39edbd7c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:38.648882 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-edfc0df6-de78-4679-b81c-c1ca39edbd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:38.711456 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fb714-402b-4737-bf40-ed5f7fb61ad5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:38.713979 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 291/569] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:38.715589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc0df6-de78-4679-b81c-c1ca39edbd7c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:38.746339 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bc12a-1167-4096-afee-5c18fd5181b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:38.747301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bc12a-1167-4096-afee-5c18fd5181b2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:38.747582 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bc12a-1167-4096-afee-5c18fd5181b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:38.747856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bc12a-1167-4096-afee-5c18fd5181b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:38.757619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bc12a-1167-4096-afee-5c18fd5181b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:38.759098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bc12a-1167-4096-afee-5c18fd5181b2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:38.773811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-847bc12a-1167-4096-afee-5c18fd5181b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:38.773811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:38.773811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:38.773811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:38.773811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:38.773811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:38.773811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:38.773811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:38.773811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:38.773811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:38.773811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:38.773811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:38.773811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:38.773811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:38.773811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:38.773811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:38.774956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:38.774956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:38.774956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:38.774956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:38.774956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:38.774956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:38.774956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:38.774956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:38.774956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:38.774956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:38.774956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:38.774956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:38.774956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:38.774956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:38.774956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:38.774956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:38.774956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:38.776060 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:38.776060 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:38.776060 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:38.776060 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 279/570] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:38.776060 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bc12a-1167-4096-afee-5c18fd5181b2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:38.785772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:38.837325 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc0df6-de78-4679-b81c-c1ca39edbd7c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:38.854898 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:38.870436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36d3e1-58d8-4edc-8c00-41ced5794b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:38.871877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36d3e1-58d8-4edc-8c00-41ced5794b08 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:38.871997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36d3e1-58d8-4edc-8c00-41ced5794b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:38.872245 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36d3e1-58d8-4edc-8c00-41ced5794b08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:38.874012 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bc12a-1167-4096-afee-5c18fd5181b2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:38.878772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36d3e1-58d8-4edc-8c00-41ced5794b08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:38.880234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36d3e1-58d8-4edc-8c00-41ced5794b08 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:38.891872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-ab36d3e1-58d8-4edc-8c00-41ced5794b08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:38.891872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:38.891872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:38.891872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:38.891872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:38.891872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:38.891872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:38.891872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:38.891872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:38.891872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:38.891872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:38.891872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:38.891872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:43:38.891872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:43:38.891872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:43:38.892933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:43:38.892933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:38.892933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:38.892933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:38.892933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:38.892933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:38.892933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:38.892933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:38.892933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:38.892933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:38.892933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:38.892933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:38.892933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:38.892933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:38.892933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:38.892933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:38.892933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:38.894182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:43:38.894182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:43:38.894182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:43:38.894182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:43:38.894182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:43:38.894182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:43:38.894182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:38.894182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:38.894182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 292/571] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:38.894182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36d3e1-58d8-4edc-8c00-41ced5794b08 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:38.911699 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9f6df-c0c0-491c-a73f-f9958bfeb72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:38.912336 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9f6df-c0c0-491c-a73f-f9958bfeb72f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:38.912618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9f6df-c0c0-491c-a73f-f9958bfeb72f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:38.912897 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9f6df-c0c0-491c-a73f-f9958bfeb72f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:38.922988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9f6df-c0c0-491c-a73f-f9958bfeb72f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:38.924441 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9f6df-c0c0-491c-a73f-f9958bfeb72f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:38.939318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c9a9f6df-c0c0-491c-a73f-f9958bfeb72f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:38.939318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:38.939318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:38.939318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:38.939318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:38.939318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:38.939318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:38.939318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:38.939318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:38.939318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:38.939318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:38.939318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:38.939318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:38.939318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:38.939318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:38.939318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:38.940455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:38.940455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:38.940455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:38.940455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:38.940455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:38.940455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:38.940455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:38.940455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:38.940455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:38.940455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:38.940455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:38.940455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:38.940455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:38.940455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:38.940455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:38.940455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:38.940455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:38.941312 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:38.941312 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:38.941312 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:38.941312 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 280/572] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:38.941312 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9f6df-c0c0-491c-a73f-f9958bfeb72f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:38.996178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36d3e1-58d8-4edc-8c00-41ced5794b08 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:39.004781 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:39.028995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4f378-a0fe-4e21-9e28-6729d11f1f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:39.029599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4f378-a0fe-4e21-9e28-6729d11f1f8b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:39.032609 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4f378-a0fe-4e21-9e28-6729d11f1f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:39.032609 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4f378-a0fe-4e21-9e28-6729d11f1f8b None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:39.032609 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4f378-a0fe-4e21-9e28-6729d11f1f8b None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:39.032609 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4f378-a0fe-4e21-9e28-6729d11f1f8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:39.032609 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4f378-a0fe-4e21-9e28-6729d11f1f8b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:39.040882 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 293/573] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Aug 11 10:43:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:39.041669 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4f378-a0fe-4e21-9e28-6729d11f1f8b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:39.052007 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9f6df-c0c0-491c-a73f-f9958bfeb72f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:39.081461 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:39.085992 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7e694-911e-48ea-940f-0bc916235961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:39.086613 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7e694-911e-48ea-940f-0bc916235961 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:39.086918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7e694-911e-48ea-940f-0bc916235961 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:39.087190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7e694-911e-48ea-940f-0bc916235961 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:39.098043 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7e694-911e-48ea-940f-0bc916235961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:39.102633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e9a7e694-911e-48ea-940f-0bc916235961 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:39.102633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:39.102633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:39.102633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:39.102633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:39.102633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:39.102633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:39.102633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:39.102633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:39.102633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:39.102633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:39.102633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:39.102633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:39.102633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:39.102633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:39.102633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:39.103765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:39.103765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:39.103765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:39.103765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:39.103765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:39.103765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:39.103765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:39.103765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:39.103765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:39.103765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:39.103765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:39.103765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:39.103765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:39.103765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:39.103765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:39.103765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:39.104606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:39.104606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:39.104606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:39.104606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:39.104606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:39.104606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:39.104606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:39.104606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:39.104606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:39.104606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:39.104606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:39.104606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:39.104606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 281/574] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:43:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:39.104606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7e694-911e-48ea-940f-0bc916235961 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:39.144281 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4f378-a0fe-4e21-9e28-6729d11f1f8b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:39.178148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5d6a5-f5ac-426d-ac27-6cf22dc4f597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:39.178787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5d6a5-f5ac-426d-ac27-6cf22dc4f597 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:39.179069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5d6a5-f5ac-426d-ac27-6cf22dc4f597 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:39.179346 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5d6a5-f5ac-426d-ac27-6cf22dc4f597 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:39.179988 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5d6a5-f5ac-426d-ac27-6cf22dc4f597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:39.180295 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5d6a5-f5ac-426d-ac27-6cf22dc4f597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:39.181668 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5d6a5-f5ac-426d-ac27-6cf22dc4f597 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:39.193452 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 294/575] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:39.194273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5d6a5-f5ac-426d-ac27-6cf22dc4f597 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:39.204120 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7e694-911e-48ea-940f-0bc916235961 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:39.225466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:39.237607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e624f-c55f-43bc-8132-dfe9f7db69dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:39.238215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e624f-c55f-43bc-8132-dfe9f7db69dd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:39.238497 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e624f-c55f-43bc-8132-dfe9f7db69dd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:39.238780 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e624f-c55f-43bc-8132-dfe9f7db69dd None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:39.239479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e624f-c55f-43bc-8132-dfe9f7db69dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:39.239783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e624f-c55f-43bc-8132-dfe9f7db69dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:39.241220 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e624f-c55f-43bc-8132-dfe9f7db69dd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:39.253168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 282/576] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:43:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:39.253896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e624f-c55f-43bc-8132-dfe9f7db69dd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:39.295073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5d6a5-f5ac-426d-ac27-6cf22dc4f597 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:39.305779 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:39.328306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a940b-a17a-4194-b9d3-164b114cd585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:39.328900 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a940b-a17a-4194-b9d3-164b114cd585 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:39.329176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a940b-a17a-4194-b9d3-164b114cd585 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:39.329441 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a940b-a17a-4194-b9d3-164b114cd585 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:39.330067 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a940b-a17a-4194-b9d3-164b114cd585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:39.330363 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a940b-a17a-4194-b9d3-164b114cd585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:39.331742 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a940b-a17a-4194-b9d3-164b114cd585 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:39.343595 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 295/577] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:39.344394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a940b-a17a-4194-b9d3-164b114cd585 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:39.352524 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e624f-c55f-43bc-8132-dfe9f7db69dd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:39.385037 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc26fc-109d-40b7-967e-77f7e9df5387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:39.385659 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc26fc-109d-40b7-967e-77f7e9df5387 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:39.385935 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc26fc-109d-40b7-967e-77f7e9df5387 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:39.386724 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc26fc-109d-40b7-967e-77f7e9df5387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:39.398324 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc26fc-109d-40b7-967e-77f7e9df5387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:39.399798 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc26fc-109d-40b7-967e-77f7e9df5387 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:39.413805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b6dc26fc-109d-40b7-967e-77f7e9df5387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:39.413805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:39.413805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:39.413805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:39.413805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:39.413805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:39.413805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:39.413805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:39.413805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:39.413805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:39.413805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:39.413805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:39.413805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:39.413805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:39.413805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:39.413805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:39.414702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:39.414702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:39.414702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:39.414702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:39.414702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:39.414702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:39.414702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:39.414702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:39.414702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:39.414702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:39.414702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:39.414702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:39.414702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:39.414702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:39.414702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:39.414702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:39.414702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:39.415599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:39.415599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:39.415599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:39.415599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 283/578] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:39.415816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc26fc-109d-40b7-967e-77f7e9df5387 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:39.435499 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:39.444239 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a940b-a17a-4194-b9d3-164b114cd585 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:39.476951 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523de706-fd3d-4b5e-b84a-9f6b2e2bb52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:39.477654 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523de706-fd3d-4b5e-b84a-9f6b2e2bb52d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:39.477942 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523de706-fd3d-4b5e-b84a-9f6b2e2bb52d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:39.478215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523de706-fd3d-4b5e-b84a-9f6b2e2bb52d None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:39.478914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523de706-fd3d-4b5e-b84a-9f6b2e2bb52d None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:39.479424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523de706-fd3d-4b5e-b84a-9f6b2e2bb52d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:39.481341 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523de706-fd3d-4b5e-b84a-9f6b2e2bb52d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:39.489873 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 296/579] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Aug 11 10:43:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:39.490748 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523de706-fd3d-4b5e-b84a-9f6b2e2bb52d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:39.521535 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc26fc-109d-40b7-967e-77f7e9df5387 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:39.523714 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:39.554563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a804048-3db6-46d0-936a-3139ae9a9237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:39.555219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a804048-3db6-46d0-936a-3139ae9a9237 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:39.555499 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a804048-3db6-46d0-936a-3139ae9a9237 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:39.555771 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a804048-3db6-46d0-936a-3139ae9a9237 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:39.563209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a804048-3db6-46d0-936a-3139ae9a9237 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:39.565022 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a804048-3db6-46d0-936a-3139ae9a9237 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:39.576316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-4a804048-3db6-46d0-936a-3139ae9a9237 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 11 10:43:39.576316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:39.576316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:39.576316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:39.576316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:39.576316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:39.576316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:39.576316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:39.576316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:39.576316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:39.576316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:39.576316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:39.576316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:43:39.576316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:43:39.576316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:43:39.576316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:43:39.577380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:39.577380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:39.577380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:43:39.577380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:39.577380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:43:39.577380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:39.577380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:39.577380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:39.577380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:39.577380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:39.577380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:39.577380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:39.577380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:39.577380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:39.577380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:39.577380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:39.577380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:39.577380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:39.578478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:39.578478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:39.578478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:43:39.578478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:43:39.578478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:43:39.578478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:43:39.578478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:43:39.578478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:43:39.578478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 11 10:43:39.578478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:39.578478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 284/580] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:39.578478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a804048-3db6-46d0-936a-3139ae9a9237 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:39.592831 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523de706-fd3d-4b5e-b84a-9f6b2e2bb52d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:39.626713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74084939-863e-4781-840d-0a83ad8e6911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:39.627424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74084939-863e-4781-840d-0a83ad8e6911 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:39.627710 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74084939-863e-4781-840d-0a83ad8e6911 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:39.627982 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74084939-863e-4781-840d-0a83ad8e6911 None admin] PATH_INFO: `/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/9267752ac6724013bc1edcdecff48dd7/roles/6de833fef4c9456cb5d8ad66caf96586` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:39.642731 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74084939-863e-4781-840d-0a83ad8e6911 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb12c96bf3a84df0b86967fbe93d1c17, user_id=9267752ac6724013bc1edcdecff48dd7, role_id=6de833fef4c9456cb5d8ad66caf96586)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:39.644207 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74084939-863e-4781-840d-0a83ad8e6911 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:39.675861 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a804048-3db6-46d0-936a-3139ae9a9237 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:39.709384 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e8ac2-6c62-4257-8226-e5e4e09c5f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:39.710124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e8ac2-6c62-4257-8226-e5e4e09c5f44 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:39.710407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e8ac2-6c62-4257-8226-e5e4e09c5f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:39.710679 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e8ac2-6c62-4257-8226-e5e4e09c5f44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:39.714692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 297/581] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:43:39 2022] PUT /identity/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/9267752ac6724013bc1edcdecff48dd7/roles/6de833fef4c9456cb5d8ad66caf96586 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:43:39.715642 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74084939-863e-4781-840d-0a83ad8e6911 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:39.718745 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:39.720260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e8ac2-6c62-4257-8226-e5e4e09c5f44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:39.721817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e8ac2-6c62-4257-8226-e5e4e09c5f44 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:39.734903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-138e8ac2-6c62-4257-8226-e5e4e09c5f44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:39.734903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:39.734903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:39.734903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:39.734903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:39.734903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:39.734903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:39.734903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:39.734903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:39.734903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:39.734903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:39.734903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:39.734903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:43:39.734903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:43:39.734903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:43:39.736019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:43:39.736019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:39.736019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:39.736019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:39.736019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:39.736019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:39.736019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:39.736019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:39.736019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:39.736019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:39.736019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:39.736019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:39.736019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:39.736019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:39.736019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:39.736019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:39.736019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:39.737035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:43:39.737035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:43:39.737035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:43:39.737035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:43:39.737035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:43:39.737035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:43:39.737035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:39.737035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:39.737035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 285/582] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:39.737660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e8ac2-6c62-4257-8226-e5e4e09c5f44 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:39.768184 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:39.842374 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74084939-863e-4781-840d-0a83ad8e6911 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:39.857479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e8ac2-6c62-4257-8226-e5e4e09c5f44 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:39.893763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397eb556-3bb1-4682-978f-4b7ed197069c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:39.894442 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397eb556-3bb1-4682-978f-4b7ed197069c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:39.894636 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397eb556-3bb1-4682-978f-4b7ed197069c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:39.894936 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397eb556-3bb1-4682-978f-4b7ed197069c None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:39.895582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397eb556-3bb1-4682-978f-4b7ed197069c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:39.895880 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397eb556-3bb1-4682-978f-4b7ed197069c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:39.897238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397eb556-3bb1-4682-978f-4b7ed197069c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:39.900993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7685bcc-0b59-4f5a-9066-6ae40b854c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:39.901621 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7685bcc-0b59-4f5a-9066-6ae40b854c9a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:39.901955 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7685bcc-0b59-4f5a-9066-6ae40b854c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:39.902228 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7685bcc-0b59-4f5a-9066-6ae40b854c9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:39.908459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 298/583] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:39.909272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397eb556-3bb1-4682-978f-4b7ed197069c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:39.913213 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7685bcc-0b59-4f5a-9066-6ae40b854c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:39.914710 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7685bcc-0b59-4f5a-9066-6ae40b854c9a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:39.929946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-d7685bcc-0b59-4f5a-9066-6ae40b854c9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:39.929946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:39.929946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:39.929946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:39.929946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:39.929946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:39.929946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:39.929946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:39.929946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:39.929946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:39.929946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:39.929946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:39.929946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:39.929946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:39.929946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:39.929946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:39.931081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:39.931081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:39.931081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:39.931081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:39.931081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:39.931081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:39.931081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:39.931081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:39.931081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:39.931081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:39.931081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:39.931081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:39.931081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:39.931081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:39.931081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:39.931081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:39.931081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:39.932125 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:39.932125 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:39.932125 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:39.932125 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 286/584] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:39.932384 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7685bcc-0b59-4f5a-9066-6ae40b854c9a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:39.986454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:40.013842 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:40.037325 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397eb556-3bb1-4682-978f-4b7ed197069c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:40.042979 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7685bcc-0b59-4f5a-9066-6ae40b854c9a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:40.073573 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc23c7-6c45-4b74-b4d1-19db20e4a3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:40.074861 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc23c7-6c45-4b74-b4d1-19db20e4a3ea None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:40.075271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc23c7-6c45-4b74-b4d1-19db20e4a3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:40.075611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc23c7-6c45-4b74-b4d1-19db20e4a3ea None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:40.076510 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc23c7-6c45-4b74-b4d1-19db20e4a3ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:40.076986 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc23c7-6c45-4b74-b4d1-19db20e4a3ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:40.078463 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc23c7-6c45-4b74-b4d1-19db20e4a3ea None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:40.081619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbef377-ae11-4f67-aac8-3037d67295e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:40.082305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbef377-ae11-4f67-aac8-3037d67295e5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:40.082592 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbef377-ae11-4f67-aac8-3037d67295e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:40.082899 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbef377-ae11-4f67-aac8-3037d67295e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:40.083592 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbef377-ae11-4f67-aac8-3037d67295e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:40.083899 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbef377-ae11-4f67-aac8-3037d67295e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:40.085309 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbef377-ae11-4f67-aac8-3037d67295e5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:40.102723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 287/585] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:43:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:40.102723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbef377-ae11-4f67-aac8-3037d67295e5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:40.103417 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 299/586] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Aug 11 10:43:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:40.104460 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc23c7-6c45-4b74-b4d1-19db20e4a3ea None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:40.209687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbef377-ae11-4f67-aac8-3037d67295e5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:40.213181 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc23c7-6c45-4b74-b4d1-19db20e4a3ea None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:40.239285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:40.247537 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0801c-fcbc-4718-8a9e-7dd4086afa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:40.248210 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0801c-fcbc-4718-8a9e-7dd4086afa00 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:40.248500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0801c-fcbc-4718-8a9e-7dd4086afa00 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:40.248816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0801c-fcbc-4718-8a9e-7dd4086afa00 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:40.252378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:40.254245 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df669088-1fa7-4df5-86ea-44705d280fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:40.254871 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df669088-1fa7-4df5-86ea-44705d280fbb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:40.255149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df669088-1fa7-4df5-86ea-44705d280fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:40.255443 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df669088-1fa7-4df5-86ea-44705d280fbb None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:40.256138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df669088-1fa7-4df5-86ea-44705d280fbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:40.256434 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df669088-1fa7-4df5-86ea-44705d280fbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:40.257328 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0801c-fcbc-4718-8a9e-7dd4086afa00 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:40.257802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df669088-1fa7-4df5-86ea-44705d280fbb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:40.258750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0801c-fcbc-4718-8a9e-7dd4086afa00 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:40.271368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-61b0801c-fcbc-4718-8a9e-7dd4086afa00 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 10:43:40.271368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:40.271368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:40.271368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:40.271368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:40.271368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:40.271368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:40.271368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:40.271368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:40.271368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:40.271368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:40.271368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:40.271368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:43:40.271368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:43:40.271368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:43:40.271368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:43:40.272311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:40.272311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:40.272311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:43:40.272311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:40.272311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:43:40.272311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:40.272311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:40.272311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:40.272311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:40.272311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:40.272311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:40.272311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:40.272311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:40.272311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:40.272311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:40.272311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:40.272311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:40.272311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:40.273206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:40.273206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:40.273206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:43:40.273206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:43:40.273206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:43:40.273206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:43:40.273206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:43:40.273206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:43:40.273206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 10:43:40.273206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:40.274291 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 300/587] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:40.275289 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df669088-1fa7-4df5-86ea-44705d280fbb None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:40.278110 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 288/588] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:40.279005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0801c-fcbc-4718-8a9e-7dd4086afa00 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:40.384469 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0801c-fcbc-4718-8a9e-7dd4086afa00 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:40.385101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df669088-1fa7-4df5-86ea-44705d280fbb None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:40.419693 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b27747-5b3e-4765-8924-dee0f92e0966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:40.420060 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1197b-05d7-4151-a78e-f633d9184f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:40.420319 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b27747-5b3e-4765-8924-dee0f92e0966 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:40.420596 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b27747-5b3e-4765-8924-dee0f92e0966 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:40.420707 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1197b-05d7-4151-a78e-f633d9184f40 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:40.420859 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b27747-5b3e-4765-8924-dee0f92e0966 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:40.420952 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1197b-05d7-4151-a78e-f633d9184f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:40.421186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1197b-05d7-4151-a78e-f633d9184f40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:40.421905 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1197b-05d7-4151-a78e-f633d9184f40 None admin] RBAC: Adding query filter params (role.id=6de833fef4c9456cb5d8ad66caf96586, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=cbd25d1bde0c4703b61e0edaf5b658d4) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:40.422214 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1197b-05d7-4151-a78e-f633d9184f40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:40.423672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1197b-05d7-4151-a78e-f633d9184f40 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:40.429051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 289/589] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:43:40 2022] GET /identity/v3/role_assignments?user.id=cbd25d1bde0c4703b61e0edaf5b658d4&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=6de833fef4c9456cb5d8ad66caf96586 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:40.429822 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1197b-05d7-4151-a78e-f633d9184f40 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:40.439793 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b27747-5b3e-4765-8924-dee0f92e0966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:40.441984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b27747-5b3e-4765-8924-dee0f92e0966 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:40.458823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-80b27747-5b3e-4765-8924-dee0f92e0966 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:40.458823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:40.458823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:40.458823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:40.458823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:40.458823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:40.458823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:40.458823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:40.458823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:40.458823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:40.458823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:40.458823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:40.458823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:40.458823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:40.458823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:40.458823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:40.459972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:40.459972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:40.459972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:40.459972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:40.459972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:40.459972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:40.459972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:40.459972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:40.459972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:40.459972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:40.459972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:40.459972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:40.459972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:40.459972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:40.459972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:40.459972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:40.459972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:40.461019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:40.461019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:40.461019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:40.462813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 301/590] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:40.463889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b27747-5b3e-4765-8924-dee0f92e0966 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:40.503003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:40.523191 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:40.581273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b27747-5b3e-4765-8924-dee0f92e0966 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:40.586940 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1197b-05d7-4151-a78e-f633d9184f40 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:40.626528 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dc89d-9fdb-42ee-8692-5b0664e92390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:40.627960 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dc89d-9fdb-42ee-8692-5b0664e92390 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:40.628404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dc89d-9fdb-42ee-8692-5b0664e92390 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:40.628845 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dc89d-9fdb-42ee-8692-5b0664e92390 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:40.629415 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6dc89d-9fdb-42ee-8692-5b0664e92390 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:40.629875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6dc89d-9fdb-42ee-8692-5b0664e92390 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:40.631804 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6dc89d-9fdb-42ee-8692-5b0664e92390 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:40.634999 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1670b9b-bbae-4538-ab47-191497de2c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:40.635584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1670b9b-bbae-4538-ab47-191497de2c0b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:40.635863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1670b9b-bbae-4538-ab47-191497de2c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:40.636645 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1670b9b-bbae-4538-ab47-191497de2c0b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:40.646873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1670b9b-bbae-4538-ab47-191497de2c0b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:40.648328 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1670b9b-bbae-4538-ab47-191497de2c0b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:40.659482 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 302/591] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Aug 11 10:43:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:40.659638 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dc89d-9fdb-42ee-8692-5b0664e92390 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:40.666523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b1670b9b-bbae-4538-ab47-191497de2c0b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 10:43:40.666523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:40.666523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:40.666523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:40.666523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:40.666523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:40.666523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:40.666523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:40.666523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:40.666523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:40.666523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:40.666523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:40.666523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:43:40.666523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:43:40.666523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:43:40.666523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:43:40.668112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:40.668112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:40.668112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:43:40.668112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:40.668112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:43:40.668112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:40.668112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:40.668112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:40.668112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:40.668112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:40.668112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:40.668112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:40.668112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:40.668112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:40.668112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:40.668112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:40.668112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:40.668112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:40.669879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:40.669879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:40.669879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:43:40.669879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:43:40.669879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:43:40.669879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:43:40.669879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:43:40.669879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:43:40.669879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 10:43:40.669879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:40.669879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 290/592] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:43:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:40.669879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1670b9b-bbae-4538-ab47-191497de2c0b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:40.778520 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:40.792900 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dc89d-9fdb-42ee-8692-5b0664e92390 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:40.795650 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1670b9b-bbae-4538-ab47-191497de2c0b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:40.820594 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:40.835669 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dbc28-7ccc-42a9-b013-32898a56b2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:40.836563 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dbc28-7ccc-42a9-b013-32898a56b2df None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:40.837077 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dbc28-7ccc-42a9-b013-32898a56b2df None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:40.837511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dbc28-7ccc-42a9-b013-32898a56b2df None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:40.838515 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dbc28-7ccc-42a9-b013-32898a56b2df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:40.839014 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dbc28-7ccc-42a9-b013-32898a56b2df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:40.840981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dbc28-7ccc-42a9-b013-32898a56b2df None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:40.842221 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70895a-cc57-4fe8-aa65-4cfed59d04e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:40.843416 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70895a-cc57-4fe8-aa65-4cfed59d04e5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:40.844106 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70895a-cc57-4fe8-aa65-4cfed59d04e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:40.845202 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70895a-cc57-4fe8-aa65-4cfed59d04e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:40.855778 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 303/593] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:40.857137 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dbc28-7ccc-42a9-b013-32898a56b2df None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:40.862209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70895a-cc57-4fe8-aa65-4cfed59d04e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:40.864004 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70895a-cc57-4fe8-aa65-4cfed59d04e5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:40.883864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-bd70895a-cc57-4fe8-aa65-4cfed59d04e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:40.883864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:40.883864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:40.883864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:40.883864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:40.883864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:40.883864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:40.883864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:40.883864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:40.883864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:40.883864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:40.883864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:40.883864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:40.883864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:40.883864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:40.883864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:40.885064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:40.885064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:40.885064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:40.885064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:40.885064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:40.885064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:40.885064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:40.885064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:40.885064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:40.885064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:40.885064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:40.885064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:40.885064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:40.885064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:40.885064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:40.885064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:40.885064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:40.885981 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:40.885981 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:40.885981 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:40.890849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 291/594] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:40.893767 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70895a-cc57-4fe8-aa65-4cfed59d04e5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:40.979029 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dbc28-7ccc-42a9-b013-32898a56b2df None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:41.021114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70895a-cc57-4fe8-aa65-4cfed59d04e5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:41.032574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738bec6-33ad-4034-9ed7-ff8faf85fb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:41.035266 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738bec6-33ad-4034-9ed7-ff8faf85fb86 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:41.035539 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738bec6-33ad-4034-9ed7-ff8faf85fb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:41.035818 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738bec6-33ad-4034-9ed7-ff8faf85fb86 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:41.037029 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738bec6-33ad-4034-9ed7-ff8faf85fb86 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:41.037347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738bec6-33ad-4034-9ed7-ff8faf85fb86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:41.039258 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738bec6-33ad-4034-9ed7-ff8faf85fb86 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:41.064949 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ddeee-d2fb-4d05-9bf1-355d8ad1cf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:41.065327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 304/595] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Aug 11 10:43:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:41.066079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ddeee-d2fb-4d05-9bf1-355d8ad1cf00 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:41.066278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738bec6-33ad-4034-9ed7-ff8faf85fb86 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:41.066822 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ddeee-d2fb-4d05-9bf1-355d8ad1cf00 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:41.067393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ddeee-d2fb-4d05-9bf1-355d8ad1cf00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:41.075456 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ddeee-d2fb-4d05-9bf1-355d8ad1cf00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:41.077289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ddeee-d2fb-4d05-9bf1-355d8ad1cf00 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:41.078559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:41.090778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-508ddeee-d2fb-4d05-9bf1-355d8ad1cf00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:41.090778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:41.090778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:41.090778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:41.090778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:41.090778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:41.090778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:41.090778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:41.090778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:41.090778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:41.090778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:41.090778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:41.090778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:43:41.090778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:43:41.090778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:43:41.093072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:43:41.093072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:41.093072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:41.093072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:41.093072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:41.093072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:41.093072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:41.093072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:41.093072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:41.093072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:41.093072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:41.093072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:41.093072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:41.093072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:41.093072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:41.093072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:41.093072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:41.093952 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:43:41.093952 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:43:41.093952 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:43:41.093952 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:43:41.093952 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:43:41.093952 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:43:41.093952 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:41.093952 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:41.095246 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 292/596] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:41.096254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ddeee-d2fb-4d05-9bf1-355d8ad1cf00 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:41.131286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:41.194697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738bec6-33ad-4034-9ed7-ff8faf85fb86 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:41.218522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ddeee-d2fb-4d05-9bf1-355d8ad1cf00 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:41.231144 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da475f3-fe87-4c3b-aaf5-e314ef8c3626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:41.231799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da475f3-fe87-4c3b-aaf5-e314ef8c3626 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:41.232076 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da475f3-fe87-4c3b-aaf5-e314ef8c3626 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:41.232344 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da475f3-fe87-4c3b-aaf5-e314ef8c3626 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:41.232986 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da475f3-fe87-4c3b-aaf5-e314ef8c3626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:41.233283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da475f3-fe87-4c3b-aaf5-e314ef8c3626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:41.235014 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da475f3-fe87-4c3b-aaf5-e314ef8c3626 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:41.247551 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 305/597] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:41.248732 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da475f3-fe87-4c3b-aaf5-e314ef8c3626 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:41.264710 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9be78-a0c7-4701-80ed-5ecf457567eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:41.265688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9be78-a0c7-4701-80ed-5ecf457567eb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:41.266186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9be78-a0c7-4701-80ed-5ecf457567eb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:41.266716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9be78-a0c7-4701-80ed-5ecf457567eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:41.278377 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9be78-a0c7-4701-80ed-5ecf457567eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:41.280133 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9be78-a0c7-4701-80ed-5ecf457567eb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:41.301275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-32c9be78-a0c7-4701-80ed-5ecf457567eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:41.301275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:41.301275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:41.301275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:41.301275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:41.301275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:41.301275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:41.301275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:41.301275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:41.301275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:41.301275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:41.301275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:41.301275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:41.301275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:41.301275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:41.301275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:41.302421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:41.302421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:41.302421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:41.302421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:41.302421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:41.302421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:41.302421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:41.302421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:41.302421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:41.302421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:41.302421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:41.302421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:41.302421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:41.302421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:41.302421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:41.302421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:41.302421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:41.303439 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:41.303439 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:41.303439 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:41.305783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 293/598] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:41.306998 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9be78-a0c7-4701-80ed-5ecf457567eb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:41.319116 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:41.354874 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da475f3-fe87-4c3b-aaf5-e314ef8c3626 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:41.391668 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91c812-4f77-4d8d-9752-e7d619422c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:41.392329 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91c812-4f77-4d8d-9752-e7d619422c40 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:41.392610 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91c812-4f77-4d8d-9752-e7d619422c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:41.393050 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91c812-4f77-4d8d-9752-e7d619422c40 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:41.393793 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91c812-4f77-4d8d-9752-e7d619422c40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:41.394098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91c812-4f77-4d8d-9752-e7d619422c40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:41.395961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91c812-4f77-4d8d-9752-e7d619422c40 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:41.408369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 306/599] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:43:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:41.409204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91c812-4f77-4d8d-9752-e7d619422c40 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:41.411595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:41.429267 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9be78-a0c7-4701-80ed-5ecf457567eb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:41.466962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507790c-c303-481b-a74d-711736bd7aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:41.467976 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507790c-c303-481b-a74d-711736bd7aff None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:41.468504 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507790c-c303-481b-a74d-711736bd7aff None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:41.469002 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507790c-c303-481b-a74d-711736bd7aff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:41.476270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507790c-c303-481b-a74d-711736bd7aff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:41.477978 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507790c-c303-481b-a74d-711736bd7aff None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:41.491040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e507790c-c303-481b-a74d-711736bd7aff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:41.491040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:41.491040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:41.491040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:41.491040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:41.491040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:41.491040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:41.491040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:41.491040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:41.491040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:41.491040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:41.491040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:41.491040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:43:41.491040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:43:41.491040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:43:41.491945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:43:41.491945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:41.491945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:41.491945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:41.491945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:41.491945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:41.491945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:41.491945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:41.491945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:41.491945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:41.491945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:41.491945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:41.491945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:41.491945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:41.491945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:41.491945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:41.491945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:41.492793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:43:41.492793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:43:41.492793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:43:41.492793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:43:41.492793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:43:41.492793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:43:41.492793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:41.492793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:41.499528 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 294/600] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:41.500626 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507790c-c303-481b-a74d-711736bd7aff None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:41.516332 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91c812-4f77-4d8d-9752-e7d619422c40 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:41.543984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:41.552829 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b42dd-059a-4d0e-a576-801182bdf7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:41.558113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b42dd-059a-4d0e-a576-801182bdf7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:41.558113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b42dd-059a-4d0e-a576-801182bdf7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:41.558113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b42dd-059a-4d0e-a576-801182bdf7f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:41.558113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b42dd-059a-4d0e-a576-801182bdf7f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:41.558113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b42dd-059a-4d0e-a576-801182bdf7f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:41.558113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b42dd-059a-4d0e-a576-801182bdf7f3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:41.567919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 307/601] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:41.568748 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b42dd-059a-4d0e-a576-801182bdf7f3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:41.613890 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507790c-c303-481b-a74d-711736bd7aff None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:41.651169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd621f2-24a0-4a1f-b20b-bceef7ad46d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:41.652754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd621f2-24a0-4a1f-b20b-bceef7ad46d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:41.653315 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd621f2-24a0-4a1f-b20b-bceef7ad46d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:41.653817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd621f2-24a0-4a1f-b20b-bceef7ad46d8 None admin] PATH_INFO: `/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/d4fe013f66e2452eaaf84d4b52eca489/roles/6de833fef4c9456cb5d8ad66caf96586` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:41.669726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd621f2-24a0-4a1f-b20b-bceef7ad46d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb12c96bf3a84df0b86967fbe93d1c17, user_id=d4fe013f66e2452eaaf84d4b52eca489, role_id=6de833fef4c9456cb5d8ad66caf96586)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:41.671516 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd621f2-24a0-4a1f-b20b-bceef7ad46d8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:41.674064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:41.678448 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b42dd-059a-4d0e-a576-801182bdf7f3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:41.716226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dea05d-ca48-459f-b8fb-68a8ba253ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:41.716827 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dea05d-ca48-459f-b8fb-68a8ba253ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:41.717152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dea05d-ca48-459f-b8fb-68a8ba253ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:41.717373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dea05d-ca48-459f-b8fb-68a8ba253ba6 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:41.718062 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dea05d-ca48-459f-b8fb-68a8ba253ba6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:41.718360 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dea05d-ca48-459f-b8fb-68a8ba253ba6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:41.719843 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dea05d-ca48-459f-b8fb-68a8ba253ba6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:41.737528 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 308/602] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:43:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:41.737528 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dea05d-ca48-459f-b8fb-68a8ba253ba6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:41.748410 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 295/603] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:43:41 2022] PUT /identity/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/d4fe013f66e2452eaaf84d4b52eca489/roles/6de833fef4c9456cb5d8ad66caf96586 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:43:41.752247 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd621f2-24a0-4a1f-b20b-bceef7ad46d8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:41.823124 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:41.880524 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dea05d-ca48-459f-b8fb-68a8ba253ba6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:41.882020 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd621f2-24a0-4a1f-b20b-bceef7ad46d8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:41.923216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddad78-2142-458c-aad9-0d931b5637a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:41.924187 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddad78-2142-458c-aad9-0d931b5637a0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:41.924620 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddad78-2142-458c-aad9-0d931b5637a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:41.925395 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddad78-2142-458c-aad9-0d931b5637a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:41.934389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caddad78-2142-458c-aad9-0d931b5637a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:41.934639 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a32e21-ccdb-48d3-8a13-6273e185ced1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:41.935550 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a32e21-ccdb-48d3-8a13-6273e185ced1 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:41.935979 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a32e21-ccdb-48d3-8a13-6273e185ced1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:41.936099 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caddad78-2142-458c-aad9-0d931b5637a0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:41.936497 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a32e21-ccdb-48d3-8a13-6273e185ced1 None admin] PATH_INFO: `/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/85551eadb87f496f882c4d6e984144c8/roles/6de833fef4c9456cb5d8ad66caf96586` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:41.951120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-caddad78-2142-458c-aad9-0d931b5637a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:41.951120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:41.951120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:41.951120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:41.951120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:41.951120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:41.951120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:41.951120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:41.951120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:41.951120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:41.951120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:41.951120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:41.951120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:43:41.951120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:43:41.951120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:43:41.952188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:43:41.952188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:41.952188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:41.952188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:41.952188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:41.952188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:41.952188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:41.952188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:41.952188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:41.952188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:41.952188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:41.952188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:41.952188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:41.952188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:41.952188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:41.952188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:41.952188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:41.953202 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:43:41.953202 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:43:41.953202 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:43:41.953202 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:43:41.953202 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:43:41.953202 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:43:41.953202 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:41.953202 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:41.953202 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 309/604] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:41.954168 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32652eb5-a928-43bd-8c02-77716129ab20 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:41.954560 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32652eb5-a928-43bd-8c02-77716129ab20 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:41.954858 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32652eb5-a928-43bd-8c02-77716129ab20 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:41.956467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a32e21-ccdb-48d3-8a13-6273e185ced1 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb12c96bf3a84df0b86967fbe93d1c17, user_id=85551eadb87f496f882c4d6e984144c8, role_id=6de833fef4c9456cb5d8ad66caf96586)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:41.956591 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 310/605] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:41.957786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32652eb5-a928-43bd-8c02-77716129ab20 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:41.958346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a32e21-ccdb-48d3-8a13-6273e185ced1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:42.066783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 296/606] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:43:41 2022] PUT /identity/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/85551eadb87f496f882c4d6e984144c8/roles/6de833fef4c9456cb5d8ad66caf96586 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:43:42.071625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef622f80-c31e-4886-bbe7-fc240d8365aa None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:42.071625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef622f80-c31e-4886-bbe7-fc240d8365aa None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:42.071625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef622f80-c31e-4886-bbe7-fc240d8365aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:42.072003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32652eb5-a928-43bd-8c02-77716129ab20 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:42.082454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:42.095454 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ef622f80-c31e-4886-bbe7-fc240d8365aa None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:42.096966 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ef622f80-c31e-4886-bbe7-fc240d8365aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:42.135690 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8850666-fe76-47a4-a399-4d33150be8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:42.136873 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8850666-fe76-47a4-a399-4d33150be8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:42.137199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8850666-fe76-47a4-a399-4d33150be8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:42.137411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8850666-fe76-47a4-a399-4d33150be8c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:42.138106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8850666-fe76-47a4-a399-4d33150be8c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:42.138436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8850666-fe76-47a4-a399-4d33150be8c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:42.140032 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8850666-fe76-47a4-a399-4d33150be8c5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:42.165532 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 311/607] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:43:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:42.165741 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:42.171728 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8850666-fe76-47a4-a399-4d33150be8c5 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:42.187273 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 297/608] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:42.211721 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef622f80-c31e-4886-bbe7-fc240d8365aa None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:42.344775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef622f80-c31e-4886-bbe7-fc240d8365aa None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:42.370660 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8850666-fe76-47a4-a399-4d33150be8c5 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:42.385772 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b33da-006c-484e-b6d8-c4fb26f10699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:42.387120 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b33da-006c-484e-b6d8-c4fb26f10699 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:42.387120 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b33da-006c-484e-b6d8-c4fb26f10699 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:42.387120 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b33da-006c-484e-b6d8-c4fb26f10699 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:42.400263 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b33da-006c-484e-b6d8-c4fb26f10699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:42.405147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-543b33da-006c-484e-b6d8-c4fb26f10699 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:42.405147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:42.405147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:42.405147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:42.405147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:42.405147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:42.405147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:42.405147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:42.405147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:42.405147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:42.405147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:42.405147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:42.405147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:42.405147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:42.405147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:42.405147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:42.406159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:42.406159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:42.406159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:42.406159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:42.406159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:42.406159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:42.406159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:42.406159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:42.406159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:42.406159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:42.406159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:42.406159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:42.406159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:42.406159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:42.406159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:42.406159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:42.408107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:42.408107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:42.408107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:42.408107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:42.408107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:42.408107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:42.408107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:42.408107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:42.408107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:42.408107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:42.408107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:42.408107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:42.408107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 298/609] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:43:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:43:42.414699 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b33da-006c-484e-b6d8-c4fb26f10699 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:42.424049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b960c13-a05e-4f8d-b56c-b6d3926787b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:42.424715 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b960c13-a05e-4f8d-b56c-b6d3926787b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:42.424990 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b960c13-a05e-4f8d-b56c-b6d3926787b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:42.425262 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b960c13-a05e-4f8d-b56c-b6d3926787b5 None admin] PATH_INFO: `/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/6302b1f98544470a8986055a68bcd948/roles/6de833fef4c9456cb5d8ad66caf96586` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:42.441272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b960c13-a05e-4f8d-b56c-b6d3926787b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb12c96bf3a84df0b86967fbe93d1c17, user_id=6302b1f98544470a8986055a68bcd948, role_id=6de833fef4c9456cb5d8ad66caf96586)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:42.442709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b960c13-a05e-4f8d-b56c-b6d3926787b5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:42.458449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:42.529600 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 312/610] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:43:42 2022] PUT /identity/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/6302b1f98544470a8986055a68bcd948/roles/6de833fef4c9456cb5d8ad66caf96586 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:43:42.536221 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b33da-006c-484e-b6d8-c4fb26f10699 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:42.578178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62637e-bb18-401c-9b6d-8d1ba47b04b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:42.579282 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62637e-bb18-401c-9b6d-8d1ba47b04b3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:42.579803 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62637e-bb18-401c-9b6d-8d1ba47b04b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:42.580361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62637e-bb18-401c-9b6d-8d1ba47b04b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:42.581399 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62637e-bb18-401c-9b6d-8d1ba47b04b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:42.581981 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62637e-bb18-401c-9b6d-8d1ba47b04b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:42.583743 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62637e-bb18-401c-9b6d-8d1ba47b04b3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:42.591505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2c55f-3446-4ebc-90e7-6a70958d9485 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:42.591856 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2c55f-3446-4ebc-90e7-6a70958d9485 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:42.592039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2c55f-3446-4ebc-90e7-6a70958d9485 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:42.593660 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 313/611] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:42.596165 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 299/612] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Aug 11 10:43:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:42.602800 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd79a22-b4dc-443a-a48d-bf1b7e8edbe3 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:42.602800 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd79a22-b4dc-443a-a48d-bf1b7e8edbe3 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:42.602800 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd79a22-b4dc-443a-a48d-bf1b7e8edbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:42.604399 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62637e-bb18-401c-9b6d-8d1ba47b04b3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:42.622784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1cd79a22-b4dc-443a-a48d-bf1b7e8edbe3 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:42.622784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1cd79a22-b4dc-443a-a48d-bf1b7e8edbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:42.635173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:42.699068 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 314/613] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:42.758388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd79a22-b4dc-443a-a48d-bf1b7e8edbe3 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:42.773797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:42.789596 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62637e-bb18-401c-9b6d-8d1ba47b04b3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:42.830642 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d49179-7db9-4bee-93df-133304b9c153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:42.831305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d49179-7db9-4bee-93df-133304b9c153 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:42.831583 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d49179-7db9-4bee-93df-133304b9c153 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:42.831856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d49179-7db9-4bee-93df-133304b9c153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:42.843592 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d49179-7db9-4bee-93df-133304b9c153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:42.845174 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d49179-7db9-4bee-93df-133304b9c153 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:42.861866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-d2d49179-7db9-4bee-93df-133304b9c153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:42.861866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:42.861866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:42.861866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:42.861866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:42.861866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:42.861866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:42.861866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:42.861866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:42.861866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:42.861866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:42.861866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:42.861866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:42.861866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:42.861866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:42.861866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:42.863600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:42.863600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:42.863600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:42.863600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:42.863600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:42.863600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:42.863600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:42.863600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:42.863600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:42.863600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:42.863600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:42.863600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:42.863600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:42.863600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:42.863600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:42.863600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:42.863600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:42.864789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:42.864789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:42.864789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:42.864789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 300/614] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:42.874242 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d49179-7db9-4bee-93df-133304b9c153 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:42.960634 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd79a22-b4dc-443a-a48d-bf1b7e8edbe3 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:43.013533 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d49179-7db9-4bee-93df-133304b9c153 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:43.039795 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7231e42-d73e-4500-b467-5978107fce2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:43.040564 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7231e42-d73e-4500-b467-5978107fce2f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:43.040949 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7231e42-d73e-4500-b467-5978107fce2f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:43.041330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7231e42-d73e-4500-b467-5978107fce2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:43.053308 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7231e42-d73e-4500-b467-5978107fce2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:43.059063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-c7231e42-d73e-4500-b467-5978107fce2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:43.059063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:43.059063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:43.059063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:43.059063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:43.059063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:43.059063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:43.059063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:43.059063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:43.059063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:43.059063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:43.059063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:43.059063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:43.059063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:43.059063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:43.059063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:43.060149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:43.060149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:43.060149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:43.060149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:43.060149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:43.060149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:43.060149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:43.060149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:43.060149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:43.060149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:43.060149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:43.060149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:43.060149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:43.060149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:43.060149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:43.060149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:43.061039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:43.061039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:43.061039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:43.061039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:43.061039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:43.061039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:43.061039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:43.061039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:43.061039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:43.061039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:43.061039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:43.061039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:43.063081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 315/615] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:43:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:43:43.069124 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7231e42-d73e-4500-b467-5978107fce2f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:43.084008 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:43.103412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050d33d-70db-4ae7-9b89-cec68bdf68f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:43.103798 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050d33d-70db-4ae7-9b89-cec68bdf68f1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:43.104074 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050d33d-70db-4ae7-9b89-cec68bdf68f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:43.104353 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050d33d-70db-4ae7-9b89-cec68bdf68f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:43.105530 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050d33d-70db-4ae7-9b89-cec68bdf68f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:43.105828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050d33d-70db-4ae7-9b89-cec68bdf68f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:43.107245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050d33d-70db-4ae7-9b89-cec68bdf68f1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:43.145084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 301/616] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:43.155758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050d33d-70db-4ae7-9b89-cec68bdf68f1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:43.184506 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7231e42-d73e-4500-b467-5978107fce2f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:43.184936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:43.223272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35642111-f05a-4711-af68-898166eafa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:43.224200 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35642111-f05a-4711-af68-898166eafa6f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:43.224482 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35642111-f05a-4711-af68-898166eafa6f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:43.224754 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35642111-f05a-4711-af68-898166eafa6f None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:43.225423 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35642111-f05a-4711-af68-898166eafa6f None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:43.225724 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35642111-f05a-4711-af68-898166eafa6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:43.227131 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35642111-f05a-4711-af68-898166eafa6f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:43.243654 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 316/617] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Aug 11 10:43:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:43.245010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35642111-f05a-4711-af68-898166eafa6f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:43.353782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35642111-f05a-4711-af68-898166eafa6f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:43.391433 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05f245-4c15-4224-8a82-75639a18845c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:43.392095 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05f245-4c15-4224-8a82-75639a18845c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:43.392373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05f245-4c15-4224-8a82-75639a18845c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:43.392646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05f245-4c15-4224-8a82-75639a18845c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:43.395199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:43.405571 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05f245-4c15-4224-8a82-75639a18845c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:43.407379 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05f245-4c15-4224-8a82-75639a18845c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:43.422718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-6c05f245-4c15-4224-8a82-75639a18845c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:43.422718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:43.422718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:43.422718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:43.422718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:43.422718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:43.422718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:43.422718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:43.422718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:43.422718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:43.422718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:43.422718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:43.422718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:43.422718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:43.422718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:43.422718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:43.423692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:43.423692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:43.423692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:43.423692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:43.423692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:43.423692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:43.423692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:43.423692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:43.423692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:43.423692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:43.423692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:43.423692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:43.423692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:43.423692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:43.423692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:43.423692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:43.423692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:43.424742 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:43.424742 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:43.424742 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:43.427433 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 317/618] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:43.430289 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05f245-4c15-4224-8a82-75639a18845c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:43.451574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050d33d-70db-4ae7-9b89-cec68bdf68f1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:43.559492 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab6d90-673f-41c6-adce-f7a3dbee3aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:43.560150 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab6d90-673f-41c6-adce-f7a3dbee3aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:43.560430 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab6d90-673f-41c6-adce-f7a3dbee3aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:43.560702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab6d90-673f-41c6-adce-f7a3dbee3aa2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:43.564693 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05f245-4c15-4224-8a82-75639a18845c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:43.583542 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab6d90-673f-41c6-adce-f7a3dbee3aa2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:43.585007 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab6d90-673f-41c6-adce-f7a3dbee3aa2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:43.600188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1c1db-c3c4-41c0-9d2a-392579a50ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:43.600806 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1c1db-c3c4-41c0-9d2a-392579a50ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:43.601087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1c1db-c3c4-41c0-9d2a-392579a50ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:43.601363 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1c1db-c3c4-41c0-9d2a-392579a50ef6 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:43.602015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1c1db-c3c4-41c0-9d2a-392579a50ef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:43.602322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1c1db-c3c4-41c0-9d2a-392579a50ef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:43.603881 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1c1db-c3c4-41c0-9d2a-392579a50ef6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:43.607103 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:43.615799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c1ab6d90-673f-41c6-adce-f7a3dbee3aa2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 10:43:43.615799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:43.615799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:43.615799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:43.615799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:43.615799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:43.615799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:43.615799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:43.615799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:43.615799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:43.615799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:43.615799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:43.615799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:43:43.615799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:43:43.615799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:43:43.615799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:43:43.616747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:43.616747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:43.616747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:43:43.616747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:43.616747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:43:43.616747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:43.616747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:43.616747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:43.616747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:43.616747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:43.616747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:43.616747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:43.616747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:43.616747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:43.616747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:43.616747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:43.616747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:43.616747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:43.617688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:43.617688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:43.617688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:43:43.617688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:43:43.617688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:43:43.617688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:43:43.617688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:43:43.617688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:43:43.617688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 10:43:43.617688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:43.617688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 302/620] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Aug 11 10:43:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 462 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:43.621627 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 318/620] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:43.623747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab6d90-673f-41c6-adce-f7a3dbee3aa2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:43.624990 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1c1db-c3c4-41c0-9d2a-392579a50ef6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:43.762344 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1c1db-c3c4-41c0-9d2a-392579a50ef6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:43.775100 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:43.810431 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab6d90-673f-41c6-adce-f7a3dbee3aa2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:43.843157 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca09c5-6952-4638-b138-f181189d410c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:43.843803 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca09c5-6952-4638-b138-f181189d410c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:43.844081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca09c5-6952-4638-b138-f181189d410c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:43.844474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca09c5-6952-4638-b138-f181189d410c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:43.850228 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915dda8-2836-4fcf-bf49-842b33446898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:43.851488 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915dda8-2836-4fcf-bf49-842b33446898 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:43.851884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915dda8-2836-4fcf-bf49-842b33446898 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:43.852279 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915dda8-2836-4fcf-bf49-842b33446898 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:43.853114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915dda8-2836-4fcf-bf49-842b33446898 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:43.853529 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915dda8-2836-4fcf-bf49-842b33446898 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:43.856077 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915dda8-2836-4fcf-bf49-842b33446898 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:43.860627 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca09c5-6952-4638-b138-f181189d410c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:43.862129 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca09c5-6952-4638-b138-f181189d410c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:43.881111 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 303/621] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Aug 11 10:43:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:43.882342 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915dda8-2836-4fcf-bf49-842b33446898 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:43.886652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e4ca09c5-6952-4638-b138-f181189d410c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 11 10:43:43.886652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:43.886652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:43.886652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:43.886652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:43.886652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:43.886652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:43.886652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:43.886652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:43.886652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:43.886652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:43.886652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:43.886652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:43:43.886652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:43:43.886652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:43:43.886652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:43:43.887588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:43.887588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:43.887588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:43:43.887588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:43.887588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:43:43.887588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:43.887588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:43.887588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:43.887588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:43.887588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:43.887588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:43.887588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:43.887588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:43.887588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:43.887588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:43.887588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:43.887588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:43.887588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:43.888470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:43.888470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:43.888470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:43:43.888470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:43:43.888470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:43:43.888470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:43:43.888470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:43:43.888470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:43:43.888470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 11 10:43:43.888470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:43.893247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 319/622] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:43:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:43.904609 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca09c5-6952-4638-b138-f181189d410c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:43.999129 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:44.000206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915dda8-2836-4fcf-bf49-842b33446898 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:44.060710 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:44.079732 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c726eea-5826-41a4-bcb2-b9273a3b054f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:44.080350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c726eea-5826-41a4-bcb2-b9273a3b054f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:44.080629 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c726eea-5826-41a4-bcb2-b9273a3b054f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:44.080902 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c726eea-5826-41a4-bcb2-b9273a3b054f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:44.096499 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca09c5-6952-4638-b138-f181189d410c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:44.142190 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfcc01-1708-4daa-a916-43ead24b11df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:44.143137 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfcc01-1708-4daa-a916-43ead24b11df None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:44.143419 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfcc01-1708-4daa-a916-43ead24b11df None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:44.143689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfcc01-1708-4daa-a916-43ead24b11df None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:44.144716 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfcc01-1708-4daa-a916-43ead24b11df None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:44.145439 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfcc01-1708-4daa-a916-43ead24b11df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:44.146933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfcc01-1708-4daa-a916-43ead24b11df None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:44.166004 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c726eea-5826-41a4-bcb2-b9273a3b054f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:44.167815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c726eea-5826-41a4-bcb2-b9273a3b054f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:44.176711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 320/623] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Aug 11 10:43:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:44.179998 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342cc3c-7d85-4dbd-80f5-70f649c4a7b9 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:44.180287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342cc3c-7d85-4dbd-80f5-70f649c4a7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:44.180559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342cc3c-7d85-4dbd-80f5-70f649c4a7b9 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:44.181857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 321/624] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:44.182555 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342cc3c-7d85-4dbd-80f5-70f649c4a7b9 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:44.282747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 304/625] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:43:44.284029 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc91a3-d90c-4966-b575-2360a9f05a15 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:44.284315 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc91a3-d90c-4966-b575-2360a9f05a15 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:44.284644 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc91a3-d90c-4966-b575-2360a9f05a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:44.302806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-10cc91a3-d90c-4966-b575-2360a9f05a15 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:44.303990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-10cc91a3-d90c-4966-b575-2360a9f05a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:44.321613 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:44.326835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:44.327850 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342cc3c-7d85-4dbd-80f5-70f649c4a7b9 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:44.364552 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ff331-670e-4581-9973-2598638810f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:44.365176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ff331-670e-4581-9973-2598638810f3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:44.365458 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ff331-670e-4581-9973-2598638810f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:44.365785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ff331-670e-4581-9973-2598638810f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:44.376459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ff331-670e-4581-9973-2598638810f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:44.378074 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ff331-670e-4581-9973-2598638810f3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:44.393823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 305/626] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:44.395241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc91a3-d90c-4966-b575-2360a9f05a15 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:44.396895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-a28ff331-670e-4581-9973-2598638810f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:44.396895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:44.396895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:44.396895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:44.396895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:44.396895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:44.396895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:44.396895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:44.396895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:44.396895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:44.396895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:44.396895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:44.396895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:44.396895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:44.396895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:44.396895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:44.397785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:44.397785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:44.397785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:44.397785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:44.397785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:44.397785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:44.397785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:44.397785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:44.397785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:44.397785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:44.397785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:44.397785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:44.397785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:44.397785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:44.397785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:44.397785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:44.397785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:44.403154 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:44.403154 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:44.403154 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:44.403154 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 322/627] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:44.404853 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb5cd8-80c0-45f5-8f13-15ff7a03cbd7 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:44.405134 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb5cd8-80c0-45f5-8f13-15ff7a03cbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:44.405405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb5cd8-80c0-45f5-8f13-15ff7a03cbd7 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:44.406917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 323/628] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:44.410596 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb5cd8-80c0-45f5-8f13-15ff7a03cbd7 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:44.516667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb5cd8-80c0-45f5-8f13-15ff7a03cbd7 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:44.517864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc91a3-d90c-4966-b575-2360a9f05a15 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:44.551626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40350a-c65f-467e-a0ce-633d04797b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:44.552149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40350a-c65f-467e-a0ce-633d04797b62 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:44.552425 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40350a-c65f-467e-a0ce-633d04797b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:44.552691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40350a-c65f-467e-a0ce-633d04797b62 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:44.553324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40350a-c65f-467e-a0ce-633d04797b62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:44.553622 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40350a-c65f-467e-a0ce-633d04797b62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:44.554999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40350a-c65f-467e-a0ce-633d04797b62 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:44.555246 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242f096-5213-4af1-b689-730c8fc85a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:44.555872 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242f096-5213-4af1-b689-730c8fc85a0f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:44.556142 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242f096-5213-4af1-b689-730c8fc85a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:44.556424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242f096-5213-4af1-b689-730c8fc85a0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:44.567523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242f096-5213-4af1-b689-730c8fc85a0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:44.568973 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242f096-5213-4af1-b689-730c8fc85a0f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:44.572331 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 324/629] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:44.573688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f693d-31a1-45f9-b6d3-85c6e852db1a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:44.574000 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f693d-31a1-45f9-b6d3-85c6e852db1a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:44.574275 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f693d-31a1-45f9-b6d3-85c6e852db1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:44.586378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f242f096-5213-4af1-b689-730c8fc85a0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:44.586378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:44.586378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:44.586378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:44.586378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:44.586378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:44.586378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:44.586378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:44.586378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:44.586378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:44.586378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:44.586378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:44.586378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:44.586378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:44.586378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:44.586378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:44.587370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:44.587370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:44.587370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:44.587370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:44.587370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:44.587370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:44.587370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:44.587370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:44.587370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:44.587370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:44.587370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:44.587370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:44.587370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:44.587370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:44.587370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:44.587370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:44.587370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:44.593320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:44.593320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:44.593320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:44.593320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 306/630] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:44.593320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242f096-5213-4af1-b689-730c8fc85a0f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:44.593617 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4d9f693d-31a1-45f9-b6d3-85c6e852db1a None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:44.593617 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4d9f693d-31a1-45f9-b6d3-85c6e852db1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:44.600924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:44.603240 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:44.660374 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 325/631] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:44.661442 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f693d-31a1-45f9-b6d3-85c6e852db1a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:44.709961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242f096-5213-4af1-b689-730c8fc85a0f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:44.746039 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad39d0-aaea-4006-a607-c3296f7d3f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:44.746799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad39d0-aaea-4006-a607-c3296f7d3f28 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:44.747193 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad39d0-aaea-4006-a607-c3296f7d3f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:44.747464 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad39d0-aaea-4006-a607-c3296f7d3f28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:44.758309 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad39d0-aaea-4006-a607-c3296f7d3f28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:44.763994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-84ad39d0-aaea-4006-a607-c3296f7d3f28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:44.763994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:44.763994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:44.763994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:44.763994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:44.763994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:44.763994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:44.763994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:44.763994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:44.763994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:44.763994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:44.763994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:44.763994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:44.763994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:44.763994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:44.763994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:44.764929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:44.764929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:44.764929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:44.764929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:44.764929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:44.764929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:44.764929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:44.764929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:44.764929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:44.764929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:44.764929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:44.764929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:44.764929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:44.764929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:44.764929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:44.764929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:44.765769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:44.765769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:44.765769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:44.765769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:44.765769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:44.765769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:44.765769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:44.765769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:44.765769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:44.765769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:44.765769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:44.765769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:44.765769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 307/632] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:43:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:44.766435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad39d0-aaea-4006-a607-c3296f7d3f28 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:44.778390 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f693d-31a1-45f9-b6d3-85c6e852db1a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:44.815580 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfb0dc-4171-46de-80cf-47097fe959d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:44.816169 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfb0dc-4171-46de-80cf-47097fe959d4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:44.816448 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfb0dc-4171-46de-80cf-47097fe959d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:44.816721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfb0dc-4171-46de-80cf-47097fe959d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:44.824544 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfb0dc-4171-46de-80cf-47097fe959d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:44.826055 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfb0dc-4171-46de-80cf-47097fe959d4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:44.836919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:44.838204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-afbfb0dc-4171-46de-80cf-47097fe959d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:44.838204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:44.838204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:44.838204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:44.838204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:44.838204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:44.838204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:44.838204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:44.838204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:44.838204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:44.838204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:44.838204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:44.838204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:43:44.838204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:43:44.838204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:43:44.839645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:43:44.839645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:44.839645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:44.839645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:44.839645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:44.839645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:44.839645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:44.839645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:44.839645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:44.839645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:44.839645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:44.839645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:44.839645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:44.839645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:44.839645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:44.839645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:44.839645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:44.840927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:43:44.840927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:43:44.840927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:43:44.840927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:43:44.840927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:43:44.840927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:43:44.840927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:44.840927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:44.840927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 326/633] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:44.840927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfb0dc-4171-46de-80cf-47097fe959d4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:44.844854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:44.880324 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad39d0-aaea-4006-a607-c3296f7d3f28 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:44.914665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238e53d-4d87-41a0-b7bf-f70b9446db60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:44.915336 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238e53d-4d87-41a0-b7bf-f70b9446db60 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:44.915615 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238e53d-4d87-41a0-b7bf-f70b9446db60 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:44.915886 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238e53d-4d87-41a0-b7bf-f70b9446db60 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:44.916525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238e53d-4d87-41a0-b7bf-f70b9446db60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:44.916829 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238e53d-4d87-41a0-b7bf-f70b9446db60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:44.918263 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238e53d-4d87-41a0-b7bf-f70b9446db60 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:44.935287 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 308/634] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:44.936546 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238e53d-4d87-41a0-b7bf-f70b9446db60 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:44.949634 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfb0dc-4171-46de-80cf-47097fe959d4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:44.985546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480150a-a3b1-4030-92dd-6a8d3855e727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:44.986183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480150a-a3b1-4030-92dd-6a8d3855e727 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:44.986467 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480150a-a3b1-4030-92dd-6a8d3855e727 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:44.986741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480150a-a3b1-4030-92dd-6a8d3855e727 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:44.998205 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480150a-a3b1-4030-92dd-6a8d3855e727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:45.002837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-4480150a-a3b1-4030-92dd-6a8d3855e727 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:45.002837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:45.002837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:45.002837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:45.002837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:45.002837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:45.002837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:45.002837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:45.002837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:45.002837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:45.002837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:45.002837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:45.002837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:45.002837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:45.002837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:45.002837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:45.006976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:45.006976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:45.006976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:45.006976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:45.006976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:45.006976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:45.006976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:45.006976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:45.006976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:45.006976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:45.006976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:45.006976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:45.006976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:45.006976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:45.006976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:45.006976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:45.007913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:45.007913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:45.007913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:45.007913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:45.007913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:45.007913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:45.007913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:45.007913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:45.007913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:45.007913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:45.007913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:45.007913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:45.007913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 327/635] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:43:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:45.007913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480150a-a3b1-4030-92dd-6a8d3855e727 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:45.053965 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238e53d-4d87-41a0-b7bf-f70b9446db60 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:45.078290 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:45.081865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:45.089640 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ae7a5-c9c2-4b4f-9493-9490756f1b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:45.090421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ae7a5-c9c2-4b4f-9493-9490756f1b4d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:45.090702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ae7a5-c9c2-4b4f-9493-9490756f1b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:45.090999 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ae7a5-c9c2-4b4f-9493-9490756f1b4d None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:45.091657 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ae7a5-c9c2-4b4f-9493-9490756f1b4d None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:45.091957 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ae7a5-c9c2-4b4f-9493-9490756f1b4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:45.095932 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ae7a5-c9c2-4b4f-9493-9490756f1b4d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:45.101528 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 309/636] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Aug 11 10:43:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:45.102317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ae7a5-c9c2-4b4f-9493-9490756f1b4d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:45.116416 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480150a-a3b1-4030-92dd-6a8d3855e727 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:45.150064 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f0e0f-bb27-4160-a1b0-0c29dd957d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:45.150663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f0e0f-bb27-4160-a1b0-0c29dd957d62 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:45.150964 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f0e0f-bb27-4160-a1b0-0c29dd957d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:45.151234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f0e0f-bb27-4160-a1b0-0c29dd957d62 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:45.152601 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f0e0f-bb27-4160-a1b0-0c29dd957d62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:45.152904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f0e0f-bb27-4160-a1b0-0c29dd957d62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:45.154335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f0e0f-bb27-4160-a1b0-0c29dd957d62 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:45.165240 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 328/637] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:43:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:45.166010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f0e0f-bb27-4160-a1b0-0c29dd957d62 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:45.208087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ae7a5-c9c2-4b4f-9493-9490756f1b4d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:45.241651 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f00de8-aba9-45bc-a7f0-db2f77839923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:45.242280 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f00de8-aba9-45bc-a7f0-db2f77839923 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:45.242560 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f00de8-aba9-45bc-a7f0-db2f77839923 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:45.242864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f00de8-aba9-45bc-a7f0-db2f77839923 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:45.249881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f00de8-aba9-45bc-a7f0-db2f77839923 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:45.251379 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f00de8-aba9-45bc-a7f0-db2f77839923 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:45.260354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f0e0f-bb27-4160-a1b0-0c29dd957d62 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:45.263310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-91f00de8-aba9-45bc-a7f0-db2f77839923 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:45.263310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:45.263310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:45.263310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:45.263310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:45.263310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:45.263310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:45.263310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:45.263310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:45.263310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:45.263310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:45.263310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:45.263310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:43:45.263310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:43:45.263310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:43:45.264211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:43:45.264211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:45.264211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:45.264211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:45.264211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:45.264211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:45.264211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:45.264211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:45.264211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:45.264211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:45.264211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:45.264211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:45.264211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:45.264211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:45.264211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:45.264211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:45.264211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:45.265066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:43:45.265066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:43:45.265066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:43:45.265066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:43:45.265066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:43:45.265066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:43:45.265066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:45.265066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:45.265066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 310/638] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:45.265925 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ba68a-bde4-46e4-82a9-1e9afd95553d None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:45.265925 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ba68a-bde4-46e4-82a9-1e9afd95553d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:45.266186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ba68a-bde4-46e4-82a9-1e9afd95553d None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:45.267584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 311/639] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:45.268114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ba68a-bde4-46e4-82a9-1e9afd95553d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:45.287067 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:45.299260 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e155f5-b301-4856-a8cf-f33e70da0db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:45.299894 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e155f5-b301-4856-a8cf-f33e70da0db2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:45.300171 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e155f5-b301-4856-a8cf-f33e70da0db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:45.300446 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e155f5-b301-4856-a8cf-f33e70da0db2 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:45.301104 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e155f5-b301-4856-a8cf-f33e70da0db2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:45.301403 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e155f5-b301-4856-a8cf-f33e70da0db2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:45.302785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e155f5-b301-4856-a8cf-f33e70da0db2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:45.311117 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 329/640] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Aug 11 10:43:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:45.311715 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e155f5-b301-4856-a8cf-f33e70da0db2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:45.324079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:45.374982 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ba68a-bde4-46e4-82a9-1e9afd95553d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:45.408748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aec30c-195b-440b-b87d-702d9ca30391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:45.409364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aec30c-195b-440b-b87d-702d9ca30391 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:45.409644 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aec30c-195b-440b-b87d-702d9ca30391 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:45.409914 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aec30c-195b-440b-b87d-702d9ca30391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:45.410854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e155f5-b301-4856-a8cf-f33e70da0db2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:45.419798 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aec30c-195b-440b-b87d-702d9ca30391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:45.421240 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aec30c-195b-440b-b87d-702d9ca30391 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:45.435114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-94aec30c-195b-440b-b87d-702d9ca30391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:45.435114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:45.435114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:45.435114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:45.435114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:45.435114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:45.435114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:45.435114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:45.435114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:45.435114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:45.435114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:45.435114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:45.435114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:45.435114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:45.435114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:45.435114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:45.436245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:45.436245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:45.436245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:45.436245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:45.436245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:45.436245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:45.436245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:45.436245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:45.436245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:45.436245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:45.436245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:45.436245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:45.436245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:45.436245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:45.436245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:45.436245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:45.436245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:45.437281 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:45.437281 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:45.437281 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:45.437281 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 312/641] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:45.437281 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aec30c-195b-440b-b87d-702d9ca30391 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:45.446212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec88e50-1ebe-4f4d-a7ce-cd1e2df2733b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:45.446904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec88e50-1ebe-4f4d-a7ce-cd1e2df2733b None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:45.447176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec88e50-1ebe-4f4d-a7ce-cd1e2df2733b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:45.447447 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec88e50-1ebe-4f4d-a7ce-cd1e2df2733b None admin] PATH_INFO: `/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/cbd25d1bde0c4703b61e0edaf5b658d4/roles/6de833fef4c9456cb5d8ad66caf96586` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:45.462034 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec88e50-1ebe-4f4d-a7ce-cd1e2df2733b None admin] RBAC: Authorizing `identity:create_grant(project_id=bb12c96bf3a84df0b86967fbe93d1c17, user_id=cbd25d1bde0c4703b61e0edaf5b658d4, role_id=6de833fef4c9456cb5d8ad66caf96586)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:45.463490 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec88e50-1ebe-4f4d-a7ce-cd1e2df2733b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:45.530987 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 330/642] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:43:45 2022] PUT /identity/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/cbd25d1bde0c4703b61e0edaf5b658d4/roles/6de833fef4c9456cb5d8ad66caf96586 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:43:45.532371 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b342e-b6c2-4bfb-a185-995877ed7e2d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:45.532675 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b342e-b6c2-4bfb-a185-995877ed7e2d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:45.532952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b342e-b6c2-4bfb-a185-995877ed7e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:45.543273 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aec30c-195b-440b-b87d-702d9ca30391 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:45.545118 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:45.560018 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-440b342e-b6c2-4bfb-a185-995877ed7e2d None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:45.565813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-440b342e-b6c2-4bfb-a185-995877ed7e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:45.583264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289c0cf-cb96-477c-ad41-680fabe8cf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:45.584451 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289c0cf-cb96-477c-ad41-680fabe8cf69 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:45.584865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289c0cf-cb96-477c-ad41-680fabe8cf69 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:45.585235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289c0cf-cb96-477c-ad41-680fabe8cf69 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:45.585960 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289c0cf-cb96-477c-ad41-680fabe8cf69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:45.586270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289c0cf-cb96-477c-ad41-680fabe8cf69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:45.587830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289c0cf-cb96-477c-ad41-680fabe8cf69 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:45.593950 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:45.606616 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 313/643] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:43:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:45.606616 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289c0cf-cb96-477c-ad41-680fabe8cf69 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:45.646671 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 331/644] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:45.647571 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b342e-b6c2-4bfb-a185-995877ed7e2d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:45.738799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289c0cf-cb96-477c-ad41-680fabe8cf69 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:45.763328 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b342e-b6c2-4bfb-a185-995877ed7e2d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:45.775100 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde7523-b14b-40ec-8024-f2a55502dd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:45.775737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde7523-b14b-40ec-8024-f2a55502dd79 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:45.776108 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde7523-b14b-40ec-8024-f2a55502dd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:45.776292 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde7523-b14b-40ec-8024-f2a55502dd79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:45.788070 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde7523-b14b-40ec-8024-f2a55502dd79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:45.789537 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde7523-b14b-40ec-8024-f2a55502dd79 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:45.800420 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f64d6-22eb-4d6c-b2ad-4228d3e0d85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:45.801628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f64d6-22eb-4d6c-b2ad-4228d3e0d85a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:45.801628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f64d6-22eb-4d6c-b2ad-4228d3e0d85a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:45.801628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f64d6-22eb-4d6c-b2ad-4228d3e0d85a None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:45.802182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f64d6-22eb-4d6c-b2ad-4228d3e0d85a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:45.802480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f64d6-22eb-4d6c-b2ad-4228d3e0d85a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:45.803874 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f64d6-22eb-4d6c-b2ad-4228d3e0d85a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:45.805188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-0cde7523-b14b-40ec-8024-f2a55502dd79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:45.805188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:45.805188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:45.805188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:45.805188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:45.805188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:45.805188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:45.805188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:45.805188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:45.805188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:45.805188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:45.805188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:45.805188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:45.805188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:45.805188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:45.805188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:45.806073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:45.806073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:45.806073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:45.806073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:45.806073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:45.806073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:45.806073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:45.806073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:45.806073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:45.806073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:45.806073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:45.806073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:45.806073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:45.806073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:45.806073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:45.806073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:45.806073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:45.807387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:45.807387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:45.807387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:45.807387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 314/645] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:45.807387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde7523-b14b-40ec-8024-f2a55502dd79 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:45.821914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 332/646] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:45.822845 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f64d6-22eb-4d6c-b2ad-4228d3e0d85a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:45.832396 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:45.851201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:45.923454 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde7523-b14b-40ec-8024-f2a55502dd79 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:45.931306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f64d6-22eb-4d6c-b2ad-4228d3e0d85a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:45.959413 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478aa9fc-6076-468b-b8ef-9270a02272ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:45.960016 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aa9fc-6076-468b-b8ef-9270a02272ca None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:45.960297 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aa9fc-6076-468b-b8ef-9270a02272ca None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:45.960573 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aa9fc-6076-468b-b8ef-9270a02272ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:45.961294 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478aa9fc-6076-468b-b8ef-9270a02272ca None admin] RBAC: Adding query filter params (role.id=6de833fef4c9456cb5d8ad66caf96586, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=9267752ac6724013bc1edcdecff48dd7) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:45.961599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478aa9fc-6076-468b-b8ef-9270a02272ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:45.963081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478aa9fc-6076-468b-b8ef-9270a02272ca None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:45.967094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6be4c-7fb5-454b-92b3-2a9785dbc878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:45.967819 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6be4c-7fb5-454b-92b3-2a9785dbc878 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:45.968099 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6be4c-7fb5-454b-92b3-2a9785dbc878 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:45.968371 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6be4c-7fb5-454b-92b3-2a9785dbc878 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:45.979148 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 315/647] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:43:45 2022] GET /identity/v3/role_assignments?user.id=9267752ac6724013bc1edcdecff48dd7&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=6de833fef4c9456cb5d8ad66caf96586 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:45.979148 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478aa9fc-6076-468b-b8ef-9270a02272ca None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:45.991895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6be4c-7fb5-454b-92b3-2a9785dbc878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:45.997924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-13e6be4c-7fb5-454b-92b3-2a9785dbc878 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:45.997924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:45.997924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:45.997924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:45.997924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:45.997924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:45.997924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:45.997924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:45.997924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:45.997924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:45.997924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:45.997924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:45.997924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:45.997924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:45.997924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:45.997924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:45.998939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:45.998939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:45.998939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:45.998939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:45.998939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:45.998939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:45.998939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:45.998939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:45.998939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:45.998939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:45.998939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:45.998939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:45.998939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:45.998939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:45.998939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:45.998939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:45.999726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:45.999726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:45.999726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:45.999726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:45.999726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:45.999726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:45.999726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:45.999726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:45.999726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:45.999726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:45.999726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:45.999726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:45.999726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 333/648] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:43:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:46.000409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6be4c-7fb5-454b-92b3-2a9785dbc878 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:46.080369 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:46.107645 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478aa9fc-6076-468b-b8ef-9270a02272ca None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:46.133765 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:46.157758 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6be4c-7fb5-454b-92b3-2a9785dbc878 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:46.161435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95144cb0-f607-4cb0-911d-2a60b87ebbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:46.162065 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95144cb0-f607-4cb0-911d-2a60b87ebbfa None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:46.162348 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95144cb0-f607-4cb0-911d-2a60b87ebbfa None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:46.162625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95144cb0-f607-4cb0-911d-2a60b87ebbfa None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:46.163307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95144cb0-f607-4cb0-911d-2a60b87ebbfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:46.163614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95144cb0-f607-4cb0-911d-2a60b87ebbfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:46.165592 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95144cb0-f607-4cb0-911d-2a60b87ebbfa None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:46.181365 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 316/649] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:46.181365 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95144cb0-f607-4cb0-911d-2a60b87ebbfa None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:46.197300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306c6ca-3418-4daf-8b33-f753d0e05a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:46.197931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306c6ca-3418-4daf-8b33-f753d0e05a95 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:46.198214 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306c6ca-3418-4daf-8b33-f753d0e05a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:46.199276 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306c6ca-3418-4daf-8b33-f753d0e05a95 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:46.208394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306c6ca-3418-4daf-8b33-f753d0e05a95 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:46.209836 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306c6ca-3418-4daf-8b33-f753d0e05a95 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:46.224003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-6306c6ca-3418-4daf-8b33-f753d0e05a95 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 11 10:43:46.224003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:46.224003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:46.224003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:46.224003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:46.224003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:46.224003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:46.224003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:46.224003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:46.224003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:46.224003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:46.224003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:46.224003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:43:46.224003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:43:46.224003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:43:46.224003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:43:46.225160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:46.225160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:46.225160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:43:46.225160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:46.225160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:43:46.225160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:46.225160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:46.225160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:46.225160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:46.225160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:46.225160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:46.225160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:46.225160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:46.225160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:46.225160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:46.225160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:46.225160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:46.225160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:46.226177 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:46.226177 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:46.226177 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:43:46.226177 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:43:46.226177 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:43:46.226177 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:43:46.226177 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:43:46.226177 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:43:46.226177 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 11 10:43:46.226177 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:46.226177 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 334/650] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:46.226177 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306c6ca-3418-4daf-8b33-f753d0e05a95 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:46.313540 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95144cb0-f607-4cb0-911d-2a60b87ebbfa None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:46.350578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306c6ca-3418-4daf-8b33-f753d0e05a95 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:46.357829 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4521c3a-1fb9-4226-b7cb-a8911a45c160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:46.358703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4521c3a-1fb9-4226-b7cb-a8911a45c160 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:46.360022 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4521c3a-1fb9-4226-b7cb-a8911a45c160 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:46.360521 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4521c3a-1fb9-4226-b7cb-a8911a45c160 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:46.361839 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4521c3a-1fb9-4226-b7cb-a8911a45c160 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:46.362345 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4521c3a-1fb9-4226-b7cb-a8911a45c160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:46.364634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4521c3a-1fb9-4226-b7cb-a8911a45c160 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:46.371982 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:46.377935 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 317/651] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Aug 11 10:43:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:46.379082 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4521c3a-1fb9-4226-b7cb-a8911a45c160 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:46.394942 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707082c2-0fa6-483b-9157-dd3e208c75e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:46.395857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707082c2-0fa6-483b-9157-dd3e208c75e3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:46.396143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707082c2-0fa6-483b-9157-dd3e208c75e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:46.396466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707082c2-0fa6-483b-9157-dd3e208c75e3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:46.407878 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707082c2-0fa6-483b-9157-dd3e208c75e3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:46.409607 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707082c2-0fa6-483b-9157-dd3e208c75e3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:46.423927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-707082c2-0fa6-483b-9157-dd3e208c75e3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 10:43:46.423927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:46.423927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:46.423927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:46.423927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:46.423927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:46.423927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:46.423927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:46.423927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:46.423927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:46.423927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:46.423927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:46.423927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:43:46.423927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:43:46.423927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:43:46.423927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:43:46.425133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:46.425133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:46.425133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:43:46.425133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:46.425133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:43:46.425133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:46.425133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:46.425133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:46.425133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:46.425133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:46.425133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:46.425133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:46.425133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:46.425133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:46.425133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:46.425133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:46.425133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:46.425133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:46.426546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:46.426546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:46.426546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:43:46.426546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:43:46.426546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:43:46.426546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:43:46.426546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:43:46.426546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:43:46.426546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 10:43:46.426546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:46.426546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 335/652] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:46.426546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707082c2-0fa6-483b-9157-dd3e208c75e3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:46.431175 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:46.518419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4521c3a-1fb9-4226-b7cb-a8911a45c160 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:46.552277 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707082c2-0fa6-483b-9157-dd3e208c75e3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:46.562403 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f88120-da2b-4389-9a7c-fb85961afa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:46.564241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f88120-da2b-4389-9a7c-fb85961afa96 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:46.565111 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f88120-da2b-4389-9a7c-fb85961afa96 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:46.565590 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f88120-da2b-4389-9a7c-fb85961afa96 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:46.566745 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f88120-da2b-4389-9a7c-fb85961afa96 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:46.567247 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f88120-da2b-4389-9a7c-fb85961afa96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:46.569949 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f88120-da2b-4389-9a7c-fb85961afa96 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:46.594058 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 318/653] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Aug 11 10:43:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:46.595335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f88120-da2b-4389-9a7c-fb85961afa96 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:46.600423 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac3e12-6e47-4683-992c-daff3aa4ee32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:46.601161 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac3e12-6e47-4683-992c-daff3aa4ee32 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:46.601516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac3e12-6e47-4683-992c-daff3aa4ee32 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:46.601857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac3e12-6e47-4683-992c-daff3aa4ee32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:46.615259 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac3e12-6e47-4683-992c-daff3aa4ee32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:46.616722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac3e12-6e47-4683-992c-daff3aa4ee32 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:46.633287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-4eac3e12-6e47-4683-992c-daff3aa4ee32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:46.633287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:46.633287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:46.633287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:46.633287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:46.633287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:46.633287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:46.633287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:46.633287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:46.633287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:46.633287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:46.633287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:46.633287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:46.633287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:46.633287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:46.633287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:46.634426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:46.634426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:46.634426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:46.634426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:46.634426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:46.634426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:46.634426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:46.634426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:46.634426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:46.634426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:46.634426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:46.634426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:46.634426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:46.634426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:46.634426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:46.634426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:46.634426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:46.635517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:46.635517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:46.635517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:46.636238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 336/654] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:46.637254 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac3e12-6e47-4683-992c-daff3aa4ee32 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:46.671200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:46.702780 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:46.719185 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f88120-da2b-4389-9a7c-fb85961afa96 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:46.756772 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2864547-df1b-4eb6-b21c-b9d321a21ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:46.757497 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2864547-df1b-4eb6-b21c-b9d321a21ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:46.757801 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2864547-df1b-4eb6-b21c-b9d321a21ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:46.758161 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2864547-df1b-4eb6-b21c-b9d321a21ba8 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:46.759008 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2864547-df1b-4eb6-b21c-b9d321a21ba8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:46.759419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2864547-df1b-4eb6-b21c-b9d321a21ba8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:46.760465 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac3e12-6e47-4683-992c-daff3aa4ee32 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:46.761000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2864547-df1b-4eb6-b21c-b9d321a21ba8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:46.783368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 319/655] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Aug 11 10:43:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:46.783368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2864547-df1b-4eb6-b21c-b9d321a21ba8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:46.802868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ed6f4-d8a5-41f5-a62d-f6a1dd708113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:46.803762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ed6f4-d8a5-41f5-a62d-f6a1dd708113 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:46.804670 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ed6f4-d8a5-41f5-a62d-f6a1dd708113 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:46.805122 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ed6f4-d8a5-41f5-a62d-f6a1dd708113 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:46.883935 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ed6f4-d8a5-41f5-a62d-f6a1dd708113 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:46.885888 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ed6f4-d8a5-41f5-a62d-f6a1dd708113 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:46.901362 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2864547-df1b-4eb6-b21c-b9d321a21ba8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:46.945221 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:46.997156 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 337/656] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:43:46.998148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ed6f4-d8a5-41f5-a62d-f6a1dd708113 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:47.064855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:47.083120 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7631f08-5e3b-46c9-ba96-a21782f67498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:47.083832 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7631f08-5e3b-46c9-ba96-a21782f67498 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:47.084175 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7631f08-5e3b-46c9-ba96-a21782f67498 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:47.084508 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7631f08-5e3b-46c9-ba96-a21782f67498 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:47.085714 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7631f08-5e3b-46c9-ba96-a21782f67498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:47.085714 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7631f08-5e3b-46c9-ba96-a21782f67498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:47.087217 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7631f08-5e3b-46c9-ba96-a21782f67498 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:47.101223 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 320/657] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:47.102047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7631f08-5e3b-46c9-ba96-a21782f67498 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:47.127920 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ed6f4-d8a5-41f5-a62d-f6a1dd708113 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:47.162804 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90124d94-05e7-4edf-8e72-308d01ab2e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:47.163420 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90124d94-05e7-4edf-8e72-308d01ab2e6f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:47.163749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90124d94-05e7-4edf-8e72-308d01ab2e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:47.164020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90124d94-05e7-4edf-8e72-308d01ab2e6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:47.210139 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7631f08-5e3b-46c9-ba96-a21782f67498 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:47.219152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:47.233516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90124d94-05e7-4edf-8e72-308d01ab2e6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:47.235414 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90124d94-05e7-4edf-8e72-308d01ab2e6f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:47.248380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb787baa-0da7-45e7-9964-d1b95d72eca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:47.249356 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb787baa-0da7-45e7-9964-d1b95d72eca0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:47.249704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb787baa-0da7-45e7-9964-d1b95d72eca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:47.250193 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb787baa-0da7-45e7-9964-d1b95d72eca0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:47.261782 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb787baa-0da7-45e7-9964-d1b95d72eca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:47.263367 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb787baa-0da7-45e7-9964-d1b95d72eca0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:47.282778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-cb787baa-0da7-45e7-9964-d1b95d72eca0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:47.282778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:47.282778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:47.282778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:47.282778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:47.282778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:47.282778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:47.282778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:47.282778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:47.282778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:47.282778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:47.282778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:47.282778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:47.282778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:47.282778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:47.282778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:47.283746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:47.283746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:47.283746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:47.283746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:47.283746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:47.283746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:47.283746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:47.283746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:47.283746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:47.283746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:47.283746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:47.283746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:47.283746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:47.283746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:47.283746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:47.283746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:47.283746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:47.285128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:47.285128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:47.285128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:47.285128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 321/658] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:47.285386 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb787baa-0da7-45e7-9964-d1b95d72eca0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:47.326227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:47.349167 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 338/659] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:43:47.350240 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90124d94-05e7-4edf-8e72-308d01ab2e6f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:47.412281 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:47.429585 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb787baa-0da7-45e7-9964-d1b95d72eca0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:47.457535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90124d94-05e7-4edf-8e72-308d01ab2e6f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:47.474002 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4c057-1c91-4471-a237-013e33f60533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:47.474627 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4c057-1c91-4471-a237-013e33f60533 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:47.474946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4c057-1c91-4471-a237-013e33f60533 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:47.475216 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4c057-1c91-4471-a237-013e33f60533 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:47.489391 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4c057-1c91-4471-a237-013e33f60533 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:47.491664 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4c057-1c91-4471-a237-013e33f60533 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:47.499863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4bb2c-9b21-4619-9f30-08ac69e1e879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:47.500468 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4bb2c-9b21-4619-9f30-08ac69e1e879 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:47.500746 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4bb2c-9b21-4619-9f30-08ac69e1e879 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:47.501013 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4bb2c-9b21-4619-9f30-08ac69e1e879 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:47.501647 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4bb2c-9b21-4619-9f30-08ac69e1e879 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:47.502020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4bb2c-9b21-4619-9f30-08ac69e1e879 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:47.503410 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4bb2c-9b21-4619-9f30-08ac69e1e879 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:47.508691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-3ab4c057-1c91-4471-a237-013e33f60533 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 10:43:47.508691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:47.508691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:47.508691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:47.508691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:47.508691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:47.508691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:47.508691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:47.508691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:47.508691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:47.508691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:47.508691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:47.508691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:43:47.508691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:43:47.508691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:43:47.508691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:43:47.509625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:47.509625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:47.509625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:43:47.509625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:47.509625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:43:47.509625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:47.509625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:47.509625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:47.509625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:47.509625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:47.509625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:47.509625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:47.509625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:47.509625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:47.509625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:47.509625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:47.509625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:47.509625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:47.510539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:47.510539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:47.510539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:43:47.510539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:43:47.510539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:43:47.510539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:43:47.510539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:43:47.510539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:43:47.510539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 11 10:43:47.510539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:47.512764 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 322/660] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:43:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:47.513580 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4c057-1c91-4471-a237-013e33f60533 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:47.524659 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 339/661] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:47.524659 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4bb2c-9b21-4619-9f30-08ac69e1e879 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:47.616008 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:47.629232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4c057-1c91-4471-a237-013e33f60533 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:47.643740 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4bb2c-9b21-4619-9f30-08ac69e1e879 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:47.661213 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:47.666293 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670913f-e42b-4612-b8b5-0d94a15adfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:47.666950 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670913f-e42b-4612-b8b5-0d94a15adfda None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:47.667256 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670913f-e42b-4612-b8b5-0d94a15adfda None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:47.667526 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670913f-e42b-4612-b8b5-0d94a15adfda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:47.677815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670913f-e42b-4612-b8b5-0d94a15adfda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:47.679569 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670913f-e42b-4612-b8b5-0d94a15adfda None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:47.680489 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4d8c7-d2e3-4fde-8544-354328bcaa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:47.681149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4d8c7-d2e3-4fde-8544-354328bcaa5a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:47.681424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4d8c7-d2e3-4fde-8544-354328bcaa5a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:47.681688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4d8c7-d2e3-4fde-8544-354328bcaa5a None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:47.682406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4d8c7-d2e3-4fde-8544-354328bcaa5a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:47.682849 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4d8c7-d2e3-4fde-8544-354328bcaa5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:47.684297 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4d8c7-d2e3-4fde-8544-354328bcaa5a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:47.694501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-1670913f-e42b-4612-b8b5-0d94a15adfda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:47.694501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:47.694501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:47.694501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:47.694501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:47.694501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:47.694501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:47.694501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:47.694501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:47.694501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:47.694501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:47.694501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:47.694501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:47.694501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:47.694501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:47.694501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:47.695466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:47.695466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:47.695466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:47.695466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:47.695466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:47.695466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:47.695466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:47.695466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:47.695466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:47.695466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:47.695466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:47.695466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:47.695466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:47.695466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:47.695466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:47.695466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:47.695466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:47.696320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:47.696320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:47.696320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:47.696320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 323/662] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:47.696535 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670913f-e42b-4612-b8b5-0d94a15adfda None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:47.706511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 340/663] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Aug 11 10:43:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:47.708079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1357ae-5147-4d55-b408-7b36747b92dd None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:47.708573 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1357ae-5147-4d55-b408-7b36747b92dd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:47.709147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1357ae-5147-4d55-b408-7b36747b92dd None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:47.710550 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 341/664] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:47.714948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1357ae-5147-4d55-b408-7b36747b92dd None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:47.815191 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670913f-e42b-4612-b8b5-0d94a15adfda None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:47.816347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1357ae-5147-4d55-b408-7b36747b92dd None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:47.851867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e6144-cd71-4641-af2c-41e678d08702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:47.852078 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f91516-6aab-4bf0-963e-c27222f5029e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:47.852500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e6144-cd71-4641-af2c-41e678d08702 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:47.852604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f91516-6aab-4bf0-963e-c27222f5029e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:47.852775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e6144-cd71-4641-af2c-41e678d08702 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:47.852881 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f91516-6aab-4bf0-963e-c27222f5029e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:47.853037 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e6144-cd71-4641-af2c-41e678d08702 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:47.853129 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f91516-6aab-4bf0-963e-c27222f5029e None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:47.853746 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f91516-6aab-4bf0-963e-c27222f5029e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:47.854054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f91516-6aab-4bf0-963e-c27222f5029e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:47.856458 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f91516-6aab-4bf0-963e-c27222f5029e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:47.861626 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e6144-cd71-4641-af2c-41e678d08702 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:47.863189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e6144-cd71-4641-af2c-41e678d08702 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:47.867316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:47.872550 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 342/665] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:47.872550 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f91516-6aab-4bf0-963e-c27222f5029e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:47.878380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-2c3e6144-cd71-4641-af2c-41e678d08702 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:47.878380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:47.878380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:47.878380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:47.878380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:47.878380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:47.878380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:47.878380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:47.878380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:47.878380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:47.878380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:47.878380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:47.878380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:43:47.878380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:43:47.878380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:43:47.880307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:43:47.880307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:47.880307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:47.880307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:47.880307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:47.880307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:47.880307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:47.880307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:47.880307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:47.880307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:47.880307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:47.880307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:47.880307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:47.880307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:47.880307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:47.880307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:47.880307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:47.881366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:43:47.881366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:43:47.881366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:43:47.881366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:43:47.881366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:43:47.881366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:43:47.881366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:47.881366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:47.881366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 324/666] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:47.881366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3667aa0-a30a-4812-8d1b-ceba3380d8d8 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:47.881366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3667aa0-a30a-4812-8d1b-ceba3380d8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:47.881976 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3667aa0-a30a-4812-8d1b-ceba3380d8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:47.899632 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e3667aa0-a30a-4812-8d1b-ceba3380d8d8 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:47.900815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e3667aa0-a30a-4812-8d1b-ceba3380d8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:47.911778 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:47.973001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 325/667] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:47.973859 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3667aa0-a30a-4812-8d1b-ceba3380d8d8 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:47.985995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f91516-6aab-4bf0-963e-c27222f5029e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:48.028577 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b6aa9-eccc-4b69-a69e-b1536af36925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:48.029494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b6aa9-eccc-4b69-a69e-b1536af36925 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:48.029952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b6aa9-eccc-4b69-a69e-b1536af36925 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:48.030428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b6aa9-eccc-4b69-a69e-b1536af36925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:48.088533 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3667aa0-a30a-4812-8d1b-ceba3380d8d8 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:48.103635 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b6aa9-eccc-4b69-a69e-b1536af36925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:48.105412 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b6aa9-eccc-4b69-a69e-b1536af36925 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:48.118979 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:48.124730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21eeda-4141-4ab0-ab39-d7bd953b2a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:48.125364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21eeda-4141-4ab0-ab39-d7bd953b2a4a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:48.125646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21eeda-4141-4ab0-ab39-d7bd953b2a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:48.125946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21eeda-4141-4ab0-ab39-d7bd953b2a4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:48.132611 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21eeda-4141-4ab0-ab39-d7bd953b2a4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:48.134071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21eeda-4141-4ab0-ab39-d7bd953b2a4a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:48.140808 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:48.146098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-6d21eeda-4141-4ab0-ab39-d7bd953b2a4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:48.146098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:48.146098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:48.146098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:48.146098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:48.146098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:48.146098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:48.146098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:48.146098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:48.146098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:48.146098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:48.146098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:48.146098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:43:48.146098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:43:48.146098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:43:48.146975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:43:48.146975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:48.146975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:48.146975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:48.146975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:48.146975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:48.146975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:48.146975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:48.146975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:48.146975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:48.146975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:48.146975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:48.146975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:48.146975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:48.146975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:48.146975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:48.146975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:48.147836 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:43:48.147836 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:43:48.147836 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:43:48.147836 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:43:48.147836 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:43:48.147836 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:43:48.147836 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:48.147836 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:48.152025 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 326/668] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:48.152649 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21eeda-4141-4ab0-ab39-d7bd953b2a4a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:48.215735 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 343/669] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:43:48.217034 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b6aa9-eccc-4b69-a69e-b1536af36925 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:48.262648 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21eeda-4141-4ab0-ab39-d7bd953b2a4a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:48.295651 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a47202-18ea-4a0a-9c29-ad16b142ff9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:48.296254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a47202-18ea-4a0a-9c29-ad16b142ff9d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:48.296532 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a47202-18ea-4a0a-9c29-ad16b142ff9d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:48.296805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a47202-18ea-4a0a-9c29-ad16b142ff9d None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:48.297484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a47202-18ea-4a0a-9c29-ad16b142ff9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:48.297786 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a47202-18ea-4a0a-9c29-ad16b142ff9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:48.299241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a47202-18ea-4a0a-9c29-ad16b142ff9d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:48.316321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 327/670] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:43:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:48.316321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a47202-18ea-4a0a-9c29-ad16b142ff9d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:48.316574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b6aa9-eccc-4b69-a69e-b1536af36925 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:48.348211 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc82e9-eca0-4162-bae9-3181c0929737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:48.348836 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc82e9-eca0-4162-bae9-3181c0929737 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:48.349113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc82e9-eca0-4162-bae9-3181c0929737 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:48.349388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc82e9-eca0-4162-bae9-3181c0929737 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:48.351255 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:48.360486 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc82e9-eca0-4162-bae9-3181c0929737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:48.365101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-79dc82e9-eca0-4162-bae9-3181c0929737 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:48.365101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:48.365101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:48.365101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:48.365101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:48.365101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:48.365101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:48.365101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:48.365101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:48.365101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:48.365101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:48.365101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:48.365101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:48.365101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:48.365101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:48.365101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:48.366162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:48.366162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:48.366162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:48.366162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:48.366162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:48.366162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:48.366162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:48.366162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:48.366162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:48.366162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:48.366162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:48.366162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:48.366162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:48.366162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:48.366162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:48.366162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:48.367007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:48.367007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:48.367007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:48.367007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:48.367007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:48.367007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:48.367007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:48.367007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:48.367007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:48.367007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:48.367007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:48.367007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:48.367007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 344/671] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:43:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:48.367007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc82e9-eca0-4162-bae9-3181c0929737 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:48.368026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:48.417869 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a47202-18ea-4a0a-9c29-ad16b142ff9d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:48.451132 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f4f11-3195-4e92-8cdd-01fee974ac68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:48.451788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f4f11-3195-4e92-8cdd-01fee974ac68 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:48.452062 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f4f11-3195-4e92-8cdd-01fee974ac68 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:48.452351 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f4f11-3195-4e92-8cdd-01fee974ac68 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:48.453026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f4f11-3195-4e92-8cdd-01fee974ac68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:48.453325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f4f11-3195-4e92-8cdd-01fee974ac68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:48.454731 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f4f11-3195-4e92-8cdd-01fee974ac68 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:48.467595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 328/672] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:43:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:48.468178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc82e9-eca0-4162-bae9-3181c0929737 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:48.468824 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b645df5-f93c-414e-8715-dcddcda51301 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:48.469112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b645df5-f93c-414e-8715-dcddcda51301 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:48.469384 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b645df5-f93c-414e-8715-dcddcda51301 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:48.470562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 329/673] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:48.471274 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b645df5-f93c-414e-8715-dcddcda51301 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:48.504626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9fc43-7d1f-4a0a-9d40-ed8f0687e3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:48.505246 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9fc43-7d1f-4a0a-9d40-ed8f0687e3ec None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:48.505536 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9fc43-7d1f-4a0a-9d40-ed8f0687e3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:48.505786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9fc43-7d1f-4a0a-9d40-ed8f0687e3ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:48.515886 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9fc43-7d1f-4a0a-9d40-ed8f0687e3ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:48.517328 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9fc43-7d1f-4a0a-9d40-ed8f0687e3ec None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:48.531598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-99b9fc43-7d1f-4a0a-9d40-ed8f0687e3ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:48.531598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:48.531598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:48.531598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:48.531598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:48.531598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:48.531598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:48.531598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:48.531598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:48.531598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:48.531598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:48.531598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:48.531598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:48.531598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:48.531598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:48.531598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:48.532494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:48.532494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:48.532494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:48.532494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:48.532494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:48.532494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:48.532494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:48.532494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:48.532494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:48.532494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:48.532494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:48.532494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:48.532494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:48.532494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:48.532494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:48.532494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:48.532494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:48.533780 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:48.533780 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:48.533780 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:48.533780 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 345/674] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:48.533780 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9fc43-7d1f-4a0a-9d40-ed8f0687e3ec None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:48.573761 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b645df5-f93c-414e-8715-dcddcda51301 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:48.581766 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:48.584170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:48.607528 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843ec52-5627-4418-9ea9-6cca14ea8429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:48.608122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843ec52-5627-4418-9ea9-6cca14ea8429 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:48.608398 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843ec52-5627-4418-9ea9-6cca14ea8429 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:48.608668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843ec52-5627-4418-9ea9-6cca14ea8429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:48.609631 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843ec52-5627-4418-9ea9-6cca14ea8429 None admin] RBAC: Adding query filter params (role.id=6de833fef4c9456cb5d8ad66caf96586, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=d4fe013f66e2452eaaf84d4b52eca489) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:48.609936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843ec52-5627-4418-9ea9-6cca14ea8429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:48.611391 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843ec52-5627-4418-9ea9-6cca14ea8429 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:48.616864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 330/675] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:43:48 2022] GET /identity/v3/role_assignments?user.id=d4fe013f66e2452eaaf84d4b52eca489&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=6de833fef4c9456cb5d8ad66caf96586 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:48.617623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843ec52-5627-4418-9ea9-6cca14ea8429 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:48.637624 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9fc43-7d1f-4a0a-9d40-ed8f0687e3ec None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:48.675429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40163bcd-5cf1-49f1-8c6b-3c0ab33476a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:48.676069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40163bcd-5cf1-49f1-8c6b-3c0ab33476a5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:48.676235 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40163bcd-5cf1-49f1-8c6b-3c0ab33476a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:48.676517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40163bcd-5cf1-49f1-8c6b-3c0ab33476a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:48.677188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40163bcd-5cf1-49f1-8c6b-3c0ab33476a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:48.677498 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40163bcd-5cf1-49f1-8c6b-3c0ab33476a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:48.678972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40163bcd-5cf1-49f1-8c6b-3c0ab33476a5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:48.687740 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 346/676] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Aug 11 10:43:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:48.689019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fbe15-ac45-464a-a586-e77ff61bc2b4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:48.689305 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fbe15-ac45-464a-a586-e77ff61bc2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:48.689577 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fbe15-ac45-464a-a586-e77ff61bc2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:48.710612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-375fbe15-ac45-464a-a586-e77ff61bc2b4 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:48.712138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-375fbe15-ac45-464a-a586-e77ff61bc2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:48.738593 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843ec52-5627-4418-9ea9-6cca14ea8429 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:48.778053 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53debf05-529a-4f0c-b301-0a41ce8e6353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:48.778393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53debf05-529a-4f0c-b301-0a41ce8e6353 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:48.778677 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53debf05-529a-4f0c-b301-0a41ce8e6353 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:48.779033 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53debf05-529a-4f0c-b301-0a41ce8e6353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:48.779769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53debf05-529a-4f0c-b301-0a41ce8e6353 None admin] RBAC: Adding query filter params (role.id=6de833fef4c9456cb5d8ad66caf96586, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=85551eadb87f496f882c4d6e984144c8) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:48.780079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53debf05-529a-4f0c-b301-0a41ce8e6353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:48.781989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53debf05-529a-4f0c-b301-0a41ce8e6353 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:48.788102 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 331/677] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:43:48 2022] GET /identity/v3/role_assignments?user.id=85551eadb87f496f882c4d6e984144c8&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=6de833fef4c9456cb5d8ad66caf96586 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:48.788907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53debf05-529a-4f0c-b301-0a41ce8e6353 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:48.792631 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 347/678] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:48.793754 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fbe15-ac45-464a-a586-e77ff61bc2b4 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:48.845180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:48.847159 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:48.934164 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53debf05-529a-4f0c-b301-0a41ce8e6353 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:48.943863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fbe15-ac45-464a-a586-e77ff61bc2b4 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:48.975407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae6d41-e7b9-450c-9048-e81634e0ed82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:48.977113 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae6d41-e7b9-450c-9048-e81634e0ed82 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:48.977497 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae6d41-e7b9-450c-9048-e81634e0ed82 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:48.977867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae6d41-e7b9-450c-9048-e81634e0ed82 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:48.978671 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae6d41-e7b9-450c-9048-e81634e0ed82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:48.979111 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae6d41-e7b9-450c-9048-e81634e0ed82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:48.981261 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae6d41-e7b9-450c-9048-e81634e0ed82 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:48.996345 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 332/679] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:48.997381 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae6d41-e7b9-450c-9048-e81634e0ed82 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:49.113288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa552c6-2e01-44b5-91cd-04f47db39331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:49.114234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa552c6-2e01-44b5-91cd-04f47db39331 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:49.114664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa552c6-2e01-44b5-91cd-04f47db39331 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:49.115105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa552c6-2e01-44b5-91cd-04f47db39331 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:49.120905 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:49.126439 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae6d41-e7b9-450c-9048-e81634e0ed82 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:49.127153 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa552c6-2e01-44b5-91cd-04f47db39331 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:49.128823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa552c6-2e01-44b5-91cd-04f47db39331 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:49.144454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-8aa552c6-2e01-44b5-91cd-04f47db39331 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:49.144454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:49.144454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:49.144454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:49.144454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:49.144454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:49.144454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:49.144454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:49.144454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:49.144454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:49.144454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:49.144454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:49.144454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:49.144454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:49.144454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:49.144454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:49.145630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:49.145630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:49.145630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:49.145630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:49.145630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:49.145630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:49.145630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:49.145630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:49.145630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:49.145630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:49.145630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:49.145630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:49.145630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:49.145630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:49.145630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:49.145630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:49.145630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:49.146815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:49.146815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:49.146815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:49.146815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 348/680] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:49.146815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa552c6-2e01-44b5-91cd-04f47db39331 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:49.174186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ad489-1c7b-4af4-88d3-e4a7c87321e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:49.175213 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ad489-1c7b-4af4-88d3-e4a7c87321e6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:49.175687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ad489-1c7b-4af4-88d3-e4a7c87321e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:49.176094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ad489-1c7b-4af4-88d3-e4a7c87321e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:49.195472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ad489-1c7b-4af4-88d3-e4a7c87321e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:49.201936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-bd3ad489-1c7b-4af4-88d3-e4a7c87321e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:43:49.201936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:49.201936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:49.201936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:49.201936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:49.201936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:49.201936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:49.201936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:49.201936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:49.201936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:49.201936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:49.201936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:49.201936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:49.201936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:49.201936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:49.201936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:49.203079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:49.203079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:49.203079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:49.203079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:49.203079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:49.203079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:49.203079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:49.203079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:49.203079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:49.203079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:49.203079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:49.203079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:49.203079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:49.203079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:49.203079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:49.203079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:49.204093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:49.204093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:49.204093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:49.204093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:49.204093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:49.204093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:49.204093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:49.204093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:49.204093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:49.204093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:49.204093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:43:49.204093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:49.206051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 333/681] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:43:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:49.207005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ad489-1c7b-4af4-88d3-e4a7c87321e6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:49.269262 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:49.284312 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa552c6-2e01-44b5-91cd-04f47db39331 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:49.315767 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ad489-1c7b-4af4-88d3-e4a7c87321e6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:49.329122 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8bd58-6c5e-4b1f-9128-2d605dfccedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:49.330062 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8bd58-6c5e-4b1f-9128-2d605dfccedf None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:49.330244 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8bd58-6c5e-4b1f-9128-2d605dfccedf None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:49.330614 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8bd58-6c5e-4b1f-9128-2d605dfccedf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:49.337942 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8bd58-6c5e-4b1f-9128-2d605dfccedf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:49.340116 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8bd58-6c5e-4b1f-9128-2d605dfccedf None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:49.351749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-c2e8bd58-6c5e-4b1f-9128-2d605dfccedf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:49.351749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:49.351749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:49.351749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:49.351749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:49.351749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:49.351749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:49.351749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:49.351749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:49.351749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:49.351749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:49.351749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:49.351749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:43:49.351749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:43:49.351749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:43:49.352892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:43:49.352892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:49.352892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:49.352892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:49.352892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:49.352892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:49.352892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:49.352892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:49.352892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:49.352892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:49.352892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:49.352892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:49.352892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:49.352892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:49.352892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:49.352892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:49.352892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:49.353952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:43:49.353952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:43:49.353952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:43:49.353952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:43:49.353952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:43:49.353952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:43:49.353952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:49.353952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:49.357106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 349/682] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:49.358692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8bd58-6c5e-4b1f-9128-2d605dfccedf None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:49.363376 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f1848-cd11-4867-b728-3051d7da974c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:49.364512 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f1848-cd11-4867-b728-3051d7da974c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:49.365945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f1848-cd11-4867-b728-3051d7da974c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:49.366386 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f1848-cd11-4867-b728-3051d7da974c None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:49.367271 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f1848-cd11-4867-b728-3051d7da974c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:49.367750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f1848-cd11-4867-b728-3051d7da974c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:49.369359 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f1848-cd11-4867-b728-3051d7da974c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:49.385913 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 334/683] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:49.387728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f1848-cd11-4867-b728-3051d7da974c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:49.414365 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:49.493656 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8bd58-6c5e-4b1f-9128-2d605dfccedf None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:49.521084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f1848-cd11-4867-b728-3051d7da974c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:49.539731 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dc082-47f4-4646-950d-fbbaa8fd3b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:49.540348 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dc082-47f4-4646-950d-fbbaa8fd3b10 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:49.541006 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dc082-47f4-4646-950d-fbbaa8fd3b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:49.541294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dc082-47f4-4646-950d-fbbaa8fd3b10 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:49.542019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5dc082-47f4-4646-950d-fbbaa8fd3b10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:49.542327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5dc082-47f4-4646-950d-fbbaa8fd3b10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:49.543718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5dc082-47f4-4646-950d-fbbaa8fd3b10 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:49.555553 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 350/684] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:49.560239 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dc082-47f4-4646-950d-fbbaa8fd3b10 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:49.569818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77407103-3012-4d2e-9a9a-60e06f739abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:49.570654 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77407103-3012-4d2e-9a9a-60e06f739abd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:49.571563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77407103-3012-4d2e-9a9a-60e06f739abd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:49.571988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77407103-3012-4d2e-9a9a-60e06f739abd None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:49.573246 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77407103-3012-4d2e-9a9a-60e06f739abd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:49.574171 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:49.574370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77407103-3012-4d2e-9a9a-60e06f739abd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:49.577006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77407103-3012-4d2e-9a9a-60e06f739abd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:49.598907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 335/685] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:43:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:49.601407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77407103-3012-4d2e-9a9a-60e06f739abd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:49.669684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dc082-47f4-4646-950d-fbbaa8fd3b10 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:49.706332 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904a3e4-3239-44bd-86b3-aae37642158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:49.706986 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904a3e4-3239-44bd-86b3-aae37642158e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:49.707330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904a3e4-3239-44bd-86b3-aae37642158e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:49.707699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904a3e4-3239-44bd-86b3-aae37642158e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:49.708973 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:49.717028 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904a3e4-3239-44bd-86b3-aae37642158e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:49.718978 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904a3e4-3239-44bd-86b3-aae37642158e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:49.732761 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77407103-3012-4d2e-9a9a-60e06f739abd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:49.733984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-9904a3e4-3239-44bd-86b3-aae37642158e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 11 10:43:49.733984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:49.733984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:49.733984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:49.733984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:49.733984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:49.733984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:49.733984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:49.733984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:49.733984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:49.733984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:49.733984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:49.733984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:43:49.733984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:43:49.733984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:43:49.733984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:43:49.735110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:49.735110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:49.735110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:43:49.735110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:49.735110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:43:49.735110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:49.735110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:49.735110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:49.735110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:49.735110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:49.735110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:49.735110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:49.735110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:49.735110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:49.735110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:49.735110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:49.735110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:49.735110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:49.736248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:49.736248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:49.736248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:43:49.736248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:43:49.736248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:43:49.736248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:43:49.736248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:43:49.736248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:43:49.736248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 11 10:43:49.736248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:49.739305 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 351/686] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:43:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:49.740333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904a3e4-3239-44bd-86b3-aae37642158e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:49.779481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e7d10-ec4e-4657-84f8-bc970bd2c8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:49.780184 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e7d10-ec4e-4657-84f8-bc970bd2c8ad None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:49.780472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e7d10-ec4e-4657-84f8-bc970bd2c8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:49.780754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e7d10-ec4e-4657-84f8-bc970bd2c8ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:49.796732 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e7d10-ec4e-4657-84f8-bc970bd2c8ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:49.798769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e7d10-ec4e-4657-84f8-bc970bd2c8ad None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:49.819017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e53e7d10-ec4e-4657-84f8-bc970bd2c8ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:49.819017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:49.819017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:49.819017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:49.819017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:49.819017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:49.819017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:49.819017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:49.819017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:49.819017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:49.819017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:49.819017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:49.819017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:49.819017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:49.819017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:49.819017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:49.820080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:49.820080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:49.820080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:49.820080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:49.820080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:49.820080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:49.820080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:49.820080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:49.820080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:49.820080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:49.820080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:49.820080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:49.820080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:49.820080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:49.820080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:49.820080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:49.820080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:49.820938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:49.820938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:49.820938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:49.820938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 336/687] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:49.822223 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e7d10-ec4e-4657-84f8-bc970bd2c8ad None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:49.834377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:49.875396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904a3e4-3239-44bd-86b3-aae37642158e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:49.924030 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1833e-e29a-45e9-bd1d-9052964138d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:49.924713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1833e-e29a-45e9-bd1d-9052964138d0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:49.925025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1833e-e29a-45e9-bd1d-9052964138d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:49.929262 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1833e-e29a-45e9-bd1d-9052964138d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:49.929262 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1833e-e29a-45e9-bd1d-9052964138d0 None admin] RBAC: Adding query filter params (role.id=6de833fef4c9456cb5d8ad66caf96586, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=6302b1f98544470a8986055a68bcd948) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:49.929262 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1833e-e29a-45e9-bd1d-9052964138d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:49.929262 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1833e-e29a-45e9-bd1d-9052964138d0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:49.937817 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 352/688] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:43:49 2022] GET /identity/v3/role_assignments?user.id=6302b1f98544470a8986055a68bcd948&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=6de833fef4c9456cb5d8ad66caf96586 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:49.937817 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1833e-e29a-45e9-bd1d-9052964138d0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:49.970495 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e7d10-ec4e-4657-84f8-bc970bd2c8ad None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:50.008014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:50.016341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c864d-c549-475d-8c88-b2a8490f031d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:50.017558 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c864d-c549-475d-8c88-b2a8490f031d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:50.017993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c864d-c549-475d-8c88-b2a8490f031d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:50.018420 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c864d-c549-475d-8c88-b2a8490f031d None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:50.019489 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c864d-c549-475d-8c88-b2a8490f031d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:50.020674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c864d-c549-475d-8c88-b2a8490f031d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:50.021806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c864d-c549-475d-8c88-b2a8490f031d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:50.046836 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 337/689] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Aug 11 10:43:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:50.053499 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c864d-c549-475d-8c88-b2a8490f031d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:50.168910 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1833e-e29a-45e9-bd1d-9052964138d0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:50.184654 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c864d-c549-475d-8c88-b2a8490f031d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:50.227571 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404ef39-1b87-4f48-86c6-b74241624eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:50.228538 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404ef39-1b87-4f48-86c6-b74241624eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:50.229041 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404ef39-1b87-4f48-86c6-b74241624eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:50.230109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404ef39-1b87-4f48-86c6-b74241624eb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:50.231027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404ef39-1b87-4f48-86c6-b74241624eb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:50.231515 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404ef39-1b87-4f48-86c6-b74241624eb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:50.232281 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6ef44-2f7b-45db-b07f-22b71a969335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:50.233014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6ef44-2f7b-45db-b07f-22b71a969335 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:50.233400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6ef44-2f7b-45db-b07f-22b71a969335 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:50.233547 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404ef39-1b87-4f48-86c6-b74241624eb3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:50.234106 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6ef44-2f7b-45db-b07f-22b71a969335 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:50.236702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:50.250854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 353/690] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:50.259747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404ef39-1b87-4f48-86c6-b74241624eb3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:50.319395 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:50.334802 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6ef44-2f7b-45db-b07f-22b71a969335 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:50.334802 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6ef44-2f7b-45db-b07f-22b71a969335 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:50.402499 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404ef39-1b87-4f48-86c6-b74241624eb3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:50.479845 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c95d03-a4a9-4e00-9861-cb47250cc8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:50.480483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c95d03-a4a9-4e00-9861-cb47250cc8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:50.480760 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c95d03-a4a9-4e00-9861-cb47250cc8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:50.481027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c95d03-a4a9-4e00-9861-cb47250cc8d7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:50.485902 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 338/691] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 11 10:43:50.492106 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6ef44-2f7b-45db-b07f-22b71a969335 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:50.505258 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c95d03-a4a9-4e00-9861-cb47250cc8d7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:50.506738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c95d03-a4a9-4e00-9861-cb47250cc8d7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:50.532429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-38c95d03-a4a9-4e00-9861-cb47250cc8d7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 10:43:50.532429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:50.532429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:50.532429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:50.532429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:50.532429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:50.532429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:50.532429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:50.532429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:50.532429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:50.532429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:50.532429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:50.532429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:43:50.532429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:43:50.532429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:43:50.532429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:43:50.533494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:50.533494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:50.533494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:43:50.533494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:50.533494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:43:50.533494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:50.533494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:50.533494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:50.533494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:50.533494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:50.533494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:50.533494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:50.533494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:50.533494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:50.533494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:50.533494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:50.533494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:50.533494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:50.534411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:50.534411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:50.534411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:43:50.534411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:43:50.534411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:43:50.534411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:43:50.534411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:43:50.534411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:43:50.534411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 10:43:50.534411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:50.534411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 354/692] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Aug 11 10:43:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:50.544084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c95d03-a4a9-4e00-9861-cb47250cc8d7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:50.596409 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:50.609665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6ef44-2f7b-45db-b07f-22b71a969335 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:50.647869 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6031d-4173-449e-98a4-30d8038758c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:50.648513 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6031d-4173-449e-98a4-30d8038758c8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:50.648795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6031d-4173-449e-98a4-30d8038758c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:50.649192 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6031d-4173-449e-98a4-30d8038758c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:50.660470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6031d-4173-449e-98a4-30d8038758c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:50.661927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6031d-4173-449e-98a4-30d8038758c8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:50.678675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-45a6031d-4173-449e-98a4-30d8038758c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:50.678675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:50.678675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:50.678675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:50.678675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:50.678675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:50.678675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:50.678675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:50.678675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:50.678675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:50.678675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:50.678675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:50.678675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:50.678675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:50.678675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:50.678675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:50.679656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:50.679656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:50.679656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:50.679656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:50.679656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:50.679656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:50.679656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:50.679656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:50.679656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:50.679656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:50.679656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:50.679656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:50.679656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:50.679656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:50.679656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:50.679656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:50.679656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:50.680534 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:50.680534 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:50.680534 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:50.680699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:50.681704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 339/693] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:50.688256 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6031d-4173-449e-98a4-30d8038758c8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:50.800346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6031d-4173-449e-98a4-30d8038758c8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:50.829713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c95d03-a4a9-4e00-9861-cb47250cc8d7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:50.842383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2954ea-5da3-44ad-8595-2879b59c2489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:50.843113 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2954ea-5da3-44ad-8595-2879b59c2489 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:50.843389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2954ea-5da3-44ad-8595-2879b59c2489 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:50.843664 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2954ea-5da3-44ad-8595-2879b59c2489 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:50.844296 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2954ea-5da3-44ad-8595-2879b59c2489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:50.844593 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2954ea-5da3-44ad-8595-2879b59c2489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:50.845951 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2954ea-5da3-44ad-8595-2879b59c2489 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:50.860658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:50.865182 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 340/694] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:50.885569 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2954ea-5da3-44ad-8595-2879b59c2489 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:50.888213 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9f6ad-6189-4bad-928d-d603b7b8d7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:50.888998 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9f6ad-6189-4bad-928d-d603b7b8d7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:50.889287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9f6ad-6189-4bad-928d-d603b7b8d7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:50.889564 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9f6ad-6189-4bad-928d-d603b7b8d7c5 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:50.890305 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9f6ad-6189-4bad-928d-d603b7b8d7c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:50.890615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9f6ad-6189-4bad-928d-d603b7b8d7c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:50.892133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9f6ad-6189-4bad-928d-d603b7b8d7c5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:50.911946 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 355/695] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Aug 11 10:43:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:50.918243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9f6ad-6189-4bad-928d-d603b7b8d7c5 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:51.015362 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2954ea-5da3-44ad-8595-2879b59c2489 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:51.057714 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79ea76-a6b0-4af6-a7b8-0703e6f9609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:51.058802 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79ea76-a6b0-4af6-a7b8-0703e6f9609b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:51.059080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79ea76-a6b0-4af6-a7b8-0703e6f9609b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:51.059685 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79ea76-a6b0-4af6-a7b8-0703e6f9609b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:51.068640 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79ea76-a6b0-4af6-a7b8-0703e6f9609b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:51.070923 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79ea76-a6b0-4af6-a7b8-0703e6f9609b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:51.082668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-dc79ea76-a6b0-4af6-a7b8-0703e6f9609b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:51.082668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:51.082668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:51.082668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:51.082668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:51.082668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:51.082668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:51.082668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:51.082668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:51.082668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:51.082668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:51.082668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:51.082668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:43:51.082668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:43:51.082668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:43:51.083757 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:43:51.083757 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:51.083757 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:51.083757 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:51.083757 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:51.083757 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:51.083757 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:51.083757 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:51.083757 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:51.083757 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:51.083757 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:51.083757 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:51.083757 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:51.083757 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:51.083757 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:51.083757 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:51.083757 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:51.084826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:43:51.084826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:43:51.084826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:43:51.084826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:43:51.084826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:43:51.084826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:43:51.084826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:51.084826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:51.086803 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 341/696] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:43:51.088167 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25e285-64f8-4666-aa01-9280ead0c780 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:51.088592 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25e285-64f8-4666-aa01-9280ead0c780 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:51.089715 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25e285-64f8-4666-aa01-9280ead0c780 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:51.091378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 342/697] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:51.092700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25e285-64f8-4666-aa01-9280ead0c780 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:51.113098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9f6ad-6189-4bad-928d-d603b7b8d7c5 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:51.133605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:51.153878 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace694e-77d4-4889-ae23-23e634eb6700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:51.154591 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace694e-77d4-4889-ae23-23e634eb6700 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:51.154986 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace694e-77d4-4889-ae23-23e634eb6700 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:51.155322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace694e-77d4-4889-ae23-23e634eb6700 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:51.156529 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:51.199700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25e285-64f8-4666-aa01-9280ead0c780 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:51.228216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace694e-77d4-4889-ae23-23e634eb6700 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:51.230205 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace694e-77d4-4889-ae23-23e634eb6700 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:51.240860 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c5156-c87b-4d59-931e-35e5e8e3ce44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:51.241486 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c5156-c87b-4d59-931e-35e5e8e3ce44 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:51.241770 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c5156-c87b-4d59-931e-35e5e8e3ce44 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:51.242046 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c5156-c87b-4d59-931e-35e5e8e3ce44 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:51.242769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c5156-c87b-4d59-931e-35e5e8e3ce44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:51.243102 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c5156-c87b-4d59-931e-35e5e8e3ce44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:51.244527 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c5156-c87b-4d59-931e-35e5e8e3ce44 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:51.257760 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 343/698] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:43:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:51.263651 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fc627-c5a9-43ef-8c32-1405f089e2a9 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:51.263948 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fc627-c5a9-43ef-8c32-1405f089e2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:51.264229 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fc627-c5a9-43ef-8c32-1405f089e2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:51.281632 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-dd1fc627-c5a9-43ef-8c32-1405f089e2a9 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:51.282845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-dd1fc627-c5a9-43ef-8c32-1405f089e2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:51.342619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 356/699] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:43:51.342619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232ecec-749b-405f-bd87-e04895018b49 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:51.342619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232ecec-749b-405f-bd87-e04895018b49 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:51.342619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232ecec-749b-405f-bd87-e04895018b49 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:51.342619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 357/700] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:51.342619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232ecec-749b-405f-bd87-e04895018b49 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:51.352391 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 344/701] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:51.353285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fc627-c5a9-43ef-8c32-1405f089e2a9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:51.364635 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:51.421147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:51.455469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232ecec-749b-405f-bd87-e04895018b49 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:51.477425 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fc627-c5a9-43ef-8c32-1405f089e2a9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:51.490408 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28431709-3dd5-4c71-a63d-6ff9e62bcfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:51.491037 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28431709-3dd5-4c71-a63d-6ff9e62bcfce None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:51.491319 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28431709-3dd5-4c71-a63d-6ff9e62bcfce None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:51.491590 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28431709-3dd5-4c71-a63d-6ff9e62bcfce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:51.492311 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28431709-3dd5-4c71-a63d-6ff9e62bcfce None admin] RBAC: Adding query filter params (role.id=6de833fef4c9456cb5d8ad66caf96586, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=cbd25d1bde0c4703b61e0edaf5b658d4) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:51.492615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28431709-3dd5-4c71-a63d-6ff9e62bcfce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:51.494183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28431709-3dd5-4c71-a63d-6ff9e62bcfce None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:51.500511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 358/702] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:43:51 2022] GET /identity/v3/role_assignments?user.id=cbd25d1bde0c4703b61e0edaf5b658d4&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=6de833fef4c9456cb5d8ad66caf96586 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:51.501659 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d5132-16e6-47c3-8331-18cc11873191 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:51.501945 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d5132-16e6-47c3-8331-18cc11873191 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:51.502215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d5132-16e6-47c3-8331-18cc11873191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:51.521729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e57d5132-16e6-47c3-8331-18cc11873191 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:51.523075 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e57d5132-16e6-47c3-8331-18cc11873191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:51.531224 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cb163-28f6-4473-b2f1-b70745902597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:51.532278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cb163-28f6-4473-b2f1-b70745902597 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:51.533510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cb163-28f6-4473-b2f1-b70745902597 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:51.533980 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cb163-28f6-4473-b2f1-b70745902597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:51.549166 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cb163-28f6-4473-b2f1-b70745902597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:51.551295 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cb163-28f6-4473-b2f1-b70745902597 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:51.573773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-971cb163-28f6-4473-b2f1-b70745902597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:51.573773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:51.573773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:51.573773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:51.573773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:51.573773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:51.573773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:51.573773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:51.573773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:51.573773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:51.573773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:51.573773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:51.573773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:51.573773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:51.573773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:51.573773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:51.574922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:51.574922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:51.574922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:51.574922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:51.574922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:51.574922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:51.574922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:51.574922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:51.574922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:51.574922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:51.574922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:51.574922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:51.574922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:51.574922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:51.574922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:51.574922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:51.574922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:51.575805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:51.575805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:51.575805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:51.578575 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 345/703] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:51.580053 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cb163-28f6-4473-b2f1-b70745902597 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:51.606783 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 359/704] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:51.608018 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d5132-16e6-47c3-8331-18cc11873191 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:51.628960 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:51.720607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cb163-28f6-4473-b2f1-b70745902597 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:51.722094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:51.754174 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d5132-16e6-47c3-8331-18cc11873191 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:51.769988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba75ae8-e59d-444c-a2ef-5592857c230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:51.770630 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba75ae8-e59d-444c-a2ef-5592857c230d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:51.770947 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba75ae8-e59d-444c-a2ef-5592857c230d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:51.771366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba75ae8-e59d-444c-a2ef-5592857c230d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:51.785250 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba75ae8-e59d-444c-a2ef-5592857c230d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:51.786725 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba75ae8-e59d-444c-a2ef-5592857c230d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:51.804185 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf3ef4-ee6b-47d5-b5e1-1e03d3eb33d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:51.804881 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf3ef4-ee6b-47d5-b5e1-1e03d3eb33d5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:51.805222 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf3ef4-ee6b-47d5-b5e1-1e03d3eb33d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:51.805609 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf3ef4-ee6b-47d5-b5e1-1e03d3eb33d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:51.806248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-5ba75ae8-e59d-444c-a2ef-5592857c230d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:51.806248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:51.806248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:51.806248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:51.806248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:51.806248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:51.806248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:51.806248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:51.806248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:51.806248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:51.806248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:51.806248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:51.806248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:51.806248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:51.806248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:51.806248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:51.807962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:51.807962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:51.807962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:51.807962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:51.807962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:51.807962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:51.807962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:51.807962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:51.807962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:51.807962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:51.807962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:51.807962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:51.807962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:51.807962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:51.807962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:51.807962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:51.807962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:51.809168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:51.809168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:51.809168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:51.809369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf3ef4-ee6b-47d5-b5e1-1e03d3eb33d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:51.809369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf3ef4-ee6b-47d5-b5e1-1e03d3eb33d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:51.809525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 346/705] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:51.809525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba75ae8-e59d-444c-a2ef-5592857c230d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:51.809677 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf3ef4-ee6b-47d5-b5e1-1e03d3eb33d5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:51.827018 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 360/706] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:51.828224 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf3ef4-ee6b-47d5-b5e1-1e03d3eb33d5 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:51.925390 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:51.940446 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba75ae8-e59d-444c-a2ef-5592857c230d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:51.970680 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf3ef4-ee6b-47d5-b5e1-1e03d3eb33d5 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:51.996594 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace71337-9f69-490e-a232-5dc297d89e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:51.998477 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace71337-9f69-490e-a232-5dc297d89e2d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:52.000349 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace71337-9f69-490e-a232-5dc297d89e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:52.000784 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace71337-9f69-490e-a232-5dc297d89e2d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:52.002798 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace71337-9f69-490e-a232-5dc297d89e2d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:52.004312 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace71337-9f69-490e-a232-5dc297d89e2d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:52.025259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ace71337-9f69-490e-a232-5dc297d89e2d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 10:43:52.025259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:52.025259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:43:52.025259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:43:52.025259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:43:52.025259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:43:52.025259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:43:52.025259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:43:52.025259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 10:43:52.025259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:52.025259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:43:52.025259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:52.025259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:52.025259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:52.025259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:52.025259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:52.025259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:52.026646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:52.026646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:52.026646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:52.026646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:52.026646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:52.026646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:52.026646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:43:52.026646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:43:52.026646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:43:52.026646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:43:52.026646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:52.026646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:52.026646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:52.026646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:52.026646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:52.026646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:52.027507 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:52.027507 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:52.027507 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:52.027507 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:52.027507 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:52.027507 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:52.027507 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:52.027507 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:52.027507 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:52.027507 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:52.027507 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:43:52.027507 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:43:52.027507 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 10:43:52.027507 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:52.035643 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 347/707] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Aug 11 10:43:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:52.035878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace71337-9f69-490e-a232-5dc297d89e2d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:52.050995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90dbfdb-4ed8-4ba6-8c05-e22f2f0c7f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:52.051627 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dbfdb-4ed8-4ba6-8c05-e22f2f0c7f7d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:52.051909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dbfdb-4ed8-4ba6-8c05-e22f2f0c7f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:52.052185 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dbfdb-4ed8-4ba6-8c05-e22f2f0c7f7d None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:52.052840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90dbfdb-4ed8-4ba6-8c05-e22f2f0c7f7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:52.053168 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90dbfdb-4ed8-4ba6-8c05-e22f2f0c7f7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:52.055115 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90dbfdb-4ed8-4ba6-8c05-e22f2f0c7f7d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:52.071901 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:52.078794 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 361/708] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:52.079976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90dbfdb-4ed8-4ba6-8c05-e22f2f0c7f7d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:52.165242 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace71337-9f69-490e-a232-5dc297d89e2d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:52.193618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90dbfdb-4ed8-4ba6-8c05-e22f2f0c7f7d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:52.214575 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779ddb4-6637-4ca0-9663-0d47e99269cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:52.215573 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779ddb4-6637-4ca0-9663-0d47e99269cf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:52.216128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779ddb4-6637-4ca0-9663-0d47e99269cf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:52.216545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779ddb4-6637-4ca0-9663-0d47e99269cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:52.223053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:52.225193 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779ddb4-6637-4ca0-9663-0d47e99269cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:52.226860 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779ddb4-6637-4ca0-9663-0d47e99269cf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:52.232305 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2be40-dae3-49fd-9412-f99470852190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:52.233070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2be40-dae3-49fd-9412-f99470852190 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:52.238026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2be40-dae3-49fd-9412-f99470852190 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:52.238026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2be40-dae3-49fd-9412-f99470852190 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:52.238026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2be40-dae3-49fd-9412-f99470852190 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:52.238026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2be40-dae3-49fd-9412-f99470852190 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:52.238026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2be40-dae3-49fd-9412-f99470852190 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:52.243317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-6779ddb4-6637-4ca0-9663-0d47e99269cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:52.243317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:52.243317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:52.243317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:52.243317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:52.243317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:52.243317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:52.243317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:52.243317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:52.243317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:52.243317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:52.243317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:52.243317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:43:52.243317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:43:52.243317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:43:52.244179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:43:52.244179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:52.244179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:52.244179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:52.244179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:52.244179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:52.244179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:52.244179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:52.244179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:52.244179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:52.244179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:52.244179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:52.244179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:52.244179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:52.244179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:52.244179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:52.244179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:52.245606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:43:52.245606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:43:52.245606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:43:52.245606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:43:52.245606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:43:52.245606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:43:52.245606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:52.245606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:52.247217 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 362/709] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Aug 11 10:43:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:52.248318 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2be40-dae3-49fd-9412-f99470852190 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:52.248723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 348/710] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:52.255990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779ddb4-6637-4ca0-9663-0d47e99269cf None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:52.357986 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:52.382962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779ddb4-6637-4ca0-9663-0d47e99269cf None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:52.430800 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd004c80-2908-4270-9f57-388e5db613cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:52.431472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd004c80-2908-4270-9f57-388e5db613cf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:52.431745 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd004c80-2908-4270-9f57-388e5db613cf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:52.432023 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd004c80-2908-4270-9f57-388e5db613cf None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:52.433264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd004c80-2908-4270-9f57-388e5db613cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:52.433569 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd004c80-2908-4270-9f57-388e5db613cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:52.435054 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd004c80-2908-4270-9f57-388e5db613cf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:52.447891 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 349/711] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:43:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:52.448834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd004c80-2908-4270-9f57-388e5db613cf None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:52.460814 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2be40-dae3-49fd-9412-f99470852190 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:52.497999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125d9f9-e13a-4993-aacd-6eb0e0519cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:52.498796 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125d9f9-e13a-4993-aacd-6eb0e0519cf4 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:52.499142 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125d9f9-e13a-4993-aacd-6eb0e0519cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:52.499507 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125d9f9-e13a-4993-aacd-6eb0e0519cf4 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:52.500202 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125d9f9-e13a-4993-aacd-6eb0e0519cf4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:52.501692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125d9f9-e13a-4993-aacd-6eb0e0519cf4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:52.578977 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd004c80-2908-4270-9f57-388e5db613cf None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:52.590831 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 363/712] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Aug 11 10:43:52 2022] POST /identity/v3/users => generated 254 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:43:52.590831 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d99130-17a3-461d-af88-b2899360e7d3 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:52.590831 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d99130-17a3-461d-af88-b2899360e7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:52.590831 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d99130-17a3-461d-af88-b2899360e7d3 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:52.590831 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 364/713] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:52.590831 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d99130-17a3-461d-af88-b2899360e7d3 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:52.636926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4525c0a-19af-41ca-a96c-29bcc1cdc711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:52.637711 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4525c0a-19af-41ca-a96c-29bcc1cdc711 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:52.637990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4525c0a-19af-41ca-a96c-29bcc1cdc711 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:52.638266 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4525c0a-19af-41ca-a96c-29bcc1cdc711 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:52.638934 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4525c0a-19af-41ca-a96c-29bcc1cdc711 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:52.639239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4525c0a-19af-41ca-a96c-29bcc1cdc711 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:52.640862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4525c0a-19af-41ca-a96c-29bcc1cdc711 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:52.647526 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 350/714] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Aug 11 10:43:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:52.648811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305cb73-5127-4baf-96cc-3288f0d9c463 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:52.649097 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305cb73-5127-4baf-96cc-3288f0d9c463 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:52.649371 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305cb73-5127-4baf-96cc-3288f0d9c463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:52.659543 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:52.676049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:52.684894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6305cb73-5127-4baf-96cc-3288f0d9c463 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:52.686133 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6305cb73-5127-4baf-96cc-3288f0d9c463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:52.819460 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 351/715] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:52.837748 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d99130-17a3-461d-af88-b2899360e7d3 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:52.849475 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305cb73-5127-4baf-96cc-3288f0d9c463 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:52.888548 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910ad36-16e3-4eaa-b835-8bdbb218b7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:52.889171 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910ad36-16e3-4eaa-b835-8bdbb218b7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:52.890330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910ad36-16e3-4eaa-b835-8bdbb218b7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:52.890615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910ad36-16e3-4eaa-b835-8bdbb218b7f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:52.892107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910ad36-16e3-4eaa-b835-8bdbb218b7f7 None admin] RBAC: Adding query filter params (role.id=00c6de5dd6cd4267ba05941ddb91e6ad, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=9267752ac6724013bc1edcdecff48dd7) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:52.892418 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910ad36-16e3-4eaa-b835-8bdbb218b7f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:52.894216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910ad36-16e3-4eaa-b835-8bdbb218b7f7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:52.904963 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 365/716] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:43:52 2022] GET /identity/v3/role_assignments?user.id=9267752ac6724013bc1edcdecff48dd7&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=00c6de5dd6cd4267ba05941ddb91e6ad => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:53.011341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305cb73-5127-4baf-96cc-3288f0d9c463 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:53.063858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:53.069437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22098947-c76a-48c4-9a89-cc82019802d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:53.070159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22098947-c76a-48c4-9a89-cc82019802d0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:53.070387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22098947-c76a-48c4-9a89-cc82019802d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:53.070726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22098947-c76a-48c4-9a89-cc82019802d0 None admin] PATH_INFO: `/v3/services/network` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:53.071386 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22098947-c76a-48c4-9a89-cc82019802d0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:53.073074 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22098947-c76a-48c4-9a89-cc82019802d0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:53.086687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-22098947-c76a-48c4-9a89-cc82019802d0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 10:43:53.086687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:53.086687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:43:53.086687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:43:53.086687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:43:53.086687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:43:53.086687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:43:53.086687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:43:53.086687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 10:43:53.086687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:53.086687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:43:53.086687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:53.086687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:53.086687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:53.086687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:53.086687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:53.086687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:53.087720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:53.087720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:53.087720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:53.087720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:53.087720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:53.087720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:53.087720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:43:53.087720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:43:53.087720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:43:53.087720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:43:53.087720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:53.087720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:53.087720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:53.087720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:53.087720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:53.087720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:53.089674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:53.089674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:53.089674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:53.089674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:53.089674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:53.089674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:53.089674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:53.089674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:53.089674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:53.089674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:53.089674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:43:53.089674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:43:53.089674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 10:43:53.089674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:53.089674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 352/717] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:52 2022] GET /identity/v3/services/network => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:43:53.095123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910ad36-16e3-4eaa-b835-8bdbb218b7f7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:53.219292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910ad36-16e3-4eaa-b835-8bdbb218b7f7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:53.234142 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:53.257481 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1fe6fe-158b-4a1b-a882-87047f09f14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:53.258102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fe6fe-158b-4a1b-a882-87047f09f14b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:53.258384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fe6fe-158b-4a1b-a882-87047f09f14b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:53.258655 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fe6fe-158b-4a1b-a882-87047f09f14b None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:53.259321 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fe6fe-158b-4a1b-a882-87047f09f14b None admin] RBAC: Adding query filter params (name=network) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:53.259626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fe6fe-158b-4a1b-a882-87047f09f14b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:53.261210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1fe6fe-158b-4a1b-a882-87047f09f14b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:53.266065 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 366/718] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Aug 11 10:43:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:53.271789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22098947-c76a-48c4-9a89-cc82019802d0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:53.387994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22098947-c76a-48c4-9a89-cc82019802d0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:53.440865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247af6f-09f7-48b3-a03b-6a2b3726717b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:53.441879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247af6f-09f7-48b3-a03b-6a2b3726717b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:53.442363 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247af6f-09f7-48b3-a03b-6a2b3726717b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:53.442862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247af6f-09f7-48b3-a03b-6a2b3726717b None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:53.443711 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247af6f-09f7-48b3-a03b-6a2b3726717b None admin] RBAC: Adding query filter params (type=network) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:53.444228 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247af6f-09f7-48b3-a03b-6a2b3726717b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:53.445787 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247af6f-09f7-48b3-a03b-6a2b3726717b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:53.454512 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 353/719] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Aug 11 10:43:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:53.856974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6363ed7-ab41-4d18-ba80-0007737e66d3 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:53.857301 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6363ed7-ab41-4d18-ba80-0007737e66d3 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:53.857524 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6363ed7-ab41-4d18-ba80-0007737e66d3 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:53.859372 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 367/720] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:53.864744 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde24812-550b-43f9-bc51-8d4439b28130 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:53.865195 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde24812-550b-43f9-bc51-8d4439b28130 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:53.865380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde24812-550b-43f9-bc51-8d4439b28130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:53.893805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-bde24812-550b-43f9-bc51-8d4439b28130 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:53.895028 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bde24812-550b-43f9-bc51-8d4439b28130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:53.969619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:53.984603 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 354/721] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:54.025493 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6363ed7-ab41-4d18-ba80-0007737e66d3 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:54.171958 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6363ed7-ab41-4d18-ba80-0007737e66d3 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:54.216328 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6da30-ff82-43bd-98e9-ecd2e7f863e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:54.216960 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6da30-ff82-43bd-98e9-ecd2e7f863e9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:54.217241 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6da30-ff82-43bd-98e9-ecd2e7f863e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:54.217506 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6da30-ff82-43bd-98e9-ecd2e7f863e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:54.235547 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6da30-ff82-43bd-98e9-ecd2e7f863e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:54.240079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-2ba6da30-ff82-43bd-98e9-ecd2e7f863e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:43:54.240079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:54.240079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:54.240079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:54.240079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:54.240079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:54.240079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:54.240079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:54.240079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:54.240079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:54.240079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:54.240079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:54.240079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:54.240079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:54.240079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:54.240079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:54.240974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:54.240974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:54.240974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:54.240974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:54.240974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:54.240974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:54.240974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:54.240974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:54.240974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:54.240974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:54.240974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:54.240974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:54.240974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:54.240974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:54.240974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:54.240974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:54.242201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:54.242201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:54.242201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:54.242201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:54.242201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:54.242201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:54.242201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:54.242201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:54.242201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:54.242201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:54.242201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:43:54.242201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:54.242201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 368/722] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:43:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:54.247585 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde24812-550b-43f9-bc51-8d4439b28130 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:54.396567 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde24812-550b-43f9-bc51-8d4439b28130 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:54.439784 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e53194-0b5b-45fe-9d7a-155cfefe0622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:54.440327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e53194-0b5b-45fe-9d7a-155cfefe0622 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:54.440608 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e53194-0b5b-45fe-9d7a-155cfefe0622 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:54.440876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e53194-0b5b-45fe-9d7a-155cfefe0622 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:54.441538 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e53194-0b5b-45fe-9d7a-155cfefe0622 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:54.441837 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e53194-0b5b-45fe-9d7a-155cfefe0622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:54.443219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e53194-0b5b-45fe-9d7a-155cfefe0622 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:54.456327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 355/723] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:54.461774 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6da30-ff82-43bd-98e9-ecd2e7f863e9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:54.505624 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:54.590936 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6da30-ff82-43bd-98e9-ecd2e7f863e9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:54.638229 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6a45f-6d72-4f6b-8638-309c467d21ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:54.638902 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6a45f-6d72-4f6b-8638-309c467d21ab None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:54.639180 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6a45f-6d72-4f6b-8638-309c467d21ab None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:54.639446 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6a45f-6d72-4f6b-8638-309c467d21ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:54.660575 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6a45f-6d72-4f6b-8638-309c467d21ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:54.662011 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6a45f-6d72-4f6b-8638-309c467d21ab None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:54.682919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-8fe6a45f-6d72-4f6b-8638-309c467d21ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:54.682919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:54.682919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:54.682919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:54.682919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:54.682919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:54.682919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:54.682919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:54.682919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:54.682919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:54.682919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:54.682919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:54.682919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:54.682919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:54.682919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:54.682919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:54.684398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:54.684398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:54.684398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:54.684398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:54.684398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:54.684398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:54.684398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:54.684398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:54.684398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:54.684398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:54.684398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:54.684398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:54.684398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:54.684398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:54.684398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:54.684398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:54.684398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:54.685528 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:54.685528 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:54.685528 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:54.685528 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 369/724] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:54.689595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e53194-0b5b-45fe-9d7a-155cfefe0622 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:54.743612 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:54.790896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e53194-0b5b-45fe-9d7a-155cfefe0622 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:54.826296 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b2f3d-1547-443a-817e-0732281d698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:54.826923 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b2f3d-1547-443a-817e-0732281d698e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:54.827202 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b2f3d-1547-443a-817e-0732281d698e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:54.827474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b2f3d-1547-443a-817e-0732281d698e None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:54.828162 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b2f3d-1547-443a-817e-0732281d698e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:54.828460 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b2f3d-1547-443a-817e-0732281d698e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:54.829882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b2f3d-1547-443a-817e-0732281d698e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:54.842887 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 356/725] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:54.848368 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6a45f-6d72-4f6b-8638-309c467d21ab None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:54.954357 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:54.965842 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6a45f-6d72-4f6b-8638-309c467d21ab None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:55.002858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d625c-fcdf-4a28-95c3-2418187e95d2 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:55.003369 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d625c-fcdf-4a28-95c3-2418187e95d2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:55.003369 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d625c-fcdf-4a28-95c3-2418187e95d2 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:55.004636 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 357/726] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:43:55.013826 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8e40c-8a80-46f5-a448-79a5a8a0d57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:55.014478 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8e40c-8a80-46f5-a448-79a5a8a0d57d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:55.014783 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8e40c-8a80-46f5-a448-79a5a8a0d57d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:55.016311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe002c2-465d-48d5-b53d-520d898d5dd7 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:55.016586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe002c2-465d-48d5-b53d-520d898d5dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:55.016856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe002c2-465d-48d5-b53d-520d898d5dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:55.023633 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8e40c-8a80-46f5-a448-79a5a8a0d57d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:55.039190 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8e40c-8a80-46f5-a448-79a5a8a0d57d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:55.040660 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8e40c-8a80-46f5-a448-79a5a8a0d57d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:55.045481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5fe002c2-465d-48d5-b53d-520d898d5dd7 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:55.046659 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5fe002c2-465d-48d5-b53d-520d898d5dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:55.064771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-a4a8e40c-8a80-46f5-a448-79a5a8a0d57d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 11 10:43:55.064771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:55.064771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:55.064771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:55.064771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:55.064771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:55.064771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:55.064771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:55.064771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:55.064771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:55.064771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:55.064771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:55.064771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:43:55.064771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:43:55.064771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:43:55.064771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:43:55.065763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:55.065763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:55.065763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:43:55.065763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:55.065763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:43:55.065763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:55.065763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:55.065763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:55.065763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:55.065763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:55.065763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:55.065763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:55.065763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:55.065763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:55.065763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:55.065763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:55.065763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:55.065763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:55.066678 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:55.066678 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:55.066678 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:43:55.066678 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:43:55.066678 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:43:55.066678 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:43:55.066678 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:43:55.066678 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:43:55.066678 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 11 10:43:55.066678 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:55.072084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 370/727] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:43:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:55.075316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8e40c-8a80-46f5-a448-79a5a8a0d57d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:55.179733 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 358/728] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:55.203471 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe002c2-465d-48d5-b53d-520d898d5dd7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:55.250207 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8e40c-8a80-46f5-a448-79a5a8a0d57d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:55.258447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:55.286105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7e0d0-c86a-4af3-a392-30480a43e26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:55.286779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7e0d0-c86a-4af3-a392-30480a43e26a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:55.287080 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7e0d0-c86a-4af3-a392-30480a43e26a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:55.287353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7e0d0-c86a-4af3-a392-30480a43e26a None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:55.288092 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7e0d0-c86a-4af3-a392-30480a43e26a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:55.288396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7e0d0-c86a-4af3-a392-30480a43e26a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:55.289897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7e0d0-c86a-4af3-a392-30480a43e26a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:55.313339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 371/729] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Aug 11 10:43:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:55.313339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976dbf7a-401b-408a-8a0f-0088eeae9646 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:55.313339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976dbf7a-401b-408a-8a0f-0088eeae9646 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:55.313339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976dbf7a-401b-408a-8a0f-0088eeae9646 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:55.316509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 372/730] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:55.317292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976dbf7a-401b-408a-8a0f-0088eeae9646 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:55.326403 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:55.336783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe002c2-465d-48d5-b53d-520d898d5dd7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:55.383178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1ab45-1730-4dac-9b50-e89588a8292a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:55.384794 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1ab45-1730-4dac-9b50-e89588a8292a None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:55.385253 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1ab45-1730-4dac-9b50-e89588a8292a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:55.385821 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1ab45-1730-4dac-9b50-e89588a8292a None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:55.386775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1ab45-1730-4dac-9b50-e89588a8292a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:55.389189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1ab45-1730-4dac-9b50-e89588a8292a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:55.425316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976dbf7a-401b-408a-8a0f-0088eeae9646 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:55.464456 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec53e7-2a66-4821-972c-aed52d825484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:55.465087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec53e7-2a66-4821-972c-aed52d825484 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:55.465389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec53e7-2a66-4821-972c-aed52d825484 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:55.465689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec53e7-2a66-4821-972c-aed52d825484 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:55.494867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 359/731] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Aug 11 10:43:55 2022] POST /identity/v3/services => generated 251 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:43:55.497209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76268b02-a1dd-4100-aa2f-d5a5f06e2c92 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:55.497725 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76268b02-a1dd-4100-aa2f-d5a5f06e2c92 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:55.498656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76268b02-a1dd-4100-aa2f-d5a5f06e2c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:55.521649 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-76268b02-a1dd-4100-aa2f-d5a5f06e2c92 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:55.523878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-76268b02-a1dd-4100-aa2f-d5a5f06e2c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:55.565359 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec53e7-2a66-4821-972c-aed52d825484 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:55.567060 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec53e7-2a66-4821-972c-aed52d825484 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:55.578588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:55.640860 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 360/732] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:55 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:55.642572 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4f982-d46a-44ba-a40a-3fb83c68fbd1 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:55.643130 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4f982-d46a-44ba-a40a-3fb83c68fbd1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:55.643615 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4f982-d46a-44ba-a40a-3fb83c68fbd1 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:55.645469 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 361/733] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:55.654795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85333c-a6e1-4625-a881-8baf4a97f768 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:55.654795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85333c-a6e1-4625-a881-8baf4a97f768 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:55.654795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85333c-a6e1-4625-a881-8baf4a97f768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:55.677449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1c85333c-a6e1-4625-a881-8baf4a97f768 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:55.678977 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1c85333c-a6e1-4625-a881-8baf4a97f768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:55.708235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:55.724622 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 373/734] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 11 10:43:55.725780 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec53e7-2a66-4821-972c-aed52d825484 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:55.766456 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 362/735] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:55 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:55.767751 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85333c-a6e1-4625-a881-8baf4a97f768 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:55.865114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec53e7-2a66-4821-972c-aed52d825484 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:55.873840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:55.893299 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85333c-a6e1-4625-a881-8baf4a97f768 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:55.902302 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dd277-7ddb-4ed4-872c-690f4544f956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:55.903094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dd277-7ddb-4ed4-872c-690f4544f956 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:55.903375 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dd277-7ddb-4ed4-872c-690f4544f956 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:55.903647 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dd277-7ddb-4ed4-872c-690f4544f956 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:55.918141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620dd277-7ddb-4ed4-872c-690f4544f956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:55.924529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-620dd277-7ddb-4ed4-872c-690f4544f956 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:55.924529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:55.924529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:55.924529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:55.924529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:55.924529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:55.924529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:55.924529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:55.924529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:55.924529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:55.924529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:55.924529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:55.924529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:55.924529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:55.924529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:55.924529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:55.925451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:55.925451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:55.925451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:55.925451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:55.925451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:55.925451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:55.925451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:55.925451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:55.925451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:55.925451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:55.925451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:55.925451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:55.925451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:55.925451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:55.925451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:55.925451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:55.926247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:55.926247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:55.926247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:55.926247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:55.926247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:55.926247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:55.926247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:55.926247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:55.926247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:55.926247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:55.926247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:43:55.926247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:55.926247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 374/736] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:43:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:55.926939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dd277-7ddb-4ed4-872c-690f4544f956 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:55.946826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b8b6e-fbaa-4ea8-a13e-494a0a8bda49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:55.948284 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b8b6e-fbaa-4ea8-a13e-494a0a8bda49 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:55.949096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b8b6e-fbaa-4ea8-a13e-494a0a8bda49 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:55.949587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b8b6e-fbaa-4ea8-a13e-494a0a8bda49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:55.963990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b8b6e-fbaa-4ea8-a13e-494a0a8bda49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:55.966211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b8b6e-fbaa-4ea8-a13e-494a0a8bda49 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:55.984815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ee1b8b6e-fbaa-4ea8-a13e-494a0a8bda49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:55.984815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:55.984815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:55.984815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:55.984815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:55.984815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:55.984815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:55.984815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:55.984815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:55.984815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:55.984815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:55.984815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:55.984815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:55.984815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:55.984815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:55.984815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:55.985862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:55.985862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:55.985862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:55.985862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:55.985862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:55.985862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:55.985862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:55.985862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:55.985862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:55.985862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:55.985862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:55.985862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:55.985862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:55.985862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:55.985862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:55.985862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:55.985862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:55.986705 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:55.986705 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:55.986705 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:55.988150 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 363/737] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:55.992827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b8b6e-fbaa-4ea8-a13e-494a0a8bda49 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:56.012371 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:56.083010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dd277-7ddb-4ed4-872c-690f4544f956 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:56.124624 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf90a3-7e9f-4735-a32c-f382cb1305dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:56.125269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf90a3-7e9f-4735-a32c-f382cb1305dc None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:56.125652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf90a3-7e9f-4735-a32c-f382cb1305dc None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:56.126028 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf90a3-7e9f-4735-a32c-f382cb1305dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:56.138402 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b8b6e-fbaa-4ea8-a13e-494a0a8bda49 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:56.139762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf90a3-7e9f-4735-a32c-f382cb1305dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:56.146097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-d1bf90a3-7e9f-4735-a32c-f382cb1305dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:43:56.146097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:56.146097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:56.146097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:56.146097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:56.146097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:56.146097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:56.146097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:56.146097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:56.146097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:56.146097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:56.146097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:56.146097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:56.146097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:56.146097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:56.146097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:56.147138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:56.147138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:56.147138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:56.147138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:56.147138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:56.147138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:56.147138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:56.147138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:56.147138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:56.147138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:56.147138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:56.147138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:56.147138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:56.147138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:56.147138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:56.147138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:56.147939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:56.147939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:56.147939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:56.147939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:56.147939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:56.147939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:56.147939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:56.147939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:56.147939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:56.147939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:56.147939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:43:56.147939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:56.150824 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 375/738] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:43:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:56.152342 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf90a3-7e9f-4735-a32c-f382cb1305dc None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:56.188726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:56.189303 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f9514-5cc3-4ece-aa06-47cd1ac8c0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:56.191461 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f9514-5cc3-4ece-aa06-47cd1ac8c0fe None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:56.191918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f9514-5cc3-4ece-aa06-47cd1ac8c0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:56.192519 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f9514-5cc3-4ece-aa06-47cd1ac8c0fe None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:56.193813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f9514-5cc3-4ece-aa06-47cd1ac8c0fe None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:56.194541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f9514-5cc3-4ece-aa06-47cd1ac8c0fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:56.196148 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f9514-5cc3-4ece-aa06-47cd1ac8c0fe None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:56.206814 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 364/739] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Aug 11 10:43:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:56.208229 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f9514-5cc3-4ece-aa06-47cd1ac8c0fe None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:56.281648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf90a3-7e9f-4735-a32c-f382cb1305dc None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:56.292895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:56.320331 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c085b4-305a-4145-9933-09fdb109d9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:56.321402 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c085b4-305a-4145-9933-09fdb109d9fb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:56.321967 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c085b4-305a-4145-9933-09fdb109d9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:56.322473 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c085b4-305a-4145-9933-09fdb109d9fb None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:56.323525 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c085b4-305a-4145-9933-09fdb109d9fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:56.324186 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c085b4-305a-4145-9933-09fdb109d9fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:56.325850 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c085b4-305a-4145-9933-09fdb109d9fb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:56.327844 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f9514-5cc3-4ece-aa06-47cd1ac8c0fe None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:56.344777 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 376/740] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:56.346216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c085b4-305a-4145-9933-09fdb109d9fb None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:56.364181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa15058-3b8c-4e3d-9ee8-b5a39aa64ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:56.364799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa15058-3b8c-4e3d-9ee8-b5a39aa64ada None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:56.365081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa15058-3b8c-4e3d-9ee8-b5a39aa64ada None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:56.365357 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa15058-3b8c-4e3d-9ee8-b5a39aa64ada None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:56.366024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa15058-3b8c-4e3d-9ee8-b5a39aa64ada None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:56.366363 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa15058-3b8c-4e3d-9ee8-b5a39aa64ada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:56.367749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa15058-3b8c-4e3d-9ee8-b5a39aa64ada None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:56.381289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 365/741] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:56.382306 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa15058-3b8c-4e3d-9ee8-b5a39aa64ada None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:56.440600 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:56.455603 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c085b4-305a-4145-9933-09fdb109d9fb None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:56.488729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa15058-3b8c-4e3d-9ee8-b5a39aa64ada None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:56.492301 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ba9bc-25ed-49cb-90a7-d01bf3e189bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:56.493013 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ba9bc-25ed-49cb-90a7-d01bf3e189bf None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:56.493296 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ba9bc-25ed-49cb-90a7-d01bf3e189bf None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:56.493570 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ba9bc-25ed-49cb-90a7-d01bf3e189bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:56.504135 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ba9bc-25ed-49cb-90a7-d01bf3e189bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:56.505789 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ba9bc-25ed-49cb-90a7-d01bf3e189bf None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:56.522086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-836ba9bc-25ed-49cb-90a7-d01bf3e189bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:56.522086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:56.522086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:56.522086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:56.522086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:56.522086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:56.522086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:56.522086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:56.522086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:56.522086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:56.522086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:56.522086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:56.522086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:56.522086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:56.522086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:56.522086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:56.523243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:56.523243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:56.523243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:56.523243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:56.523243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:56.523243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:56.523243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:56.523243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:56.523243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:56.523243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:56.523243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:56.523243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:56.523243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:56.523243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:56.523243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:56.523243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:56.523243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:56.524109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:56.524109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:56.524109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:56.524275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477213bd-6141-4438-b074-d53e7e00d865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:56.524275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477213bd-6141-4438-b074-d53e7e00d865 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:56.524275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477213bd-6141-4438-b074-d53e7e00d865 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:56.524275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477213bd-6141-4438-b074-d53e7e00d865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:56.527366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:56.527962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 377/742] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:56.529078 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2e063-9164-4821-8da2-d042fa2ab6da None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:56.529366 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2e063-9164-4821-8da2-d042fa2ab6da None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:56.529639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2e063-9164-4821-8da2-d042fa2ab6da None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:56.532955 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477213bd-6141-4438-b074-d53e7e00d865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:56.534550 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477213bd-6141-4438-b074-d53e7e00d865 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:56.534921 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 378/743] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:56.535670 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2e063-9164-4821-8da2-d042fa2ab6da None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:56.547530 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-477213bd-6141-4438-b074-d53e7e00d865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:56.547530 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:56.547530 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:56.547530 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:56.547530 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:56.547530 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:56.547530 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:56.547530 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:56.547530 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:56.547530 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:56.547530 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:56.547530 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:56.547530 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:43:56.547530 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:43:56.547530 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:43:56.548400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:43:56.548400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:56.548400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:56.548400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:56.548400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:56.548400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:56.548400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:56.548400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:56.548400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:56.548400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:56.548400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:56.548400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:56.548400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:56.548400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:56.548400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:56.548400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:56.548400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:56.549247 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:43:56.549247 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:43:56.549247 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:43:56.549247 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:43:56.549247 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:43:56.549247 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:43:56.549247 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:56.549247 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:56.549247 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 366/744] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:56.550272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477213bd-6141-4438-b074-d53e7e00d865 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:56.647867 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2e063-9164-4821-8da2-d042fa2ab6da None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:56.657246 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477213bd-6141-4438-b074-d53e7e00d865 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:56.686498 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a9f90-4ff8-48d9-9601-4e330f86f99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:56.687729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a9f90-4ff8-48d9-9601-4e330f86f99f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:56.688021 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a9f90-4ff8-48d9-9601-4e330f86f99f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:56.688389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a9f90-4ff8-48d9-9601-4e330f86f99f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:56.691414 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cbbe1-df13-4e89-be19-b567ea7a496d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:56.692231 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cbbe1-df13-4e89-be19-b567ea7a496d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:56.692512 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cbbe1-df13-4e89-be19-b567ea7a496d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:56.692813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cbbe1-df13-4e89-be19-b567ea7a496d None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:56.693449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cbbe1-df13-4e89-be19-b567ea7a496d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:56.693750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cbbe1-df13-4e89-be19-b567ea7a496d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:56.695159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cbbe1-df13-4e89-be19-b567ea7a496d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:56.696122 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:56.701186 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a9f90-4ff8-48d9-9601-4e330f86f99f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:56.702647 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a9f90-4ff8-48d9-9601-4e330f86f99f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:56.712235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 367/745] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:56.712235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b725a-e878-43fe-8d32-ebbf118c21b1 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:56.712235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b725a-e878-43fe-8d32-ebbf118c21b1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:56.712235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b725a-e878-43fe-8d32-ebbf118c21b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:56.722851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-279a9f90-4ff8-48d9-9601-4e330f86f99f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:56.722851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:56.722851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:56.722851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:56.722851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:56.722851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:56.722851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:56.722851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:56.722851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:56.722851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:56.722851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:56.722851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:56.722851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:56.722851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:56.722851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:56.722851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:56.723797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:56.723797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:56.723797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:56.723797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:56.723797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:56.723797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:56.723797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:56.723797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:56.723797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:56.723797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:56.723797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:56.723797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:56.723797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:56.723797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:56.723797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:56.723797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:56.723797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:56.724653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:56.724653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:56.724653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:56.727048 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 379/746] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:56.727474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5a7b725a-e878-43fe-8d32-ebbf118c21b1 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:56.728359 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a9f90-4ff8-48d9-9601-4e330f86f99f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:56.728666 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5a7b725a-e878-43fe-8d32-ebbf118c21b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:56.783100 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:56.801935 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 368/747] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:56 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 11 10:43:56.802785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b725a-e878-43fe-8d32-ebbf118c21b1 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:56.850433 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a9f90-4ff8-48d9-9601-4e330f86f99f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:56.886730 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416947eb-5eb4-4bcd-98a4-e8280fe17068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:56.887372 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416947eb-5eb4-4bcd-98a4-e8280fe17068 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:56.887656 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416947eb-5eb4-4bcd-98a4-e8280fe17068 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:56.887931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416947eb-5eb4-4bcd-98a4-e8280fe17068 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:56.888647 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416947eb-5eb4-4bcd-98a4-e8280fe17068 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:56.888954 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416947eb-5eb4-4bcd-98a4-e8280fe17068 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:56.890414 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416947eb-5eb4-4bcd-98a4-e8280fe17068 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:56.908006 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 380/748] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:43:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:56.908006 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416947eb-5eb4-4bcd-98a4-e8280fe17068 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:56.913096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b725a-e878-43fe-8d32-ebbf118c21b1 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:56.949237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b74df-6b1a-4ec5-9cb9-f8e6b8cbb454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:56.949876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b74df-6b1a-4ec5-9cb9-f8e6b8cbb454 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:56.950168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b74df-6b1a-4ec5-9cb9-f8e6b8cbb454 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:56.950454 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b74df-6b1a-4ec5-9cb9-f8e6b8cbb454 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:56.957387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:56.959450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b74df-6b1a-4ec5-9cb9-f8e6b8cbb454 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:56.961299 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b74df-6b1a-4ec5-9cb9-f8e6b8cbb454 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:56.973823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ec2b74df-6b1a-4ec5-9cb9-f8e6b8cbb454 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 10:43:56.973823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:56.973823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:56.973823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:56.973823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:56.973823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:56.973823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:56.973823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:56.973823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:56.973823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:56.973823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:56.973823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:56.973823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:43:56.973823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:43:56.973823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:43:56.973823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:43:56.975209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:56.975209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:56.975209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:43:56.975209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:56.975209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:43:56.975209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:56.975209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:56.975209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:56.975209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:56.975209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:56.975209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:56.975209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:56.975209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:56.975209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:56.975209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:56.975209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:56.975209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:56.975209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:56.976427 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:56.976427 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:56.976427 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:43:56.976427 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:43:56.976427 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:43:56.976427 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:43:56.976427 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:43:56.976427 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:43:56.976427 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 10:43:56.976427 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:56.976427 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 369/749] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Aug 11 10:43:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:56.976427 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b74df-6b1a-4ec5-9cb9-f8e6b8cbb454 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:57.012704 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416947eb-5eb4-4bcd-98a4-e8280fe17068 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:57.036453 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:57.052284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe9dc9-fb05-4443-80e9-7f3f14e644cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:57.053179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe9dc9-fb05-4443-80e9-7f3f14e644cb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:57.053466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe9dc9-fb05-4443-80e9-7f3f14e644cb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:57.053739 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe9dc9-fb05-4443-80e9-7f3f14e644cb None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:57.054388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe9dc9-fb05-4443-80e9-7f3f14e644cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:57.054693 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe9dc9-fb05-4443-80e9-7f3f14e644cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:57.056923 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe9dc9-fb05-4443-80e9-7f3f14e644cb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:57.069496 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 381/750] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:57.070146 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe9dc9-fb05-4443-80e9-7f3f14e644cb None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:57.098271 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b74df-6b1a-4ec5-9cb9-f8e6b8cbb454 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:57.134348 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef251147-f4f3-4469-b56c-cedb9ba5e769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:57.135141 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef251147-f4f3-4469-b56c-cedb9ba5e769 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:57.135966 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef251147-f4f3-4469-b56c-cedb9ba5e769 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:57.136453 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef251147-f4f3-4469-b56c-cedb9ba5e769 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:57.137259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef251147-f4f3-4469-b56c-cedb9ba5e769 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:57.138641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef251147-f4f3-4469-b56c-cedb9ba5e769 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:57.176392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe9dc9-fb05-4443-80e9-7f3f14e644cb None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:57.187513 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:57.205782 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 370/751] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Aug 11 10:43:56 2022] POST /identity/v3/services => generated 240 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:43:57.206898 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef251147-f4f3-4469-b56c-cedb9ba5e769 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:57.221092 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01491326-a2a7-4a98-8ed6-069b4a505c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:57.222135 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01491326-a2a7-4a98-8ed6-069b4a505c0d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:57.222652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01491326-a2a7-4a98-8ed6-069b4a505c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:57.223137 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01491326-a2a7-4a98-8ed6-069b4a505c0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:57.224182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01491326-a2a7-4a98-8ed6-069b4a505c0d None admin] RBAC: Adding query filter params (role.id=00c6de5dd6cd4267ba05941ddb91e6ad, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=cbd25d1bde0c4703b61e0edaf5b658d4) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:57.224674 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01491326-a2a7-4a98-8ed6-069b4a505c0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:57.226788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01491326-a2a7-4a98-8ed6-069b4a505c0d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:57.243231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 382/752] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:43:57 2022] GET /identity/v3/role_assignments?user.id=cbd25d1bde0c4703b61e0edaf5b658d4&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=00c6de5dd6cd4267ba05941ddb91e6ad => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:57.244692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01491326-a2a7-4a98-8ed6-069b4a505c0d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:57.357556 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef251147-f4f3-4469-b56c-cedb9ba5e769 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:57.361347 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:57.423009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f516c7b-4549-4eff-958c-817736fa860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:57.423633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f516c7b-4549-4eff-958c-817736fa860a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:57.423931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f516c7b-4549-4eff-958c-817736fa860a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:57.424182 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f516c7b-4549-4eff-958c-817736fa860a None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:57.424915 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f516c7b-4549-4eff-958c-817736fa860a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:57.425217 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f516c7b-4549-4eff-958c-817736fa860a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:57.426705 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f516c7b-4549-4eff-958c-817736fa860a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:57.445673 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01491326-a2a7-4a98-8ed6-069b4a505c0d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:57.449578 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 371/753] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Aug 11 10:43:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:57.455395 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f516c7b-4549-4eff-958c-817736fa860a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:57.497597 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426359ce-b30e-4f88-99bd-5995acc75e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:57.498271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426359ce-b30e-4f88-99bd-5995acc75e7e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:57.498553 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426359ce-b30e-4f88-99bd-5995acc75e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:57.498853 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426359ce-b30e-4f88-99bd-5995acc75e7e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:57.507485 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426359ce-b30e-4f88-99bd-5995acc75e7e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:57.508929 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426359ce-b30e-4f88-99bd-5995acc75e7e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:57.520700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-426359ce-b30e-4f88-99bd-5995acc75e7e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 10:43:57.520700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:57.520700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:57.520700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:57.520700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:57.520700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:57.520700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:57.520700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:57.520700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:57.520700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:57.520700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:57.520700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:57.520700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:43:57.520700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:43:57.520700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:43:57.520700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:43:57.521709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:57.521709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:57.521709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:43:57.521709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:57.521709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:43:57.521709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:43:57.521709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:57.521709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:57.521709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:57.521709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:57.521709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:57.521709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:57.521709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:57.521709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:57.521709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:57.521709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:57.521709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:57.521709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:57.522915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:57.522915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:57.522915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:43:57.522915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:43:57.522915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:43:57.522915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:43:57.522915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:43:57.522915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:43:57.522915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 10:43:57.522915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:57.522915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 383/754] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Aug 11 10:43:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:57.528190 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426359ce-b30e-4f88-99bd-5995acc75e7e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:57.563176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:57.584876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f516c7b-4549-4eff-958c-817736fa860a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:57.623169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d3fca-4151-40e6-9281-e9136d7f9ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:57.623848 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d3fca-4151-40e6-9281-e9136d7f9ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:57.624133 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d3fca-4151-40e6-9281-e9136d7f9ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:57.624405 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d3fca-4151-40e6-9281-e9136d7f9ab1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:57.660775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:57.702358 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d3fca-4151-40e6-9281-e9136d7f9ab1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:57.703511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426359ce-b30e-4f88-99bd-5995acc75e7e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:57.704354 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d3fca-4151-40e6-9281-e9136d7f9ab1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:57.739736 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd01da-167e-4250-8ae1-1f350d9e191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:57.740690 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd01da-167e-4250-8ae1-1f350d9e191b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:57.741148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd01da-167e-4250-8ae1-1f350d9e191b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:57.741594 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd01da-167e-4250-8ae1-1f350d9e191b None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:57.742500 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd01da-167e-4250-8ae1-1f350d9e191b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:57.743057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd01da-167e-4250-8ae1-1f350d9e191b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:57.745240 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd01da-167e-4250-8ae1-1f350d9e191b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:57.764936 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 384/755] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Aug 11 10:43:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:43:57.771014 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d88e9f-8a7f-4b9f-9d7a-9c4a7b6b4b98 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:57.771537 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d88e9f-8a7f-4b9f-9d7a-9c4a7b6b4b98 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:57.771996 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d88e9f-8a7f-4b9f-9d7a-9c4a7b6b4b98 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:57.773709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 385/756] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:57.774581 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d88e9f-8a7f-4b9f-9d7a-9c4a7b6b4b98 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:57.844161 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 372/757] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:43:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 10:43:57.844161 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855be76-c817-4ded-b796-39748bb6cfec None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:57.844161 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855be76-c817-4ded-b796-39748bb6cfec None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:57.844161 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855be76-c817-4ded-b796-39748bb6cfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:57.860117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c855be76-c817-4ded-b796-39748bb6cfec None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:57.861702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c855be76-c817-4ded-b796-39748bb6cfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:57.898597 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d88e9f-8a7f-4b9f-9d7a-9c4a7b6b4b98 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:57.911038 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:57.923149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:57.933961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 373/758] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:43:57.934888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855be76-c817-4ded-b796-39748bb6cfec None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:57.944606 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19afaaf-1828-4533-8007-56b9e7facb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:57.945650 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19afaaf-1828-4533-8007-56b9e7facb7d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:57.945944 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19afaaf-1828-4533-8007-56b9e7facb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:57.946221 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19afaaf-1828-4533-8007-56b9e7facb7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:57.961155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19afaaf-1828-4533-8007-56b9e7facb7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:57.963809 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19afaaf-1828-4533-8007-56b9e7facb7d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:57.989071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-d19afaaf-1828-4533-8007-56b9e7facb7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:57.989071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:57.989071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:57.989071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:57.989071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:57.989071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:57.989071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:57.989071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:57.989071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:57.989071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:57.989071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:57.989071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:57.989071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:57.989071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:57.989071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:57.989071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:57.990059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:57.990059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:57.990059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:57.990059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:57.990059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:57.990059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:57.990059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:57.990059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:57.990059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:57.990059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:57.990059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:57.990059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:57.990059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:57.990059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:57.990059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:57.990059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:57.990059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:57.991353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:57.991353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:57.991353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:57.991353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 386/759] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:57.995570 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19afaaf-1828-4533-8007-56b9e7facb7d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:58.051724 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855be76-c817-4ded-b796-39748bb6cfec None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:58.088308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a69281-7874-479e-8af9-28d42d6d41dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:58.089460 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69281-7874-479e-8af9-28d42d6d41dd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:58.089883 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69281-7874-479e-8af9-28d42d6d41dd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:58.090296 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69281-7874-479e-8af9-28d42d6d41dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:58.104876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a69281-7874-479e-8af9-28d42d6d41dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:58.106572 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a69281-7874-479e-8af9-28d42d6d41dd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:58.122272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-65a69281-7874-479e-8af9-28d42d6d41dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:58.122272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:58.122272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:58.122272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:58.122272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:58.122272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:58.122272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:58.122272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:58.122272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:58.122272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:58.122272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:58.122272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:58.122272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:43:58.122272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:43:58.122272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:43:58.122272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:43:58.123468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:58.123468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:58.123468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:58.123468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:58.123468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:58.123468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:58.123468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:58.123468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:58.123468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:58.123468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:58.123468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:58.123468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:58.123468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:58.123468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:58.123468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:58.123468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:58.123468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:43:58.124407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:43:58.124407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:43:58.124407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:58.126027 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 374/760] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:58.126987 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a69281-7874-479e-8af9-28d42d6d41dd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:58.138360 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19afaaf-1828-4533-8007-56b9e7facb7d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:58.180751 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:58.185906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac608c5d-7901-4b28-8f8d-3618f33d8503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:58.186553 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac608c5d-7901-4b28-8f8d-3618f33d8503 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:58.186866 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac608c5d-7901-4b28-8f8d-3618f33d8503 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:58.187144 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac608c5d-7901-4b28-8f8d-3618f33d8503 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:58.187720 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac608c5d-7901-4b28-8f8d-3618f33d8503 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:58.189144 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac608c5d-7901-4b28-8f8d-3618f33d8503 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:58.205906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-ac608c5d-7901-4b28-8f8d-3618f33d8503 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 10:43:58.205906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:58.205906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:43:58.205906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:43:58.205906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:43:58.205906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:43:58.205906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:43:58.205906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:43:58.205906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 10:43:58.205906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:58.205906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:43:58.205906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:58.205906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:58.205906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:58.205906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:58.205906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:58.205906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:58.207162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:58.207162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:58.207162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:58.207162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:58.207162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:58.207162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:58.207162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:43:58.207162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:43:58.207162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:43:58.207162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:43:58.207162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:58.207162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:58.207162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:58.207162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:58.207162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:58.207162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:58.208049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:58.208049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:58.208049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:58.208049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:58.208049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:58.208049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:58.208049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:58.208049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:58.208049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:58.208049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:58.208049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:43:58.208049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:43:58.208049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 10:43:58.208049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:58.208049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 387/761] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Aug 11 10:43:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:58.208884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac608c5d-7901-4b28-8f8d-3618f33d8503 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:58.215547 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:58.247310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a69281-7874-479e-8af9-28d42d6d41dd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:58.289027 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabe402-6b71-43ef-837e-46544b7371f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:58.289962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabe402-6b71-43ef-837e-46544b7371f8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:58.290637 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabe402-6b71-43ef-837e-46544b7371f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:58.291090 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabe402-6b71-43ef-837e-46544b7371f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:58.292377 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabe402-6b71-43ef-837e-46544b7371f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:58.293166 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabe402-6b71-43ef-837e-46544b7371f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:58.294964 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabe402-6b71-43ef-837e-46544b7371f8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:58.316358 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 375/762] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:58.316358 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabe402-6b71-43ef-837e-46544b7371f8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:58.338938 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac608c5d-7901-4b28-8f8d-3618f33d8503 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:58.375674 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abb2a5-bba6-4bb7-aff6-a92272f0993e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:58.376442 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abb2a5-bba6-4bb7-aff6-a92272f0993e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:58.376813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abb2a5-bba6-4bb7-aff6-a92272f0993e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:58.377173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abb2a5-bba6-4bb7-aff6-a92272f0993e None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:58.377901 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40abb2a5-bba6-4bb7-aff6-a92272f0993e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:58.378293 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40abb2a5-bba6-4bb7-aff6-a92272f0993e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:58.379805 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40abb2a5-bba6-4bb7-aff6-a92272f0993e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:58.395884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 388/763] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:58.395884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abb2a5-bba6-4bb7-aff6-a92272f0993e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:58.460425 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:58.464232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabe402-6b71-43ef-837e-46544b7371f8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:58.467965 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:58.503545 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abb2a5-bba6-4bb7-aff6-a92272f0993e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:58.512209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d646b5-237c-443c-b482-5535b8cf78af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:58.512708 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d646b5-237c-443c-b482-5535b8cf78af None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:58.513088 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d646b5-237c-443c-b482-5535b8cf78af None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:58.513456 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d646b5-237c-443c-b482-5535b8cf78af None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:58.514183 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d646b5-237c-443c-b482-5535b8cf78af None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:58.514580 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d646b5-237c-443c-b482-5535b8cf78af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:58.516288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d646b5-237c-443c-b482-5535b8cf78af None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:58.522786 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 376/764] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Aug 11 10:43:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:58.523739 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d646b5-237c-443c-b482-5535b8cf78af None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:58.548087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf214453-91e6-4202-89b6-b1f159f43788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:58.548977 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214453-91e6-4202-89b6-b1f159f43788 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:58.549705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214453-91e6-4202-89b6-b1f159f43788 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:58.550147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214453-91e6-4202-89b6-b1f159f43788 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:58.560686 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf214453-91e6-4202-89b6-b1f159f43788 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:58.563470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf214453-91e6-4202-89b6-b1f159f43788 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:58.577697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-bf214453-91e6-4202-89b6-b1f159f43788 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:58.577697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:58.577697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:58.577697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:58.577697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:58.577697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:58.577697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:58.577697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:58.577697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:58.577697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:58.577697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:58.577697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:58.577697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:43:58.577697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:43:58.577697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:43:58.578602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:43:58.578602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:58.578602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:58.578602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:58.578602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:58.578602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:58.578602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:58.578602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:58.578602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:58.578602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:58.578602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:58.578602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:58.578602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:58.578602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:58.578602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:58.578602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:58.578602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:58.579605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:43:58.579605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:43:58.579605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:43:58.579605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:43:58.579605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:43:58.579605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:43:58.579605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:58.579605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:43:58.583374 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 389/765] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:58.584227 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf214453-91e6-4202-89b6-b1f159f43788 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:58.659905 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d646b5-237c-443c-b482-5535b8cf78af None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:58.696589 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839582c-d305-4135-80ce-e5618e8b4570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:58.697322 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839582c-d305-4135-80ce-e5618e8b4570 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:58.698114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839582c-d305-4135-80ce-e5618e8b4570 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:58.698477 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839582c-d305-4135-80ce-e5618e8b4570 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:58.705671 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf214453-91e6-4202-89b6-b1f159f43788 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:58.705945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839582c-d305-4135-80ce-e5618e8b4570 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:58.707546 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839582c-d305-4135-80ce-e5618e8b4570 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:58.720153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-a839582c-d305-4135-80ce-e5618e8b4570 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:58.720153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:58.720153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:58.720153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:58.720153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:58.720153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:58.720153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:58.720153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:58.720153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:58.720153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:58.720153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:58.720153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:58.720153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:43:58.720153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:43:58.720153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:43:58.721190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:43:58.721190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:58.721190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:58.721190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:58.721190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:58.721190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:58.721190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:58.721190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:58.721190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:58.721190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:58.721190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:58.721190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:58.721190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:58.721190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:58.721190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:58.721190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:58.721190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:58.722117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:43:58.722117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:43:58.722117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:43:58.722117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:43:58.722117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:43:58.722117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:43:58.722117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:43:58.722117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:58.725921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 377/766] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:58.726895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839582c-d305-4135-80ce-e5618e8b4570 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:58.735360 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:58.749598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875c300-e41e-4fab-bf90-c57bba6940d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:58.750266 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875c300-e41e-4fab-bf90-c57bba6940d9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:58.750548 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875c300-e41e-4fab-bf90-c57bba6940d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:58.750853 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875c300-e41e-4fab-bf90-c57bba6940d9 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:58.751482 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875c300-e41e-4fab-bf90-c57bba6940d9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:58.751782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875c300-e41e-4fab-bf90-c57bba6940d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:58.753693 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875c300-e41e-4fab-bf90-c57bba6940d9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:58.761007 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:58.763906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 390/767] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Aug 11 10:43:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:58.764889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875c300-e41e-4fab-bf90-c57bba6940d9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:58.843927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839582c-d305-4135-80ce-e5618e8b4570 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:58.882828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066636c-43e1-45a9-8b53-8408e35c1b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:58.883678 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066636c-43e1-45a9-8b53-8408e35c1b7b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:58.884103 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066636c-43e1-45a9-8b53-8408e35c1b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:58.884571 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066636c-43e1-45a9-8b53-8408e35c1b7b None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:58.886240 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066636c-43e1-45a9-8b53-8408e35c1b7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:58.886870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066636c-43e1-45a9-8b53-8408e35c1b7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:58.888556 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066636c-43e1-45a9-8b53-8408e35c1b7b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:58.892345 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875c300-e41e-4fab-bf90-c57bba6940d9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:58.907084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 378/768] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:43:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:58.908168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066636c-43e1-45a9-8b53-8408e35c1b7b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:58.935739 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3222238-376c-45d7-a5ab-c317c049f87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:58.936347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3222238-376c-45d7-a5ab-c317c049f87c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:58.936917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3222238-376c-45d7-a5ab-c317c049f87c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:58.937201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3222238-376c-45d7-a5ab-c317c049f87c None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:58.938300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3222238-376c-45d7-a5ab-c317c049f87c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:58.938659 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3222238-376c-45d7-a5ab-c317c049f87c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:58.940748 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3222238-376c-45d7-a5ab-c317c049f87c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:58.962106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 391/769] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:43:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:58.962106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3222238-376c-45d7-a5ab-c317c049f87c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:59.014467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:59.026649 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:59.028734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066636c-43e1-45a9-8b53-8408e35c1b7b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:59.067448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a72a02-d521-4bab-ab74-705cd5165289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:59.068797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a72a02-d521-4bab-ab74-705cd5165289 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:59.069279 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a72a02-d521-4bab-ab74-705cd5165289 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:59.069723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a72a02-d521-4bab-ab74-705cd5165289 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:59.070638 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a72a02-d521-4bab-ab74-705cd5165289 None admin] RBAC: Adding query filter params (interface=public, service_id=d2e5b32928bf49b4a72be6d0a260e8ae, region_id=RegionOne) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:59.071151 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a72a02-d521-4bab-ab74-705cd5165289 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:59.074093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a72a02-d521-4bab-ab74-705cd5165289 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:59.083039 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 379/770] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Aug 11 10:43:58 2022] GET /identity/v3/endpoints?service_id=d2e5b32928bf49b4a72be6d0a260e8ae&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:59.084361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a72a02-d521-4bab-ab74-705cd5165289 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:59.092329 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3222238-376c-45d7-a5ab-c317c049f87c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:59.139756 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99ed97-83dd-445d-81a2-fca653bec324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:59.140616 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99ed97-83dd-445d-81a2-fca653bec324 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:59.140919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99ed97-83dd-445d-81a2-fca653bec324 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:59.141193 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99ed97-83dd-445d-81a2-fca653bec324 None admin] PATH_INFO: `/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/9267752ac6724013bc1edcdecff48dd7/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:59.143770 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99ed97-83dd-445d-81a2-fca653bec324 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb12c96bf3a84df0b86967fbe93d1c17, user_id=9267752ac6724013bc1edcdecff48dd7, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:59.145219 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99ed97-83dd-445d-81a2-fca653bec324 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:59.198670 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a72a02-d521-4bab-ab74-705cd5165289 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:59.227615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 392/771] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:43:58 2022] PUT /identity/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/9267752ac6724013bc1edcdecff48dd7/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:43:59.229020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99ed97-83dd-445d-81a2-fca653bec324 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:59.245365 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efaeea6-747c-4fd0-bea6-77f437f740be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:59.246381 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efaeea6-747c-4fd0-bea6-77f437f740be None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:59.246872 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efaeea6-747c-4fd0-bea6-77f437f740be None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:59.247297 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efaeea6-747c-4fd0-bea6-77f437f740be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:59.248271 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efaeea6-747c-4fd0-bea6-77f437f740be None admin] RBAC: Adding query filter params (role.id=6de833fef4c9456cb5d8ad66caf96586, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=9751264123914c27b961009f75067660) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:43:59.248774 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efaeea6-747c-4fd0-bea6-77f437f740be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:59.250601 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efaeea6-747c-4fd0-bea6-77f437f740be None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:59.258245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 380/772] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:43:59 2022] GET /identity/v3/role_assignments?user.id=9751264123914c27b961009f75067660&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=6de833fef4c9456cb5d8ad66caf96586 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:59.397966 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99ed97-83dd-445d-81a2-fca653bec324 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:59.409898 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:59.445390 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f8fd4-d1d5-4cba-b311-3b20204442e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:59.446389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f8fd4-d1d5-4cba-b311-3b20204442e6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:59.447049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f8fd4-d1d5-4cba-b311-3b20204442e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:59.447602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f8fd4-d1d5-4cba-b311-3b20204442e6 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:59.448420 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f8fd4-d1d5-4cba-b311-3b20204442e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:43:59.450082 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f8fd4-d1d5-4cba-b311-3b20204442e6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:43:59.456925 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 393/773] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Aug 11 10:43:59 2022] GET /identity/v3/services => generated 772 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:43:59.500988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab44d81-0077-4dd6-9a5f-0dbff8af1f60 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:59.501340 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab44d81-0077-4dd6-9a5f-0dbff8af1f60 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:59.501546 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab44d81-0077-4dd6-9a5f-0dbff8af1f60 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:59.503357 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 381/774] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:43:59.509704 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e9915-048e-4882-a65d-68f61765d953 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:59.510786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e9915-048e-4882-a65d-68f61765d953 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:59.511701 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e9915-048e-4882-a65d-68f61765d953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:59.531648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-305e9915-048e-4882-a65d-68f61765d953 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:59.532914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-305e9915-048e-4882-a65d-68f61765d953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:59.612433 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 394/775] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:43:59.635698 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab44d81-0077-4dd6-9a5f-0dbff8af1f60 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:59.654617 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171589ff-d707-41e7-baad-9f38f9649caf None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:59.655276 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171589ff-d707-41e7-baad-9f38f9649caf None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:59.655763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171589ff-d707-41e7-baad-9f38f9649caf None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:59.656796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:59.657620 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 395/776] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:43:59.663031 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1744e8d-6af2-4db9-99a3-c789f693b49d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:59.663323 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1744e8d-6af2-4db9-99a3-c789f693b49d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:59.663598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1744e8d-6af2-4db9-99a3-c789f693b49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:59.689399 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-b1744e8d-6af2-4db9-99a3-c789f693b49d None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:43:59.691515 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b1744e8d-6af2-4db9-99a3-c789f693b49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:43:59.759574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab44d81-0077-4dd6-9a5f-0dbff8af1f60 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:43:59.777001 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 396/777] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:43:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 10:43:59.803836 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1744e8d-6af2-4db9-99a3-c789f693b49d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:59.820025 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75912141-3b93-456e-a68a-98aece8c78d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:43:59.820719 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75912141-3b93-456e-a68a-98aece8c78d9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:43:59.821008 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75912141-3b93-456e-a68a-98aece8c78d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:43:59.821280 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75912141-3b93-456e-a68a-98aece8c78d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:43:59.844533 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75912141-3b93-456e-a68a-98aece8c78d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:43:59.849481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-75912141-3b93-456e-a68a-98aece8c78d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:43:59.849481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:43:59.849481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:43:59.849481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:43:59.849481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:43:59.849481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:43:59.849481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:43:59.849481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:43:59.849481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:43:59.849481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:43:59.849481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:43:59.849481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:43:59.849481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:43:59.849481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:43:59.849481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:43:59.849481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:43:59.850394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:43:59.850394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:43:59.850394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:43:59.850394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:43:59.850394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:43:59.850394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:43:59.850394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:43:59.850394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:43:59.850394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:43:59.850394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:43:59.850394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:43:59.850394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:43:59.850394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:43:59.850394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:43:59.850394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:43:59.850394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:43:59.851259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:43:59.851259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:43:59.851259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:43:59.851259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:43:59.851259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:43:59.851259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:43:59.851259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:43:59.851259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:43:59.851259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:43:59.851259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:43:59.851259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:43:59.851259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:43:59.851259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 382/778] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:43:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:43:59.861865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75912141-3b93-456e-a68a-98aece8c78d9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:43:59.875664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:43:59.999513 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1744e8d-6af2-4db9-99a3-c789f693b49d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:00.000107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:00.052673 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75912141-3b93-456e-a68a-98aece8c78d9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:00.060994 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5beaad-7aab-4445-8e9f-c2b26dc73639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:00.061638 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5beaad-7aab-4445-8e9f-c2b26dc73639 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:00.061914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5beaad-7aab-4445-8e9f-c2b26dc73639 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:00.062181 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5beaad-7aab-4445-8e9f-c2b26dc73639 None admin] PATH_INFO: `/v3/services/network` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:00.062865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5beaad-7aab-4445-8e9f-c2b26dc73639 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:00.064247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5beaad-7aab-4445-8e9f-c2b26dc73639 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:00.076469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-8b5beaad-7aab-4445-8e9f-c2b26dc73639 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 10:44:00.076469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:00.076469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:44:00.076469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:44:00.076469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:44:00.076469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:44:00.076469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:44:00.076469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:00.076469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 10:44:00.076469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:00.076469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:00.076469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:00.076469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:00.076469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:00.076469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:00.076469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:00.076469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:00.077569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:00.077569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:00.077569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:00.077569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:00.077569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:00.077569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:00.077569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:44:00.077569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:44:00.077569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:44:00.077569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:44:00.077569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:00.077569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:00.077569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:00.077569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:00.077569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:00.077569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:00.078993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:00.078993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:00.078993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:00.078993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:00.078993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:00.078993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:00.078993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:00.078993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:00.078993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:00.078993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:00.078993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:44:00.078993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:00.078993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 10:44:00.078993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:00.078993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 397/779] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:43:59 2022] GET /identity/v3/services/network => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:00.083766 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5beaad-7aab-4445-8e9f-c2b26dc73639 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:00.137699 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd6715-d773-4f76-b5d9-1ba7a7e642ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:00.139132 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd6715-d773-4f76-b5d9-1ba7a7e642ee None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:00.139643 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd6715-d773-4f76-b5d9-1ba7a7e642ee None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:00.140193 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd6715-d773-4f76-b5d9-1ba7a7e642ee None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:00.141065 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd6715-d773-4f76-b5d9-1ba7a7e642ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:00.141581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd6715-d773-4f76-b5d9-1ba7a7e642ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:00.143287 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd6715-d773-4f76-b5d9-1ba7a7e642ee None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:00.160538 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 383/780] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:43:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:00.171901 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd6715-d773-4f76-b5d9-1ba7a7e642ee None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:00.227103 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:00.236843 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5beaad-7aab-4445-8e9f-c2b26dc73639 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:00.311013 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd6715-d773-4f76-b5d9-1ba7a7e642ee None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:00.346715 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bffad-40e6-41b7-a03f-c52d6441a543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:00.347407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bffad-40e6-41b7-a03f-c52d6441a543 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:00.347691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bffad-40e6-41b7-a03f-c52d6441a543 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:00.347971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bffad-40e6-41b7-a03f-c52d6441a543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:00.349246 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593ac7d-ef1f-433f-b0e1-cc38bb89bb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:00.349874 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593ac7d-ef1f-433f-b0e1-cc38bb89bb58 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:00.350157 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593ac7d-ef1f-433f-b0e1-cc38bb89bb58 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:00.350430 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593ac7d-ef1f-433f-b0e1-cc38bb89bb58 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:00.351130 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593ac7d-ef1f-433f-b0e1-cc38bb89bb58 None admin] RBAC: Adding query filter params (name=network) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:00.351434 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593ac7d-ef1f-433f-b0e1-cc38bb89bb58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:00.352809 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593ac7d-ef1f-433f-b0e1-cc38bb89bb58 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:00.356662 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:00.360757 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672bffad-40e6-41b7-a03f-c52d6441a543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:00.362223 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672bffad-40e6-41b7-a03f-c52d6441a543 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:00.372802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 398/781] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Aug 11 10:44:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:00.381412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-672bffad-40e6-41b7-a03f-c52d6441a543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:00.381412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:00.381412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:00.381412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:00.381412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:00.381412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:00.381412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:00.381412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:00.381412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:00.381412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:00.381412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:00.381412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:00.381412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:00.381412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:00.381412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:00.381412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:00.382672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:00.382672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:00.382672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:00.382672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:00.382672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:00.382672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:00.382672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:00.382672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:00.382672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:00.382672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:00.382672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:00.382672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:00.382672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:00.382672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:00.382672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:00.382672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:00.382672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:00.384116 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:00.384116 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:00.384116 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:00.384116 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 384/782] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:00.389435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593ac7d-ef1f-433f-b0e1-cc38bb89bb58 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:00.390620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bffad-40e6-41b7-a03f-c52d6441a543 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:00.545571 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bffad-40e6-41b7-a03f-c52d6441a543 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:00.582282 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7413c-9c2b-42b2-9bc4-d4f8f6aac5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:00.582875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7413c-9c2b-42b2-9bc4-d4f8f6aac5fa None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:00.583161 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7413c-9c2b-42b2-9bc4-d4f8f6aac5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:00.583434 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7413c-9c2b-42b2-9bc4-d4f8f6aac5fa None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:00.584085 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7413c-9c2b-42b2-9bc4-d4f8f6aac5fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:00.584600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7413c-9c2b-42b2-9bc4-d4f8f6aac5fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:00.586171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7413c-9c2b-42b2-9bc4-d4f8f6aac5fa None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:00.601735 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 385/783] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:00.608037 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7413c-9c2b-42b2-9bc4-d4f8f6aac5fa None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:00.664265 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:00.676711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593ac7d-ef1f-433f-b0e1-cc38bb89bb58 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:00.712545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7413c-9c2b-42b2-9bc4-d4f8f6aac5fa None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:00.740847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272443c0-0873-4d3e-bf98-75c2b15c901f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:00.741457 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272443c0-0873-4d3e-bf98-75c2b15c901f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:00.741734 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272443c0-0873-4d3e-bf98-75c2b15c901f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:00.742006 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272443c0-0873-4d3e-bf98-75c2b15c901f None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:00.742639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272443c0-0873-4d3e-bf98-75c2b15c901f None admin] RBAC: Adding query filter params (type=network) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:00.742968 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272443c0-0873-4d3e-bf98-75c2b15c901f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:00.744344 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272443c0-0873-4d3e-bf98-75c2b15c901f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:00.748918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8953ecb-9976-4f38-8977-b8befa1a54f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:00.749762 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8953ecb-9976-4f38-8977-b8befa1a54f5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:00.750183 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8953ecb-9976-4f38-8977-b8befa1a54f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:00.750599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8953ecb-9976-4f38-8977-b8befa1a54f5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:00.756893 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 399/784] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Aug 11 10:44:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:00.762959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8953ecb-9976-4f38-8977-b8befa1a54f5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:00.764639 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8953ecb-9976-4f38-8977-b8befa1a54f5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:00.767030 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272443c0-0873-4d3e-bf98-75c2b15c901f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:00.778618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e8953ecb-9976-4f38-8977-b8befa1a54f5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 11 10:44:00.778618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:00.778618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:00.778618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:00.778618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:00.778618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:00.778618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:00.778618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:00.778618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:00.778618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:00.778618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:00.778618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:00.778618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:44:00.778618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:44:00.778618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:44:00.778618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:44:00.779789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:00.779789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:00.779789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:44:00.779789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:00.779789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:44:00.779789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:00.779789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:00.779789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:00.779789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:00.779789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:00.779789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:00.779789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:00.779789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:00.779789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:00.779789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:00.779789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:00.779789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:00.779789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:00.780921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:00.780921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:00.780921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:44:00.780921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:44:00.780921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:44:00.780921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:44:00.780921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:44:00.780921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:44:00.780921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 11 10:44:00.780921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:00.783059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 386/785] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:44:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:00.789650 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8953ecb-9976-4f38-8977-b8befa1a54f5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:00.832238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:00.914779 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8953ecb-9976-4f38-8977-b8befa1a54f5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:00.926770 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:00.953350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d97c0-5c26-4b74-a091-e86debbbe4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:00.954426 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d97c0-5c26-4b74-a091-e86debbbe4ad None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:00.954714 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d97c0-5c26-4b74-a091-e86debbbe4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:00.955042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d97c0-5c26-4b74-a091-e86debbbe4ad None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:00.955901 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d97c0-5c26-4b74-a091-e86debbbe4ad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:00.956243 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d97c0-5c26-4b74-a091-e86debbbe4ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:00.958477 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d97c0-5c26-4b74-a091-e86debbbe4ad None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:00.978472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 387/786] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Aug 11 10:44:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:00.985231 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d97c0-5c26-4b74-a091-e86debbbe4ad None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:00.996308 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272443c0-0873-4d3e-bf98-75c2b15c901f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:01.095393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d97c0-5c26-4b74-a091-e86debbbe4ad None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:01.123460 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef24cb-e0a7-4407-82e1-ed79fc4c5a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:01.124085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef24cb-e0a7-4407-82e1-ed79fc4c5a6d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:01.124365 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef24cb-e0a7-4407-82e1-ed79fc4c5a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:01.124628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef24cb-e0a7-4407-82e1-ed79fc4c5a6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:01.125334 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef24cb-e0a7-4407-82e1-ed79fc4c5a6d None admin] RBAC: Adding query filter params (interface=public, service_id=dacacaf276b847acaf79881b9e72cfa3, region_id=RegionOne) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:01.125631 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef24cb-e0a7-4407-82e1-ed79fc4c5a6d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:01.127018 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef24cb-e0a7-4407-82e1-ed79fc4c5a6d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:01.133118 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aeadbf-7a75-4de3-9abe-6c2c38e94d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:01.134278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeadbf-7a75-4de3-9abe-6c2c38e94d06 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:01.134564 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeadbf-7a75-4de3-9abe-6c2c38e94d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:01.134865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aeadbf-7a75-4de3-9abe-6c2c38e94d06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:01.141939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 400/787] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Aug 11 10:44:00 2022] GET /identity/v3/endpoints?service_id=dacacaf276b847acaf79881b9e72cfa3&interface=public®ion_id=RegionOne => generated 194 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:01.150972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aeadbf-7a75-4de3-9abe-6c2c38e94d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:01.151748 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef24cb-e0a7-4407-82e1-ed79fc4c5a6d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:01.152440 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aeadbf-7a75-4de3-9abe-6c2c38e94d06 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:01.171049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c6aeadbf-7a75-4de3-9abe-6c2c38e94d06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:01.171049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:01.171049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:01.171049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:01.171049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:01.171049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:01.171049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:01.171049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:01.171049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:01.171049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:01.171049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:01.171049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:01.171049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:01.171049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:01.171049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:01.171049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:01.172006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:01.172006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:01.172006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:01.172006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:01.172006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:01.172006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:01.172006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:01.172006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:01.172006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:01.172006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:01.172006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:01.172006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:01.172006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:01.172006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:01.172006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:01.172006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:01.172006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:01.174323 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:01.174323 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:01.174323 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:01.174323 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 388/788] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:01.178406 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aeadbf-7a75-4de3-9abe-6c2c38e94d06 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:01.209202 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:01.298796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aeadbf-7a75-4de3-9abe-6c2c38e94d06 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:01.336463 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed183382-94ac-432c-bae1-fe99bc8994e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:01.337420 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed183382-94ac-432c-bae1-fe99bc8994e5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:01.337841 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed183382-94ac-432c-bae1-fe99bc8994e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:01.338818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed183382-94ac-432c-bae1-fe99bc8994e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:01.339658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed183382-94ac-432c-bae1-fe99bc8994e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:01.340127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed183382-94ac-432c-bae1-fe99bc8994e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:01.341666 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed183382-94ac-432c-bae1-fe99bc8994e5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:01.354478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 389/789] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:01.360633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed183382-94ac-432c-bae1-fe99bc8994e5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:01.421484 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:01.439340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef24cb-e0a7-4407-82e1-ed79fc4c5a6d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:01.450671 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:01.472995 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed183382-94ac-432c-bae1-fe99bc8994e5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:01.492396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e08e25-8208-4e09-b64a-720da09742d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:01.493018 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e08e25-8208-4e09-b64a-720da09742d9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:01.493296 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e08e25-8208-4e09-b64a-720da09742d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:01.493572 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e08e25-8208-4e09-b64a-720da09742d9 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:01.494181 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e08e25-8208-4e09-b64a-720da09742d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:01.496258 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e08e25-8208-4e09-b64a-720da09742d9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:01.514789 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 401/790] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Aug 11 10:44:01 2022] GET /identity/v3/services => generated 772 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:01.523689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23514a-119c-4445-9cd6-60d898938b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:01.524710 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23514a-119c-4445-9cd6-60d898938b9e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:01.525277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23514a-119c-4445-9cd6-60d898938b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:01.526271 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23514a-119c-4445-9cd6-60d898938b9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:01.534371 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23514a-119c-4445-9cd6-60d898938b9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:01.536148 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23514a-119c-4445-9cd6-60d898938b9e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:01.558816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ee23514a-119c-4445-9cd6-60d898938b9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:01.558816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:01.558816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:01.558816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:01.558816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:01.558816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:01.558816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:01.558816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:01.558816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:01.558816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:01.558816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:01.558816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:01.558816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:44:01.558816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:44:01.558816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:44:01.559758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:44:01.559758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:01.559758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:01.559758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:01.559758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:01.559758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:01.559758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:01.559758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:01.559758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:01.559758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:01.559758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:01.559758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:01.559758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:01.559758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:01.559758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:01.559758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:01.559758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:01.560599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:44:01.560599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:44:01.560599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:44:01.560599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:44:01.560599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:44:01.560599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:44:01.560599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:01.560599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:01.563275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 390/791] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:44:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:01.571932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e08e25-8208-4e09-b64a-720da09742d9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:01.692392 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312626b3-e831-40df-811d-ad5a548215a6 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:01.692586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312626b3-e831-40df-811d-ad5a548215a6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:01.692975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312626b3-e831-40df-811d-ad5a548215a6 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:01.695783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 391/792] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:01.708672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e1771-bb82-4731-afbc-c8ad94a45c3a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:01.709274 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e1771-bb82-4731-afbc-c8ad94a45c3a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:01.709781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e1771-bb82-4731-afbc-c8ad94a45c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:01.723066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e08e25-8208-4e09-b64a-720da09742d9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:01.732144 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-da3e1771-bb82-4731-afbc-c8ad94a45c3a None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:01.734017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-da3e1771-bb82-4731-afbc-c8ad94a45c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:01.758335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc80f1-6fa8-44df-a75d-3f6803b3c466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:01.758975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc80f1-6fa8-44df-a75d-3f6803b3c466 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:01.759253 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc80f1-6fa8-44df-a75d-3f6803b3c466 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:01.759531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc80f1-6fa8-44df-a75d-3f6803b3c466 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:01.760742 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc80f1-6fa8-44df-a75d-3f6803b3c466 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:01.761045 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc80f1-6fa8-44df-a75d-3f6803b3c466 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:01.762480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc80f1-6fa8-44df-a75d-3f6803b3c466 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:01.775338 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 402/793] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:44:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:01.787805 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc80f1-6fa8-44df-a75d-3f6803b3c466 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:01.804407 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:01.819933 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 392/794] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 10:44:01.844726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e1771-bb82-4731-afbc-c8ad94a45c3a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:01.892238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc80f1-6fa8-44df-a75d-3f6803b3c466 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:01.922096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:01.928402 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be969d4-2dec-481b-82f4-17adb7859784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:01.929071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be969d4-2dec-481b-82f4-17adb7859784 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:01.929342 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be969d4-2dec-481b-82f4-17adb7859784 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:01.929613 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be969d4-2dec-481b-82f4-17adb7859784 None admin] PATH_INFO: `/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/cbd25d1bde0c4703b61e0edaf5b658d4/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:01.931669 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be969d4-2dec-481b-82f4-17adb7859784 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb12c96bf3a84df0b86967fbe93d1c17, user_id=cbd25d1bde0c4703b61e0edaf5b658d4, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:01.933264 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be969d4-2dec-481b-82f4-17adb7859784 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:01.958333 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e1771-bb82-4731-afbc-c8ad94a45c3a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:01.992118 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d354d71-eaa8-486f-b1a0-58dc02fb75b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:01.992779 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d354d71-eaa8-486f-b1a0-58dc02fb75b2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:01.993102 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d354d71-eaa8-486f-b1a0-58dc02fb75b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:01.993378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d354d71-eaa8-486f-b1a0-58dc02fb75b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:02.003730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d354d71-eaa8-486f-b1a0-58dc02fb75b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:44:02.009722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-7d354d71-eaa8-486f-b1a0-58dc02fb75b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:44:02.009722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:02.009722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:02.009722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:02.009722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:02.009722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:02.009722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:02.009722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:02.009722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:02.009722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:02.009722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:02.009722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:02.009722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:44:02.009722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:44:02.009722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:44:02.009722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:44:02.011574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:44:02.011574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:44:02.011574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:44:02.011574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:44:02.011574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:02.011574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:02.011574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:02.011574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:02.011574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:02.011574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:02.011574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:02.011574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:02.011574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:02.011574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:02.011574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:02.011574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:02.012555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:02.012555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:02.012555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:02.012555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:02.012555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:44:02.012555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:44:02.012555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:44:02.012555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:44:02.012555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:44:02.012555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:44:02.012555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:44:02.012555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:02.012555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 393/795] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:44:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:02.013236 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a965cd1-8a8a-46da-b4cc-bcc98c3e7aaf None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:02.013236 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a965cd1-8a8a-46da-b4cc-bcc98c3e7aaf None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:02.013420 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a965cd1-8a8a-46da-b4cc-bcc98c3e7aaf None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:02.014906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 394/796] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:02.018817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a28cbb-9be7-4870-aa69-23e055831845 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:02.018817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a28cbb-9be7-4870-aa69-23e055831845 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:02.018817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a28cbb-9be7-4870-aa69-23e055831845 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:02.018817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 395/798] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:02.018817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a28cbb-9be7-4870-aa69-23e055831845 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:02.026262 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 403/798] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:44:01 2022] PUT /identity/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/cbd25d1bde0c4703b61e0edaf5b658d4/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:44:02.027857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe45660-ff96-43d9-812f-5ffbbcfa488c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:02.028246 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe45660-ff96-43d9-812f-5ffbbcfa488c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:02.034809 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe45660-ff96-43d9-812f-5ffbbcfa488c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:02.076278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-dbe45660-ff96-43d9-812f-5ffbbcfa488c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:02.078838 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-dbe45660-ff96-43d9-812f-5ffbbcfa488c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:02.150923 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a28cbb-9be7-4870-aa69-23e055831845 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:02.183600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:02.189290 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 404/799] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:02.191105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a077157-06f7-4570-8c6b-a636b334456f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:02.191645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a077157-06f7-4570-8c6b-a636b334456f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:02.192072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a077157-06f7-4570-8c6b-a636b334456f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:02.193310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fe384-92e8-4db5-898f-470a395a4b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:02.194054 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fe384-92e8-4db5-898f-470a395a4b59 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:02.194333 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fe384-92e8-4db5-898f-470a395a4b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:02.194600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fe384-92e8-4db5-898f-470a395a4b59 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:02.195323 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480fe384-92e8-4db5-898f-470a395a4b59 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:02.195601 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480fe384-92e8-4db5-898f-470a395a4b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:02.196960 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480fe384-92e8-4db5-898f-470a395a4b59 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:02.202992 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:02.205833 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 396/800] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Aug 11 10:44:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:02.211230 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fe384-92e8-4db5-898f-470a395a4b59 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:02.219815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4a077157-06f7-4570-8c6b-a636b334456f None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:02.220140 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4a077157-06f7-4570-8c6b-a636b334456f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:02.312083 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 405/801] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:02.313412 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a077157-06f7-4570-8c6b-a636b334456f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:02.344741 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fe384-92e8-4db5-898f-470a395a4b59 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:02.380075 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47155ff2-d6a9-42ec-8541-57b8c7a15310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:02.380706 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47155ff2-d6a9-42ec-8541-57b8c7a15310 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:02.380984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47155ff2-d6a9-42ec-8541-57b8c7a15310 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:02.381251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47155ff2-d6a9-42ec-8541-57b8c7a15310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:02.392315 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47155ff2-d6a9-42ec-8541-57b8c7a15310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:02.393770 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47155ff2-d6a9-42ec-8541-57b8c7a15310 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:02.408153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-47155ff2-d6a9-42ec-8541-57b8c7a15310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:02.408153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:02.408153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:02.408153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:02.408153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:02.408153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:02.408153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:02.408153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:02.408153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:02.408153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:02.408153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:02.408153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:02.408153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:02.408153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:02.408153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:02.408153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:02.409203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:02.409203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:02.409203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:02.409203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:02.409203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:02.409203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:02.409203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:02.409203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:02.409203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:02.409203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:02.409203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:02.409203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:02.409203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:02.409203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:02.409203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:02.409203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:02.409203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:02.410510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:02.410510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:02.410510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:02.410510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 397/802] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:02.410510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47155ff2-d6a9-42ec-8541-57b8c7a15310 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:02.441316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a077157-06f7-4570-8c6b-a636b334456f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:02.471352 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:02.473644 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:02.483586 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b639894-87e3-49c3-8d66-49db62fff9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:02.484912 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b639894-87e3-49c3-8d66-49db62fff9d0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:02.491285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b639894-87e3-49c3-8d66-49db62fff9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:02.491285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b639894-87e3-49c3-8d66-49db62fff9d0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:02.491285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b639894-87e3-49c3-8d66-49db62fff9d0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:02.491285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b639894-87e3-49c3-8d66-49db62fff9d0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:02.501488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-0b639894-87e3-49c3-8d66-49db62fff9d0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 10:44:02.501488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:02.501488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:44:02.501488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:44:02.501488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:44:02.501488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:44:02.501488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:44:02.501488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:02.501488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 10:44:02.501488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:02.501488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:02.501488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:02.501488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:02.501488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:02.501488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:02.501488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:02.501488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:02.502533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:02.502533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:02.502533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:02.502533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:02.502533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:02.502533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:02.502533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:44:02.502533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:44:02.502533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:44:02.502533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:44:02.502533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:02.502533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:02.502533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:02.502533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:02.502533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:02.502533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:02.503711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:02.503711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:02.503711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:02.503711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:02.503711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:02.503711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:02.503711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:02.503711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:02.503711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:02.503711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:02.503711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:44:02.503711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:02.503711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 11 10:44:02.503711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:02.507098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 406/803] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Aug 11 10:44:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:02.508191 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b639894-87e3-49c3-8d66-49db62fff9d0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:02.536774 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47155ff2-d6a9-42ec-8541-57b8c7a15310 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:02.586596 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187c3b5-adbe-4d6c-bb52-dabe38384dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:02.587284 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187c3b5-adbe-4d6c-bb52-dabe38384dab None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:02.587566 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187c3b5-adbe-4d6c-bb52-dabe38384dab None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:02.587838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187c3b5-adbe-4d6c-bb52-dabe38384dab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:02.602277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187c3b5-adbe-4d6c-bb52-dabe38384dab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:44:02.610117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-1187c3b5-adbe-4d6c-bb52-dabe38384dab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:44:02.610117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:02.610117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:02.610117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:02.610117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:02.610117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:02.610117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:02.610117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:02.610117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:02.610117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:02.610117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:02.610117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:02.610117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:44:02.610117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:44:02.610117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:44:02.610117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:44:02.611079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:44:02.611079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:44:02.611079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:44:02.611079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:44:02.611079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:02.611079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:02.611079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:02.611079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:02.611079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:02.611079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:02.611079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:02.611079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:02.611079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:02.611079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:02.611079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:02.611079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:02.611894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:02.611894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:02.611894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:02.611894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:02.611894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:44:02.611894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:44:02.611894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:44:02.611894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:44:02.611894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:44:02.611894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:44:02.611894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:44:02.611894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:02.616807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 398/804] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:44:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:02.617668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187c3b5-adbe-4d6c-bb52-dabe38384dab None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:02.630236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b639894-87e3-49c3-8d66-49db62fff9d0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:02.665768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79197e4-f633-4b5a-aa0c-c21d9d7b8225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:02.667381 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79197e4-f633-4b5a-aa0c-c21d9d7b8225 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:02.667912 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79197e4-f633-4b5a-aa0c-c21d9d7b8225 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:02.668381 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79197e4-f633-4b5a-aa0c-c21d9d7b8225 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:02.669268 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79197e4-f633-4b5a-aa0c-c21d9d7b8225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:02.669769 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79197e4-f633-4b5a-aa0c-c21d9d7b8225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:02.671465 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79197e4-f633-4b5a-aa0c-c21d9d7b8225 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:02.686129 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 407/805] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:02.691663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79197e4-f633-4b5a-aa0c-c21d9d7b8225 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:02.747182 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187c3b5-adbe-4d6c-bb52-dabe38384dab None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:02.750950 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:02.763881 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:02.790197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90621cb-6575-4a17-a4f6-f0afdd30e4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:02.791089 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90621cb-6575-4a17-a4f6-f0afdd30e4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:02.791609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90621cb-6575-4a17-a4f6-f0afdd30e4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:02.792021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90621cb-6575-4a17-a4f6-f0afdd30e4d9 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:02.795372 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90621cb-6575-4a17-a4f6-f0afdd30e4d9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:02.795372 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90621cb-6575-4a17-a4f6-f0afdd30e4d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:02.795372 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90621cb-6575-4a17-a4f6-f0afdd30e4d9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:02.804585 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 399/806] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Aug 11 10:44:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:02.805671 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90621cb-6575-4a17-a4f6-f0afdd30e4d9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:02.811618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79197e4-f633-4b5a-aa0c-c21d9d7b8225 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:02.849505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c787f-57b9-4e21-9681-0eec62dfb1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:02.850030 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c787f-57b9-4e21-9681-0eec62dfb1fc None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:02.850365 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c787f-57b9-4e21-9681-0eec62dfb1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:02.850645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c787f-57b9-4e21-9681-0eec62dfb1fc None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:02.851510 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c787f-57b9-4e21-9681-0eec62dfb1fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:02.851816 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c787f-57b9-4e21-9681-0eec62dfb1fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:02.853243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c787f-57b9-4e21-9681-0eec62dfb1fc None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:02.867170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 408/807] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:44:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:02.867170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c787f-57b9-4e21-9681-0eec62dfb1fc None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:02.930790 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90621cb-6575-4a17-a4f6-f0afdd30e4d9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:02.968744 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05bfba-db8a-4b5d-8a2e-f9078b6ba9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:02.969402 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05bfba-db8a-4b5d-8a2e-f9078b6ba9fb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:02.969736 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05bfba-db8a-4b5d-8a2e-f9078b6ba9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:02.970008 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05bfba-db8a-4b5d-8a2e-f9078b6ba9fb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:02.977997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05bfba-db8a-4b5d-8a2e-f9078b6ba9fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:02.979577 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05bfba-db8a-4b5d-8a2e-f9078b6ba9fb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:02.991713 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ca05bfba-db8a-4b5d-8a2e-f9078b6ba9fb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 10:44:02.991713 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:02.991713 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:02.991713 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:02.991713 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:02.991713 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:02.991713 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:02.991713 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:02.991713 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:02.991713 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:02.991713 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:02.991713 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:02.991713 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:44:02.991713 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:44:02.991713 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:44:02.991713 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:44:02.992610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:02.992610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:02.992610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:44:02.992610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:02.992610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:44:02.992610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:02.992610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:02.992610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:02.992610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:02.992610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:02.992610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:02.992610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:02.992610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:02.992610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:02.992610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:02.992610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:02.992610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:02.992610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:02.993523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:02.993523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:02.993523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:44:02.993523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:44:02.993523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:44:02.993523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:44:02.993523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:44:02.993523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:44:02.993523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 10:44:02.993523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:02.998102 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 400/808] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Aug 11 10:44:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:02.998907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05bfba-db8a-4b5d-8a2e-f9078b6ba9fb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:03.013369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c787f-57b9-4e21-9681-0eec62dfb1fc None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:03.033027 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:03.047948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:03.071231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971517d-3f10-4aa1-a1e5-c59afe9db2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:03.072414 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971517d-3f10-4aa1-a1e5-c59afe9db2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:03.073345 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971517d-3f10-4aa1-a1e5-c59afe9db2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:03.073945 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971517d-3f10-4aa1-a1e5-c59afe9db2b4 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:03.074876 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971517d-3f10-4aa1-a1e5-c59afe9db2b4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:03.075355 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971517d-3f10-4aa1-a1e5-c59afe9db2b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:03.077152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971517d-3f10-4aa1-a1e5-c59afe9db2b4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:03.089226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 409/809] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Aug 11 10:44:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:03.089226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971517d-3f10-4aa1-a1e5-c59afe9db2b4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:03.129283 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05bfba-db8a-4b5d-8a2e-f9078b6ba9fb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:03.176598 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97d809-334b-4d7f-b45a-231b1536c22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:03.177754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97d809-334b-4d7f-b45a-231b1536c22e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:03.178746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97d809-334b-4d7f-b45a-231b1536c22e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:03.179343 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97d809-334b-4d7f-b45a-231b1536c22e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:03.193627 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97d809-334b-4d7f-b45a-231b1536c22e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:03.196654 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97d809-334b-4d7f-b45a-231b1536c22e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:03.199232 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971517d-3f10-4aa1-a1e5-c59afe9db2b4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:03.217606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-db97d809-334b-4d7f-b45a-231b1536c22e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:03.217606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:03.217606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:03.217606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:03.217606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:03.217606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:03.217606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:03.217606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:03.217606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:03.217606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:03.217606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:03.217606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:03.217606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:03.217606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:03.217606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:03.217606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:03.218799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:03.218799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:03.218799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:03.218799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:03.218799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:03.218799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:03.218799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:03.218799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:03.218799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:03.218799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:03.218799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:03.218799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:03.218799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:03.218799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:03.218799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:03.218799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:03.218799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:03.219864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:03.219864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:03.219864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:03.227458 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 401/810] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:03.229595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97d809-334b-4d7f-b45a-231b1536c22e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:03.245429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a34139-8ba5-4a95-8fc2-1f4b8b08f8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:03.246191 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a34139-8ba5-4a95-8fc2-1f4b8b08f8fe None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:03.246624 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a34139-8ba5-4a95-8fc2-1f4b8b08f8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:03.247021 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a34139-8ba5-4a95-8fc2-1f4b8b08f8fe None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:03.247957 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a34139-8ba5-4a95-8fc2-1f4b8b08f8fe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:03.248422 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a34139-8ba5-4a95-8fc2-1f4b8b08f8fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:03.249975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a34139-8ba5-4a95-8fc2-1f4b8b08f8fe None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:03.269243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 410/811] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Aug 11 10:44:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:03.270300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a34139-8ba5-4a95-8fc2-1f4b8b08f8fe None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:03.326178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:03.329230 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:03.350307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97d809-334b-4d7f-b45a-231b1536c22e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:03.389851 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85598e39-ecad-4bb6-95e4-86c76add4112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:03.390681 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85598e39-ecad-4bb6-95e4-86c76add4112 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:03.391091 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85598e39-ecad-4bb6-95e4-86c76add4112 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:03.391463 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85598e39-ecad-4bb6-95e4-86c76add4112 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:03.392361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85598e39-ecad-4bb6-95e4-86c76add4112 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:03.393921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85598e39-ecad-4bb6-95e4-86c76add4112 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:03.398862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a34139-8ba5-4a95-8fc2-1f4b8b08f8fe None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:03.436853 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700a190-3214-4ec8-b87e-775ed0913665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:03.437654 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700a190-3214-4ec8-b87e-775ed0913665 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:03.437935 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700a190-3214-4ec8-b87e-775ed0913665 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:03.438222 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700a190-3214-4ec8-b87e-775ed0913665 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:03.438876 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700a190-3214-4ec8-b87e-775ed0913665 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:03.439179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700a190-3214-4ec8-b87e-775ed0913665 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:03.441804 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9700a190-3214-4ec8-b87e-775ed0913665 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:03.457709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 411/812] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:03.457709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700a190-3214-4ec8-b87e-775ed0913665 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:03.503156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 402/813] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 10:44:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:44:03.504218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85598e39-ecad-4bb6-95e4-86c76add4112 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:03.585729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:03.591249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700a190-3214-4ec8-b87e-775ed0913665 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:03.643167 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f6d96-e581-4432-8cd7-dcfd693016ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:03.644064 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f6d96-e581-4432-8cd7-dcfd693016ee None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:03.644972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f6d96-e581-4432-8cd7-dcfd693016ee None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:03.645446 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f6d96-e581-4432-8cd7-dcfd693016ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:03.659342 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f6d96-e581-4432-8cd7-dcfd693016ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:03.661396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f6d96-e581-4432-8cd7-dcfd693016ee None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:03.687285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-b35f6d96-e581-4432-8cd7-dcfd693016ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:03.687285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:03.687285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:03.687285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:03.687285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:03.687285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:03.687285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:03.687285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:03.687285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:03.687285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:03.687285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:03.687285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:03.687285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:03.687285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:03.687285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:03.687285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:03.688436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:03.688436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:03.688436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:03.688436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:03.688436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:03.688436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:03.688436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:03.688436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:03.688436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:03.688436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:03.688436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:03.688436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:03.688436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:03.688436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:03.688436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:03.688436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:03.688436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:03.689469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:03.689469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:03.689469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:03.691964 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 412/814] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:03.699094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f6d96-e581-4432-8cd7-dcfd693016ee None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:03.769962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85598e39-ecad-4bb6-95e4-86c76add4112 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:03.819487 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206da01e-fed8-46de-bcf9-f52fdc590b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:03.820150 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206da01e-fed8-46de-bcf9-f52fdc590b5a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:03.820554 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206da01e-fed8-46de-bcf9-f52fdc590b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:03.820850 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206da01e-fed8-46de-bcf9-f52fdc590b5a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:03.824188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:03.831642 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206da01e-fed8-46de-bcf9-f52fdc590b5a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:03.833032 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f6d96-e581-4432-8cd7-dcfd693016ee None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:03.833522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206da01e-fed8-46de-bcf9-f52fdc590b5a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:03.846882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-206da01e-fed8-46de-bcf9-f52fdc590b5a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 10:44:03.846882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:03.846882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:03.846882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:03.846882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:03.846882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:03.846882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:03.846882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:03.846882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:03.846882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:03.846882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:03.846882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:03.846882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:44:03.846882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:44:03.846882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:44:03.846882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:44:03.847845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:03.847845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:03.847845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:44:03.847845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:03.847845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:44:03.847845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:03.847845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:03.847845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:03.847845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:03.847845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:03.847845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:03.847845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:03.847845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:03.847845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:03.847845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:03.847845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:03.847845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:03.847845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:03.848750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:03.848750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:03.848750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:44:03.848750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:44:03.848750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:44:03.848750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:44:03.848750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:44:03.848750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:44:03.848750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 10:44:03.848750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:03.851143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 403/815] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Aug 11 10:44:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:03.852309 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ba948-b6c1-4fb4-9744-381b24440553 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:03.852690 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ba948-b6c1-4fb4-9744-381b24440553 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:03.853028 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ba948-b6c1-4fb4-9744-381b24440553 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:03.855355 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 404/816] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:03.858367 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ba948-b6c1-4fb4-9744-381b24440553 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:03.884685 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb802df1-f207-4589-86ed-abb38ba3a307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:03.884685 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb802df1-f207-4589-86ed-abb38ba3a307 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:03.884685 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb802df1-f207-4589-86ed-abb38ba3a307 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:03.884685 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb802df1-f207-4589-86ed-abb38ba3a307 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:03.885936 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb802df1-f207-4589-86ed-abb38ba3a307 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:03.886295 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb802df1-f207-4589-86ed-abb38ba3a307 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:03.887784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb802df1-f207-4589-86ed-abb38ba3a307 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:03.904106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 413/817] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:03.905483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae2235-24e1-417c-b783-963a5ac6a569 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:03.905871 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae2235-24e1-417c-b783-963a5ac6a569 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:03.906256 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae2235-24e1-417c-b783-963a5ac6a569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:03.925677 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c1ae2235-24e1-417c-b783-963a5ac6a569 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:03.927124 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c1ae2235-24e1-417c-b783-963a5ac6a569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:03.929499 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:04.004157 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ba948-b6c1-4fb4-9744-381b24440553 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:04.009039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 414/818] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:04.010661 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae2235-24e1-417c-b783-963a5ac6a569 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:04.071744 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b6e9f-a60f-4677-8bdc-fc03ae6ae71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:04.073114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b6e9f-a60f-4677-8bdc-fc03ae6ae71e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:04.073524 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b6e9f-a60f-4677-8bdc-fc03ae6ae71e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:04.073898 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b6e9f-a60f-4677-8bdc-fc03ae6ae71e None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:04.074813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b6e9f-a60f-4677-8bdc-fc03ae6ae71e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:04.075186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b6e9f-a60f-4677-8bdc-fc03ae6ae71e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:04.076764 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b6e9f-a60f-4677-8bdc-fc03ae6ae71e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:04.100366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 405/819] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Aug 11 10:44:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:04.101408 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b6e9f-a60f-4677-8bdc-fc03ae6ae71e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:04.134382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae2235-24e1-417c-b783-963a5ac6a569 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:04.160470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:04.176801 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb33af-8f37-4d17-a16a-5f44d546b41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:04.177430 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb33af-8f37-4d17-a16a-5f44d546b41c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:04.177706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb33af-8f37-4d17-a16a-5f44d546b41c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:04.177976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb33af-8f37-4d17-a16a-5f44d546b41c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:04.185031 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb33af-8f37-4d17-a16a-5f44d546b41c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:04.186467 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb33af-8f37-4d17-a16a-5f44d546b41c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:04.188336 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:04.199114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-15eb33af-8f37-4d17-a16a-5f44d546b41c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:04.199114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:04.199114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:04.199114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:04.199114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:04.199114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:04.199114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:04.199114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:04.199114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:04.199114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:04.199114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:04.199114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:04.199114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:44:04.199114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:44:04.199114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:44:04.206303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:44:04.206303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:04.206303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:04.206303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:04.206303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:04.206303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:04.206303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:04.206303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:04.206303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:04.206303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:04.206303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:04.206303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:04.206303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:04.206303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:04.206303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:04.206303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:04.206303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:04.207220 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:44:04.207220 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:44:04.207220 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:44:04.207220 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:44:04.207220 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:44:04.207220 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:44:04.207220 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:04.207220 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:04.207220 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 415/820] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:44:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:04.207220 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb33af-8f37-4d17-a16a-5f44d546b41c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:04.215090 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b6e9f-a60f-4677-8bdc-fc03ae6ae71e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:04.253428 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4da52-e534-49f3-b4fa-15771b30e9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:04.254066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4da52-e534-49f3-b4fa-15771b30e9da None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:04.254345 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4da52-e534-49f3-b4fa-15771b30e9da None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:04.254619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4da52-e534-49f3-b4fa-15771b30e9da None admin] PATH_INFO: `/v3/services/network` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:04.255221 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4da52-e534-49f3-b4fa-15771b30e9da None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:04.256575 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4da52-e534-49f3-b4fa-15771b30e9da None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:04.265826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-50e4da52-e534-49f3-b4fa-15771b30e9da None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 10:44:04.265826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:04.265826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:44:04.265826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:44:04.265826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:44:04.265826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:44:04.265826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:44:04.265826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:04.265826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 10:44:04.265826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:04.265826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:04.265826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:04.265826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:04.265826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:04.265826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:04.265826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:04.265826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:04.266796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:04.266796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:04.266796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:04.266796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:04.266796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:04.266796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:04.266796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:44:04.266796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:44:04.266796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:44:04.266796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:44:04.266796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:04.266796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:04.266796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:04.266796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:04.266796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:04.266796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:04.267641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:04.267641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:04.267641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:04.267641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:04.267641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:04.267641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:04.267641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:04.267641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:04.267641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:04.267641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:04.267641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:44:04.267641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:04.267641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 11 10:44:04.267641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:04.267641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 406/821] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:44:04 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:04.268406 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db63be-bd19-48b6-8bd8-eb17b4e0292f None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:04.268406 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db63be-bd19-48b6-8bd8-eb17b4e0292f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:04.270393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5db63be-bd19-48b6-8bd8-eb17b4e0292f None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:04.270393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 407/822] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:04.270738 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db63be-bd19-48b6-8bd8-eb17b4e0292f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:04.316734 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb33af-8f37-4d17-a16a-5f44d546b41c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:04.354794 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb9f21-e783-410c-bdf7-41f06ed462f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:04.355569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb9f21-e783-410c-bdf7-41f06ed462f9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:04.355955 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb9f21-e783-410c-bdf7-41f06ed462f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:04.356330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb9f21-e783-410c-bdf7-41f06ed462f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:04.385900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5db63be-bd19-48b6-8bd8-eb17b4e0292f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:04.405087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:04.422115 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d63135-1f27-44dc-8345-d8f90136c1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:04.422331 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:04.422736 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d63135-1f27-44dc-8345-d8f90136c1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:04.423094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d63135-1f27-44dc-8345-d8f90136c1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:04.423366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d63135-1f27-44dc-8345-d8f90136c1f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:04.424077 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d63135-1f27-44dc-8345-d8f90136c1f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:04.424386 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d63135-1f27-44dc-8345-d8f90136c1f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:04.425811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d63135-1f27-44dc-8345-d8f90136c1f4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:04.426188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb9f21-e783-410c-bdf7-41f06ed462f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:04.427830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb9f21-e783-410c-bdf7-41f06ed462f9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:04.443083 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 408/823] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:44:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:04.444448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d63135-1f27-44dc-8345-d8f90136c1f4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:04.531594 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 416/824] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:44:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 10:44:04.532857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da8c5f-e6a9-4f96-9650-66c989ec4008 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:04.533140 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da8c5f-e6a9-4f96-9650-66c989ec4008 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:04.533409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da8c5f-e6a9-4f96-9650-66c989ec4008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:04.551760 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a7da8c5f-e6a9-4f96-9650-66c989ec4008 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:04.552929 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a7da8c5f-e6a9-4f96-9650-66c989ec4008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:04.557707 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d63135-1f27-44dc-8345-d8f90136c1f4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:04.594278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e259413-1320-4a88-9327-dc08cf517a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:04.594908 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e259413-1320-4a88-9327-dc08cf517a83 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:04.595198 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e259413-1320-4a88-9327-dc08cf517a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:04.595499 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e259413-1320-4a88-9327-dc08cf517a83 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:04.596087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e259413-1320-4a88-9327-dc08cf517a83 None admin] RBAC: Adding query filter params (name=network) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:04.596387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e259413-1320-4a88-9327-dc08cf517a83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:04.598142 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e259413-1320-4a88-9327-dc08cf517a83 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:04.603024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 409/825] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Aug 11 10:44:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:04.603959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e259413-1320-4a88-9327-dc08cf517a83 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:04.631367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 417/826] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:04.632497 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da8c5f-e6a9-4f96-9650-66c989ec4008 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:04.661000 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:04.662010 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:04.729829 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e259413-1320-4a88-9327-dc08cf517a83 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:04.737089 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da8c5f-e6a9-4f96-9650-66c989ec4008 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:04.767194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e97cc-2e63-4c00-82e2-acaffe721805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:04.767856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e97cc-2e63-4c00-82e2-acaffe721805 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:04.768136 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e97cc-2e63-4c00-82e2-acaffe721805 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:04.768412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e97cc-2e63-4c00-82e2-acaffe721805 None admin] PATH_INFO: `/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/9751264123914c27b961009f75067660/roles/6de833fef4c9456cb5d8ad66caf96586` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:04.773246 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ca35e-d66b-4be0-9eed-5c4cde67db49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:04.773872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ca35e-d66b-4be0-9eed-5c4cde67db49 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:04.774155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ca35e-d66b-4be0-9eed-5c4cde67db49 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:04.774424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ca35e-d66b-4be0-9eed-5c4cde67db49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:04.784889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e97cc-2e63-4c00-82e2-acaffe721805 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb12c96bf3a84df0b86967fbe93d1c17, user_id=9751264123914c27b961009f75067660, role_id=6de833fef4c9456cb5d8ad66caf96586)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:04.785969 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ca35e-d66b-4be0-9eed-5c4cde67db49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:04.786495 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e97cc-2e63-4c00-82e2-acaffe721805 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:04.787439 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ca35e-d66b-4be0-9eed-5c4cde67db49 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:04.802285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-c01ca35e-d66b-4be0-9eed-5c4cde67db49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:04.802285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:04.802285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:04.802285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:04.802285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:04.802285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:04.802285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:04.802285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:04.802285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:04.802285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:04.802285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:04.802285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:04.802285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:04.802285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:04.802285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:04.802285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:04.807022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:04.807022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:04.807022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:04.807022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:04.807022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:04.807022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:04.807022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:04.807022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:04.807022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:04.807022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:04.807022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:04.807022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:04.807022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:04.807022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:04.807022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:04.807022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:04.807022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:04.807940 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:04.807940 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:04.807940 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:04.807940 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 418/827] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:04.807940 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ca35e-d66b-4be0-9eed-5c4cde67db49 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:04.887431 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:04.906158 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ca35e-d66b-4be0-9eed-5c4cde67db49 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:04.919244 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 410/828] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:44:04 2022] PUT /identity/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/9751264123914c27b961009f75067660/roles/6de833fef4c9456cb5d8ad66caf96586 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:44:04.920026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e97cc-2e63-4c00-82e2-acaffe721805 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:04.950269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0f9a3-f5c3-4f6f-983b-00ec39190858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:04.951309 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0f9a3-f5c3-4f6f-983b-00ec39190858 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:04.951787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0f9a3-f5c3-4f6f-983b-00ec39190858 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:04.952227 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0f9a3-f5c3-4f6f-983b-00ec39190858 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:04.953138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0f9a3-f5c3-4f6f-983b-00ec39190858 None admin] RBAC: Adding query filter params (type=network) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:04.953670 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0f9a3-f5c3-4f6f-983b-00ec39190858 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:04.955353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0f9a3-f5c3-4f6f-983b-00ec39190858 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:04.966645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 419/829] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Aug 11 10:44:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:04.967957 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0f9a3-f5c3-4f6f-983b-00ec39190858 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:05.054470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:05.069240 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e97cc-2e63-4c00-82e2-acaffe721805 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:05.091204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0f9a3-f5c3-4f6f-983b-00ec39190858 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:05.115606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103f6e0-5b90-4024-b30a-7054a1019cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:05.116246 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103f6e0-5b90-4024-b30a-7054a1019cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:05.116526 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103f6e0-5b90-4024-b30a-7054a1019cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:05.116792 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103f6e0-5b90-4024-b30a-7054a1019cc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:05.130835 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa2914-d4b5-4419-861e-33685c18dfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:05.131444 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa2914-d4b5-4419-861e-33685c18dfcd None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:05.131723 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa2914-d4b5-4419-861e-33685c18dfcd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:05.132025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa2914-d4b5-4419-861e-33685c18dfcd None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:05.132852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa2914-d4b5-4419-861e-33685c18dfcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:05.133293 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa2914-d4b5-4419-861e-33685c18dfcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:05.133960 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a103f6e0-5b90-4024-b30a-7054a1019cc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:44:05.134671 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa2914-d4b5-4419-861e-33685c18dfcd None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:05.140539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-a103f6e0-5b90-4024-b30a-7054a1019cc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:44:05.140539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:05.140539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:05.140539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:05.140539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:05.140539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:05.140539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:05.140539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:05.140539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:05.140539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:05.140539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:05.140539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:05.140539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:44:05.140539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:44:05.140539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:44:05.140539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:44:05.141728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:44:05.141728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:44:05.141728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:44:05.141728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:44:05.141728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:05.141728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:05.141728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:05.141728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:05.141728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:05.141728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:05.141728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:05.141728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:05.141728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:05.141728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:05.141728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:05.141728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:05.142730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:05.142730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:05.142730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:05.142730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:05.142730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:44:05.142730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:44:05.142730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:44:05.142730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:44:05.142730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:44:05.142730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:44:05.142730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:44:05.142730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:05.144029 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 411/830] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:44:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:05.144788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103f6e0-5b90-4024-b30a-7054a1019cc0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:05.153447 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 420/831] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:05.154631 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa2914-d4b5-4419-861e-33685c18dfcd None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:05.158887 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:05.252817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103f6e0-5b90-4024-b30a-7054a1019cc0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:05.269859 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa2914-d4b5-4419-861e-33685c18dfcd None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:05.289563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93558db7-d238-429f-8baa-5a6e86e5714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:05.290173 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93558db7-d238-429f-8baa-5a6e86e5714b None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:05.290455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93558db7-d238-429f-8baa-5a6e86e5714b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:05.290728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93558db7-d238-429f-8baa-5a6e86e5714b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:05.291629 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93558db7-d238-429f-8baa-5a6e86e5714b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:05.293009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93558db7-d238-429f-8baa-5a6e86e5714b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:05.312232 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db02c8b-eabf-4d4d-9a79-d40e28661630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:05.312919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db02c8b-eabf-4d4d-9a79-d40e28661630 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:05.313211 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db02c8b-eabf-4d4d-9a79-d40e28661630 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:05.319741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db02c8b-eabf-4d4d-9a79-d40e28661630 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:05.319741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db02c8b-eabf-4d4d-9a79-d40e28661630 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:05.319741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db02c8b-eabf-4d4d-9a79-d40e28661630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:05.319741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db02c8b-eabf-4d4d-9a79-d40e28661630 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:05.324802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 421/832] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:44:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:05.325617 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db02c8b-eabf-4d4d-9a79-d40e28661630 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:05.391582 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 412/833] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 10:44:05 2022] POST /identity/v3/endpoints => generated 337 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:44:05.392771 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93558db7-d238-429f-8baa-5a6e86e5714b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:05.399052 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:05.409262 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:05.451872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db02c8b-eabf-4d4d-9a79-d40e28661630 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:05.546334 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705b889-9889-43c7-94ec-25b1f94e32bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:05.546334 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705b889-9889-43c7-94ec-25b1f94e32bd None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:05.546334 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705b889-9889-43c7-94ec-25b1f94e32bd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:05.546723 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705b889-9889-43c7-94ec-25b1f94e32bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:05.548750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93558db7-d238-429f-8baa-5a6e86e5714b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:05.554342 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705b889-9889-43c7-94ec-25b1f94e32bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:05.556009 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705b889-9889-43c7-94ec-25b1f94e32bd None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:05.570105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-3705b889-9889-43c7-94ec-25b1f94e32bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:05.570105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:05.570105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:05.570105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:05.570105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:05.570105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:05.570105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:05.570105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:05.570105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:05.570105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:05.570105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:05.570105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:05.570105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:44:05.570105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:44:05.570105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:44:05.571027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:44:05.571027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:05.571027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:05.571027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:05.571027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:05.571027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:05.571027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:05.571027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:05.571027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:05.571027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:05.571027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:05.571027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:05.571027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:05.571027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:05.571027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:05.571027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:05.571027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:05.572819 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:44:05.572819 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:44:05.572819 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:44:05.572819 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:44:05.572819 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:44:05.572819 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:44:05.572819 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:05.572819 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:05.572819 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 422/834] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:44:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:05.578237 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705b889-9889-43c7-94ec-25b1f94e32bd None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:05.602025 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad960e35-5e61-4702-bcbc-c2a204460866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:05.603109 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad960e35-5e61-4702-bcbc-c2a204460866 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:05.604130 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad960e35-5e61-4702-bcbc-c2a204460866 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:05.604605 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad960e35-5e61-4702-bcbc-c2a204460866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:05.621002 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad960e35-5e61-4702-bcbc-c2a204460866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:05.622698 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad960e35-5e61-4702-bcbc-c2a204460866 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:05.644607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ad960e35-5e61-4702-bcbc-c2a204460866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:05.644607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:05.644607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:05.644607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:05.644607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:05.644607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:05.644607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:05.644607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:05.644607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:05.644607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:05.644607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:05.644607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:05.644607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:05.644607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:05.644607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:05.644607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:05.645541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:05.645541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:05.645541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:05.645541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:05.645541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:05.645541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:05.645541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:05.645541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:05.645541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:05.645541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:05.645541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:05.645541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:05.645541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:05.645541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:05.645541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:05.645541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:05.645541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:05.646407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:05.646407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:05.646407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:05.648915 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 413/835] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:05.656022 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad960e35-5e61-4702-bcbc-c2a204460866 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:05.700080 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705b889-9889-43c7-94ec-25b1f94e32bd None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:05.731949 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:05.738421 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:05.753428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13dbd5-c7d5-4b12-b2a1-e73ec21ba388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:05.754382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13dbd5-c7d5-4b12-b2a1-e73ec21ba388 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:05.754926 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13dbd5-c7d5-4b12-b2a1-e73ec21ba388 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:05.755427 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13dbd5-c7d5-4b12-b2a1-e73ec21ba388 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:05.756373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13dbd5-c7d5-4b12-b2a1-e73ec21ba388 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:05.756896 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13dbd5-c7d5-4b12-b2a1-e73ec21ba388 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:05.759063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13dbd5-c7d5-4b12-b2a1-e73ec21ba388 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:05.778626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 423/836] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:44:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:05.787808 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13dbd5-c7d5-4b12-b2a1-e73ec21ba388 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:05.793553 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad960e35-5e61-4702-bcbc-c2a204460866 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:05.832193 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb2cb8-ef90-4a53-9744-b1fd8c629775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:05.832804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb2cb8-ef90-4a53-9744-b1fd8c629775 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:05.833131 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb2cb8-ef90-4a53-9744-b1fd8c629775 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:05.833510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb2cb8-ef90-4a53-9744-b1fd8c629775 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:05.834155 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb2cb8-ef90-4a53-9744-b1fd8c629775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:05.834503 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb2cb8-ef90-4a53-9744-b1fd8c629775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:05.836001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb2cb8-ef90-4a53-9744-b1fd8c629775 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:05.850664 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 414/837] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:05.852232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0948d7-90a8-42d7-8183-63cb48bce65d None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:05.852522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0948d7-90a8-42d7-8183-63cb48bce65d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:05.852798 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0948d7-90a8-42d7-8183-63cb48bce65d None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:05.854396 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 415/838] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:44:05.859947 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0948d7-90a8-42d7-8183-63cb48bce65d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:05.906043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13dbd5-c7d5-4b12-b2a1-e73ec21ba388 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:05.943390 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26ac33-369b-45d5-a9fb-d0dec52ca7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:05.943993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26ac33-369b-45d5-a9fb-d0dec52ca7e6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:05.944273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26ac33-369b-45d5-a9fb-d0dec52ca7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:05.944549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26ac33-369b-45d5-a9fb-d0dec52ca7e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:05.945283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26ac33-369b-45d5-a9fb-d0dec52ca7e6 None admin] RBAC: Adding query filter params (role.id=00c6de5dd6cd4267ba05941ddb91e6ad, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=9267752ac6724013bc1edcdecff48dd7) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:05.945589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26ac33-369b-45d5-a9fb-d0dec52ca7e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:05.947059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26ac33-369b-45d5-a9fb-d0dec52ca7e6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:05.963461 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 424/839] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:44:05 2022] GET /identity/v3/role_assignments?user.id=9267752ac6724013bc1edcdecff48dd7&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=00c6de5dd6cd4267ba05941ddb91e6ad => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:05.963461 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c9e43-635b-402b-a6ec-f2d6a54d9b8a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:05.963461 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c9e43-635b-402b-a6ec-f2d6a54d9b8a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:05.963461 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c9e43-635b-402b-a6ec-f2d6a54d9b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:05.985827 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-500c9e43-635b-402b-a6ec-f2d6a54d9b8a None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:05.987502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-500c9e43-635b-402b-a6ec-f2d6a54d9b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:05.992077 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0948d7-90a8-42d7-8183-63cb48bce65d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:06.017006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:06.039958 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3eb94-2397-4eff-bfea-5b70ecd2c426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:06.042241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3eb94-2397-4eff-bfea-5b70ecd2c426 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:06.042881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3eb94-2397-4eff-bfea-5b70ecd2c426 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:06.043233 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3eb94-2397-4eff-bfea-5b70ecd2c426 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:06.052173 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3eb94-2397-4eff-bfea-5b70ecd2c426 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:06.053431 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:06.054069 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3eb94-2397-4eff-bfea-5b70ecd2c426 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:06.069366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e8e3eb94-2397-4eff-bfea-5b70ecd2c426 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 11 10:44:06.069366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:06.069366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:06.069366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:06.069366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:06.069366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:06.069366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:06.069366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:06.069366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:06.069366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:06.069366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:06.069366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:06.069366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:44:06.069366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:44:06.069366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:44:06.069366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:44:06.070346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:06.070346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:06.070346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:44:06.070346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:06.070346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:44:06.070346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:06.070346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:06.070346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:06.070346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:06.070346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:06.070346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:06.070346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:06.070346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:06.070346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:06.070346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:06.070346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:06.070346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:06.070346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:06.071350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:06.071350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:06.071350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:44:06.071350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:44:06.071350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:44:06.071350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:44:06.071350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:44:06.071350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:44:06.071350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 11 10:44:06.071350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:06.071350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 416/840] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:44:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:06.078322 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3eb94-2397-4eff-bfea-5b70ecd2c426 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:06.086875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 425/841] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:06.114355 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c9e43-635b-402b-a6ec-f2d6a54d9b8a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:06.219765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3eb94-2397-4eff-bfea-5b70ecd2c426 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:06.247991 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c9e43-635b-402b-a6ec-f2d6a54d9b8a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:06.255884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f9c94-1989-48e8-9fdf-b01affb5e562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:06.257220 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f9c94-1989-48e8-9fdf-b01affb5e562 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:06.257716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f9c94-1989-48e8-9fdf-b01affb5e562 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:06.258193 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f9c94-1989-48e8-9fdf-b01affb5e562 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:06.259251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f9c94-1989-48e8-9fdf-b01affb5e562 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:06.260339 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f9c94-1989-48e8-9fdf-b01affb5e562 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:06.262177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f9c94-1989-48e8-9fdf-b01affb5e562 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:06.281341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 417/842] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Aug 11 10:44:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:06.286345 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af54c0f-6468-405b-8a04-3320b14bf079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:06.287022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af54c0f-6468-405b-8a04-3320b14bf079 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:06.287358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af54c0f-6468-405b-8a04-3320b14bf079 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:06.287637 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af54c0f-6468-405b-8a04-3320b14bf079 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:06.288061 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f9c94-1989-48e8-9fdf-b01affb5e562 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:06.288251 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af54c0f-6468-405b-8a04-3320b14bf079 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:06.289633 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af54c0f-6468-405b-8a04-3320b14bf079 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:06.299722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-3af54c0f-6468-405b-8a04-3320b14bf079 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 10:44:06.299722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:06.299722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:44:06.299722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:44:06.299722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:44:06.299722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:44:06.299722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:44:06.299722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:06.299722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 10:44:06.299722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:06.299722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:06.299722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:06.299722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:06.299722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:06.299722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:06.299722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:06.299722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:06.300706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:06.300706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:06.300706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:06.300706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:06.300706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:06.300706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:06.300706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:44:06.300706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:44:06.300706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:44:06.300706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:44:06.300706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:06.300706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:06.300706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:06.300706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:06.300706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:06.300706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:06.301540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:06.301540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:06.301540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:06.301540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:06.301540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:06.301540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:06.301540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:06.301540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:06.301540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:06.301540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:06.301540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:44:06.301540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:06.301540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 10:44:06.301540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:06.301540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 426/843] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:44:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:06.307421 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af54c0f-6468-405b-8a04-3320b14bf079 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:06.336288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:06.352150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:06.400748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f9c94-1989-48e8-9fdf-b01affb5e562 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:06.419290 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af54c0f-6468-405b-8a04-3320b14bf079 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:06.437966 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114eec66-1843-4f43-9f90-c8808664d16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:06.439002 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114eec66-1843-4f43-9f90-c8808664d16c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:06.439596 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114eec66-1843-4f43-9f90-c8808664d16c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:06.440088 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114eec66-1843-4f43-9f90-c8808664d16c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:06.455137 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1512a9-d63f-4d79-b2f8-b53a73e7e37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:06.455751 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1512a9-d63f-4d79-b2f8-b53a73e7e37a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:06.456034 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1512a9-d63f-4d79-b2f8-b53a73e7e37a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:06.456312 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1512a9-d63f-4d79-b2f8-b53a73e7e37a None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:06.456951 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1512a9-d63f-4d79-b2f8-b53a73e7e37a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:06.457254 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1512a9-d63f-4d79-b2f8-b53a73e7e37a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:06.458635 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1512a9-d63f-4d79-b2f8-b53a73e7e37a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:06.468711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 427/844] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:44:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:06.469596 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1512a9-d63f-4d79-b2f8-b53a73e7e37a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:06.517079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114eec66-1843-4f43-9f90-c8808664d16c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:06.519064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114eec66-1843-4f43-9f90-c8808664d16c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:06.560926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:06.577659 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1512a9-d63f-4d79-b2f8-b53a73e7e37a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:06.603180 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:06.616834 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50241305-9f7c-4bc6-8d53-97084754f600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:06.617754 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50241305-9f7c-4bc6-8d53-97084754f600 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:06.618182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50241305-9f7c-4bc6-8d53-97084754f600 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:06.618625 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50241305-9f7c-4bc6-8d53-97084754f600 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:06.620073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50241305-9f7c-4bc6-8d53-97084754f600 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:06.620888 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50241305-9f7c-4bc6-8d53-97084754f600 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:06.622636 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50241305-9f7c-4bc6-8d53-97084754f600 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:06.632982 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 418/846] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:44:06 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 11 10:44:06.632982 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114eec66-1843-4f43-9f90-c8808664d16c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:06.633487 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 428/846] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:44:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:06.745761 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114eec66-1843-4f43-9f90-c8808664d16c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:06.784254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8e5b4-4774-422f-b8e1-eddf6c225fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:06.784816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8e5b4-4774-422f-b8e1-eddf6c225fed None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:06.785098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8e5b4-4774-422f-b8e1-eddf6c225fed None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:06.785375 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8e5b4-4774-422f-b8e1-eddf6c225fed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:06.795407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:06.798919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8e5b4-4774-422f-b8e1-eddf6c225fed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:06.800662 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8e5b4-4774-422f-b8e1-eddf6c225fed None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:06.815855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-64f8e5b4-4774-422f-b8e1-eddf6c225fed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:06.815855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:06.815855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:06.815855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:06.815855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:06.815855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:06.815855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:06.815855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:06.815855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:06.815855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:06.815855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:06.815855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:06.815855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:06.815855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:06.815855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:06.815855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:06.816834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:06.816834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:06.816834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:06.816834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:06.816834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:06.816834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:06.816834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:06.816834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:06.816834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:06.816834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:06.816834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:06.816834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:06.816834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:06.816834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:06.816834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:06.816834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:06.816834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:06.817723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:06.817723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:06.817723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:06.817723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 419/847] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:06.823351 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50241305-9f7c-4bc6-8d53-97084754f600 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:06.932039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50241305-9f7c-4bc6-8d53-97084754f600 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:06.970820 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd645772-994c-4d08-bba1-abcde1899a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:06.971841 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd645772-994c-4d08-bba1-abcde1899a79 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:06.972338 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd645772-994c-4d08-bba1-abcde1899a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:06.972813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd645772-994c-4d08-bba1-abcde1899a79 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:06.973677 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd645772-994c-4d08-bba1-abcde1899a79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:06.974201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd645772-994c-4d08-bba1-abcde1899a79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:06.975796 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd645772-994c-4d08-bba1-abcde1899a79 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:06.989988 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 429/848] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:06.995857 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8e5b4-4774-422f-b8e1-eddf6c225fed None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:07.109087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5c535-2279-4970-8e54-d108a23c028b None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:07.109440 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5c535-2279-4970-8e54-d108a23c028b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:07.109641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5c535-2279-4970-8e54-d108a23c028b None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:07.114788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 430/849] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:44:07.116923 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f510882-5ea9-4f83-8bf5-21951fd2cd8b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:07.117434 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f510882-5ea9-4f83-8bf5-21951fd2cd8b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:07.117909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f510882-5ea9-4f83-8bf5-21951fd2cd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:07.118118 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8e5b4-4774-422f-b8e1-eddf6c225fed None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:07.141315 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-8f510882-5ea9-4f83-8bf5-21951fd2cd8b None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:07.142695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8f510882-5ea9-4f83-8bf5-21951fd2cd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:07.162103 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e282a20-5a4f-4305-8997-2627ebf73633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:07.163154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e282a20-5a4f-4305-8997-2627ebf73633 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:07.163639 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e282a20-5a4f-4305-8997-2627ebf73633 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:07.164108 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e282a20-5a4f-4305-8997-2627ebf73633 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:07.171906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e282a20-5a4f-4305-8997-2627ebf73633 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:07.173643 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e282a20-5a4f-4305-8997-2627ebf73633 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:07.174730 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:07.186465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-6e282a20-5a4f-4305-8997-2627ebf73633 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:07.186465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:07.186465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:07.186465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:07.186465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:07.186465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:07.186465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:07.186465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:07.186465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:07.186465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:07.186465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:07.186465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:07.186465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:44:07.186465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:44:07.186465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:44:07.192393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:44:07.192393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:07.192393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:07.192393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:07.192393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:07.192393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:07.192393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:07.192393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:07.192393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:07.192393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:07.192393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:07.192393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:07.192393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:07.192393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:07.192393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:07.192393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:07.192393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:07.193248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:44:07.193248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:44:07.193248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:44:07.193248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:44:07.193248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:44:07.193248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:44:07.193248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:07.193248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:07.193248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 420/850] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:44:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:07.195589 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e282a20-5a4f-4305-8997-2627ebf73633 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:07.223886 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 431/851] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 10:44:07.247911 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f510882-5ea9-4f83-8bf5-21951fd2cd8b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:07.262997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:07.326708 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e282a20-5a4f-4305-8997-2627ebf73633 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:07.353323 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f510882-5ea9-4f83-8bf5-21951fd2cd8b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:07.365372 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81573b00-d029-4f83-ba81-0eb63f4c9303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:07.366171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81573b00-d029-4f83-ba81-0eb63f4c9303 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:07.366601 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81573b00-d029-4f83-ba81-0eb63f4c9303 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:07.367005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81573b00-d029-4f83-ba81-0eb63f4c9303 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:07.367840 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81573b00-d029-4f83-ba81-0eb63f4c9303 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:07.368224 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81573b00-d029-4f83-ba81-0eb63f4c9303 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:07.370710 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81573b00-d029-4f83-ba81-0eb63f4c9303 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:07.384326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 421/852] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:44:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:07.391273 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81573b00-d029-4f83-ba81-0eb63f4c9303 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:07.397824 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb90d9a-db54-41dd-80ea-d97abcc2dfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:07.398465 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb90d9a-db54-41dd-80ea-d97abcc2dfe8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:07.398750 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb90d9a-db54-41dd-80ea-d97abcc2dfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:07.399140 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb90d9a-db54-41dd-80ea-d97abcc2dfe8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:07.413506 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb90d9a-db54-41dd-80ea-d97abcc2dfe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:44:07.419087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-3bb90d9a-db54-41dd-80ea-d97abcc2dfe8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:44:07.419087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:07.419087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:07.419087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:07.419087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:07.419087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:07.419087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:07.419087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:07.419087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:07.419087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:07.419087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:07.419087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:07.419087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:44:07.419087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:44:07.419087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:44:07.419087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:44:07.420035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:44:07.420035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:44:07.420035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:44:07.420035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:44:07.420035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:07.420035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:07.420035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:07.420035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:07.420035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:07.420035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:07.420035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:07.420035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:07.420035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:07.420035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:07.420035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:07.420035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:07.420852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:07.420852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:07.420852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:07.420852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:07.420852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:44:07.420852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:44:07.420852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:44:07.420852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:44:07.420852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:44:07.420852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:44:07.420852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:44:07.420852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:07.424339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 432/853] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:44:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:07.429689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb90d9a-db54-41dd-80ea-d97abcc2dfe8 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:07.454840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:07.541407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81573b00-d029-4f83-ba81-0eb63f4c9303 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:07.548818 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb90d9a-db54-41dd-80ea-d97abcc2dfe8 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:07.558052 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:07.585793 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d3d10-41dd-46b5-bad1-14b89ed1f2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:07.586337 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d3d10-41dd-46b5-bad1-14b89ed1f2b9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:07.586705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d3d10-41dd-46b5-bad1-14b89ed1f2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:07.587023 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d3d10-41dd-46b5-bad1-14b89ed1f2b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:07.588253 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d3d10-41dd-46b5-bad1-14b89ed1f2b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:07.588532 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d3d10-41dd-46b5-bad1-14b89ed1f2b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:07.589926 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d3d10-41dd-46b5-bad1-14b89ed1f2b9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:07.592882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a44b11-00f3-4060-b85e-0d7d27c46b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:07.593746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a44b11-00f3-4060-b85e-0d7d27c46b64 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:07.594222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a44b11-00f3-4060-b85e-0d7d27c46b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:07.594771 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a44b11-00f3-4060-b85e-0d7d27c46b64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:07.596219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a44b11-00f3-4060-b85e-0d7d27c46b64 None admin] RBAC: Adding query filter params (role.id=00c6de5dd6cd4267ba05941ddb91e6ad, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=cbd25d1bde0c4703b61e0edaf5b658d4) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:07.596991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a44b11-00f3-4060-b85e-0d7d27c46b64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:07.598600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a44b11-00f3-4060-b85e-0d7d27c46b64 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:07.603077 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 433/854] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Aug 11 10:44:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:07.604683 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d3d10-41dd-46b5-bad1-14b89ed1f2b9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:07.609317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 422/855] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:44:07 2022] GET /identity/v3/role_assignments?user.id=cbd25d1bde0c4703b61e0edaf5b658d4&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=00c6de5dd6cd4267ba05941ddb91e6ad => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:07.696696 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:07.723859 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d3d10-41dd-46b5-bad1-14b89ed1f2b9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:07.764462 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de0d2c-7d7e-4e87-923d-a4080543a554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:07.765522 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de0d2c-7d7e-4e87-923d-a4080543a554 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:07.766022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de0d2c-7d7e-4e87-923d-a4080543a554 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:07.766491 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de0d2c-7d7e-4e87-923d-a4080543a554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:07.780384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de0d2c-7d7e-4e87-923d-a4080543a554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:07.782197 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de0d2c-7d7e-4e87-923d-a4080543a554 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:07.798047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-66de0d2c-7d7e-4e87-923d-a4080543a554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:07.798047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:07.798047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:07.798047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:07.798047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:07.798047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:07.798047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:07.798047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:07.798047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:07.798047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:07.798047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:07.798047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:07.798047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:07.798047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:07.798047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:07.798047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:07.802662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:07.802662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:07.802662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:07.802662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:07.802662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:07.802662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:07.802662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:07.802662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:07.802662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:07.802662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:07.802662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:07.802662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:07.802662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:07.802662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:07.802662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:07.802662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:07.802662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:07.803574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:07.803574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:07.803574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:07.803574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 434/856] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:07.807032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a44b11-00f3-4060-b85e-0d7d27c46b64 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:07.921964 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a44b11-00f3-4060-b85e-0d7d27c46b64 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:07.957103 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d0f1d-fe7b-46f7-9aa0-185463ba9c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:07.957718 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d0f1d-fe7b-46f7-9aa0-185463ba9c5b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:07.957998 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d0f1d-fe7b-46f7-9aa0-185463ba9c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:07.958272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d0f1d-fe7b-46f7-9aa0-185463ba9c5b None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:07.958936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d0f1d-fe7b-46f7-9aa0-185463ba9c5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:07.959241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d0f1d-fe7b-46f7-9aa0-185463ba9c5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:07.960667 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d0f1d-fe7b-46f7-9aa0-185463ba9c5b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:07.973187 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 423/857] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:07.979030 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de0d2c-7d7e-4e87-923d-a4080543a554 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:08.097427 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de0d2c-7d7e-4e87-923d-a4080543a554 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:08.129277 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:08.131474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b9572-8d6b-4c68-90e8-9aff3eabda1a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:08.132250 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b9572-8d6b-4c68-90e8-9aff3eabda1a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:08.132720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b9572-8d6b-4c68-90e8-9aff3eabda1a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:08.134284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd36fb5-b5f6-4dc0-b5dd-d053f1ca863b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:08.138324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd36fb5-b5f6-4dc0-b5dd-d053f1ca863b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:08.138324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd36fb5-b5f6-4dc0-b5dd-d053f1ca863b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:08.138324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd36fb5-b5f6-4dc0-b5dd-d053f1ca863b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:08.138741 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 424/858] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:08.140654 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd338a-542c-42cc-b07b-b9da71ae491d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:08.141138 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd338a-542c-42cc-b07b-b9da71ae491d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:08.141586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd338a-542c-42cc-b07b-b9da71ae491d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:08.144346 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd36fb5-b5f6-4dc0-b5dd-d053f1ca863b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:08.145796 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd36fb5-b5f6-4dc0-b5dd-d053f1ca863b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:08.160387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-3fd36fb5-b5f6-4dc0-b5dd-d053f1ca863b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 10:44:08.160387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:08.160387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:08.160387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:08.160387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:08.160387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:08.160387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:08.160387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:08.160387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:08.160387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:08.160387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:08.160387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:08.160387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:44:08.160387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:44:08.160387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:44:08.160387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:44:08.161692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:08.161692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:08.161692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:44:08.161692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:08.161692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:44:08.161692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:08.161692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:08.161692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:08.161692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:08.161692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:08.161692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:08.161692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:08.161692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:08.161692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:08.161692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:08.161692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:08.161692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:08.161692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:08.163070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:08.163070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:08.163070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:44:08.163070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:44:08.163070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:44:08.163070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:44:08.163070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:44:08.163070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:44:08.163070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 10:44:08.163070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:08.163070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 435/859] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Aug 11 10:44:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:08.164346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-25bd338a-542c-42cc-b07b-b9da71ae491d None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:08.165742 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-25bd338a-542c-42cc-b07b-b9da71ae491d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:08.167836 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd36fb5-b5f6-4dc0-b5dd-d053f1ca863b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:08.198560 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:08.246797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 425/860] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 10:44:08.268484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd338a-542c-42cc-b07b-b9da71ae491d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:08.311024 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd36fb5-b5f6-4dc0-b5dd-d053f1ca863b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:08.348210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6dbd08-cc75-48d5-ae31-834e0c8d4eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:08.349398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dbd08-cc75-48d5-ae31-834e0c8d4eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:08.350092 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dbd08-cc75-48d5-ae31-834e0c8d4eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:08.350541 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dbd08-cc75-48d5-ae31-834e0c8d4eb8 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:08.352126 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6dbd08-cc75-48d5-ae31-834e0c8d4eb8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:08.352609 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6dbd08-cc75-48d5-ae31-834e0c8d4eb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:08.354477 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6dbd08-cc75-48d5-ae31-834e0c8d4eb8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:08.377167 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 436/861] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Aug 11 10:44:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:08.382785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6dbd08-cc75-48d5-ae31-834e0c8d4eb8 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:08.402056 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd338a-542c-42cc-b07b-b9da71ae491d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:08.439229 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bfdaa-19cb-49e3-836e-bc3781b3d732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:08.439862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bfdaa-19cb-49e3-836e-bc3781b3d732 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:08.440138 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bfdaa-19cb-49e3-836e-bc3781b3d732 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:08.440409 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bfdaa-19cb-49e3-836e-bc3781b3d732 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:08.440989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bfdaa-19cb-49e3-836e-bc3781b3d732 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:08.442443 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bfdaa-19cb-49e3-836e-bc3781b3d732 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:08.443376 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:08.453326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-286bfdaa-19cb-49e3-836e-bc3781b3d732 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 10:44:08.453326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:08.453326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:44:08.453326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:44:08.453326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:44:08.453326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:44:08.453326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:44:08.453326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:08.453326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 10:44:08.453326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:08.453326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:08.453326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:08.453326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:08.453326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:08.453326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:08.453326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:08.454291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:08.454291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:08.454291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:08.454291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:08.454291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:08.454291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:08.454291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:08.454291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:44:08.454291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:44:08.454291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:44:08.454291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:44:08.454291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:08.454291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:08.454291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:08.454291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:08.454291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:08.454291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:08.455170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:08.455170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:08.455170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:08.455170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:08.455170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:08.455170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:08.455170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:08.455170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:08.455170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:08.455170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:08.455170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:44:08.455170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:08.455170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 10:44:08.455170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:08.462625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 426/862] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Aug 11 10:44:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:08.464285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bfdaa-19cb-49e3-836e-bc3781b3d732 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:08.497335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:08.502863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6dbd08-cc75-48d5-ae31-834e0c8d4eb8 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:08.541862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f6cdf-873f-4789-9113-6bc4c318524f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:08.542836 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f6cdf-873f-4789-9113-6bc4c318524f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:08.543195 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f6cdf-873f-4789-9113-6bc4c318524f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:08.544159 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f6cdf-873f-4789-9113-6bc4c318524f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:08.575537 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bfdaa-19cb-49e3-836e-bc3781b3d732 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:08.613972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b77550-7d50-4ecb-a79e-5338686b0e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:08.614991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b77550-7d50-4ecb-a79e-5338686b0e4d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:08.615542 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b77550-7d50-4ecb-a79e-5338686b0e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:08.616020 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b77550-7d50-4ecb-a79e-5338686b0e4d None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:08.616883 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b77550-7d50-4ecb-a79e-5338686b0e4d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:08.617385 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b77550-7d50-4ecb-a79e-5338686b0e4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:08.618611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f6cdf-873f-4789-9113-6bc4c318524f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:08.619431 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b77550-7d50-4ecb-a79e-5338686b0e4d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:08.620832 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f6cdf-873f-4789-9113-6bc4c318524f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:08.629349 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 427/863] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Aug 11 10:44:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:08.630899 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b77550-7d50-4ecb-a79e-5338686b0e4d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:08.674849 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:08.730958 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 437/864] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:44:08 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 11 10:44:08.733145 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:08.734337 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfad0e-f5ba-441d-8506-6d0d526d2686 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:08.734621 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfad0e-f5ba-441d-8506-6d0d526d2686 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:08.734896 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfad0e-f5ba-441d-8506-6d0d526d2686 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:08.738901 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 438/865] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:08.739724 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfad0e-f5ba-441d-8506-6d0d526d2686 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:08.743603 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b77550-7d50-4ecb-a79e-5338686b0e4d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:08.779983 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1dbf2-17ff-42e4-ab34-a5b3939a6dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:08.780892 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1dbf2-17ff-42e4-ab34-a5b3939a6dbf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:08.781180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1dbf2-17ff-42e4-ab34-a5b3939a6dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:08.781457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1dbf2-17ff-42e4-ab34-a5b3939a6dbf None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:08.782233 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1dbf2-17ff-42e4-ab34-a5b3939a6dbf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:08.782549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1dbf2-17ff-42e4-ab34-a5b3939a6dbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:08.783962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1dbf2-17ff-42e4-ab34-a5b3939a6dbf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:08.794863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 428/866] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Aug 11 10:44:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:08.794863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354eab3-5620-4d77-a708-c9ab84afe429 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:08.794863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354eab3-5620-4d77-a708-c9ab84afe429 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:08.794863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354eab3-5620-4d77-a708-c9ab84afe429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:08.810097 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d354eab3-5620-4d77-a708-c9ab84afe429 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:08.811343 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d354eab3-5620-4d77-a708-c9ab84afe429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:08.883724 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfad0e-f5ba-441d-8506-6d0d526d2686 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:08.901205 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 429/867] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:08.923235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354eab3-5620-4d77-a708-c9ab84afe429 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:08.926929 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f9008-663d-49bb-89e7-24885c3bd7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:08.927783 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f9008-663d-49bb-89e7-24885c3bd7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:08.928261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f9008-663d-49bb-89e7-24885c3bd7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:08.928700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f9008-663d-49bb-89e7-24885c3bd7e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:08.942738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f9008-663d-49bb-89e7-24885c3bd7e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:08.944738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f9008-663d-49bb-89e7-24885c3bd7e4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:08.961909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-a35f9008-663d-49bb-89e7-24885c3bd7e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:08.961909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:08.961909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:08.961909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:08.961909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:08.961909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:08.961909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:08.961909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:08.961909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:08.961909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:08.961909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:08.961909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:08.961909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:08.961909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:08.961909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:08.961909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:08.963503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:08.963503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:08.963503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:08.963503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:08.963503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:08.963503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:08.963503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:08.963503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:08.963503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:08.963503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:08.963503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:08.963503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:08.963503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:08.963503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:08.963503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:08.963503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:08.963503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:08.964526 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:08.964526 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:08.964526 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:08.966776 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 439/868] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:08.971981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f9008-663d-49bb-89e7-24885c3bd7e4 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:08.976138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:09.039692 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:09.055905 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354eab3-5620-4d77-a708-c9ab84afe429 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:09.097970 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f9008-663d-49bb-89e7-24885c3bd7e4 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:09.102811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21136106-2b46-4a19-bb97-d26ee96b00ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:09.103735 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21136106-2b46-4a19-bb97-d26ee96b00ee None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:09.104198 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21136106-2b46-4a19-bb97-d26ee96b00ee None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:09.104614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21136106-2b46-4a19-bb97-d26ee96b00ee None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:09.105834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21136106-2b46-4a19-bb97-d26ee96b00ee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:09.107383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21136106-2b46-4a19-bb97-d26ee96b00ee None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:09.134069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013165b5-9d59-447f-9044-7ca5bab7b495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:09.140611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013165b5-9d59-447f-9044-7ca5bab7b495 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:09.140611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013165b5-9d59-447f-9044-7ca5bab7b495 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:09.140611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013165b5-9d59-447f-9044-7ca5bab7b495 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:09.140611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013165b5-9d59-447f-9044-7ca5bab7b495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:09.140611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013165b5-9d59-447f-9044-7ca5bab7b495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:09.140611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013165b5-9d59-447f-9044-7ca5bab7b495 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:09.153538 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 440/869] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:09.158825 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013165b5-9d59-447f-9044-7ca5bab7b495 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:09.205148 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 430/870] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Aug 11 10:44:08 2022] POST /identity/v3/services => generated 251 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:44:09.239700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:09.289232 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013165b5-9d59-447f-9044-7ca5bab7b495 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:09.338666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfa9f0-7bb3-4d3e-8c12-66bb9384cfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:09.339800 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfa9f0-7bb3-4d3e-8c12-66bb9384cfc5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:09.340290 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfa9f0-7bb3-4d3e-8c12-66bb9384cfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:09.340788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfa9f0-7bb3-4d3e-8c12-66bb9384cfc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:09.349448 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfa9f0-7bb3-4d3e-8c12-66bb9384cfc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:09.351334 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfa9f0-7bb3-4d3e-8c12-66bb9384cfc5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:09.364612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-80dfa9f0-7bb3-4d3e-8c12-66bb9384cfc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:09.364612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:09.364612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:09.364612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:09.364612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:09.364612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:09.364612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:09.364612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:09.364612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:09.364612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:09.364612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:09.364612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:09.364612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:44:09.364612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:44:09.364612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:44:09.365517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:44:09.365517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:09.365517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:09.365517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:09.365517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:09.365517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:09.365517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:09.365517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:09.365517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:09.365517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:09.365517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:09.365517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:09.365517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:09.365517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:09.365517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:09.365517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:09.365517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:09.366428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:44:09.366428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:44:09.366428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:44:09.366428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:44:09.366428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:44:09.366428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:44:09.366428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:09.366428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:09.369049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 441/871] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:44:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:09.374622 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21136106-2b46-4a19-bb97-d26ee96b00ee None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:09.486517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21136106-2b46-4a19-bb97-d26ee96b00ee None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:09.523730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f9dfa-8bb7-493a-b098-500c17360014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:09.524736 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f9dfa-8bb7-493a-b098-500c17360014 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:09.525783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f9dfa-8bb7-493a-b098-500c17360014 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:09.526262 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f9dfa-8bb7-493a-b098-500c17360014 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:09.527198 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f9dfa-8bb7-493a-b098-500c17360014 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:09.527713 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f9dfa-8bb7-493a-b098-500c17360014 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:09.529380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f9dfa-8bb7-493a-b098-500c17360014 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:09.543401 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 431/872] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:44:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:09.549461 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfa9f0-7bb3-4d3e-8c12-66bb9384cfc5 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:09.653467 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfa9f0-7bb3-4d3e-8c12-66bb9384cfc5 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:09.670943 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:09.688843 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c3033-c26d-4c18-b36e-49e63f4c7ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:09.689737 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c3033-c26d-4c18-b36e-49e63f4c7ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:09.690242 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c3033-c26d-4c18-b36e-49e63f4c7ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:09.690686 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c3033-c26d-4c18-b36e-49e63f4c7ef2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:09.691613 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c3033-c26d-4c18-b36e-49e63f4c7ef2 None admin] RBAC: Adding query filter params (role.id=6de833fef4c9456cb5d8ad66caf96586, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=9751264123914c27b961009f75067660) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:09.692201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c3033-c26d-4c18-b36e-49e63f4c7ef2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:09.694046 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c3033-c26d-4c18-b36e-49e63f4c7ef2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:09.700542 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 442/873] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:44:09 2022] GET /identity/v3/role_assignments?user.id=9751264123914c27b961009f75067660&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=6de833fef4c9456cb5d8ad66caf96586 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:09.841889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f95897-686a-4e8f-9ae9-e12599eb5626 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:09.842179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f95897-686a-4e8f-9ae9-e12599eb5626 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:09.842462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f95897-686a-4e8f-9ae9-e12599eb5626 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:09.844132 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 432/874] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:09.850977 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd459ac-2eef-4766-a799-b204c74054e0 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:09.851270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd459ac-2eef-4766-a799-b204c74054e0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:09.851550 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd459ac-2eef-4766-a799-b204c74054e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:09.871323 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-7bd459ac-2eef-4766-a799-b204c74054e0 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:09.872528 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7bd459ac-2eef-4766-a799-b204c74054e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:09.946170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 443/875] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:09 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:09.969712 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f95897-686a-4e8f-9ae9-e12599eb5626 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:09.980162 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:10.085671 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f95897-686a-4e8f-9ae9-e12599eb5626 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:10.122750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5df35-0d5a-48d5-b870-7cb14d9bfe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:10.123339 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5df35-0d5a-48d5-b870-7cb14d9bfe02 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:10.123622 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5df35-0d5a-48d5-b870-7cb14d9bfe02 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:10.123902 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5df35-0d5a-48d5-b870-7cb14d9bfe02 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:10.124485 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5df35-0d5a-48d5-b870-7cb14d9bfe02 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:10.125852 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5df35-0d5a-48d5-b870-7cb14d9bfe02 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:10.134785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c1f5df35-0d5a-48d5-b870-7cb14d9bfe02 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 10:44:10.134785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:10.134785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:44:10.134785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:44:10.134785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:44:10.134785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:44:10.134785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:44:10.134785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:10.134785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 10:44:10.134785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:10.134785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:10.134785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:10.134785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:10.134785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:10.134785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:10.134785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:10.134785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:10.135984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:10.135984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:10.135984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:10.135984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:10.135984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:10.135984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:10.135984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:44:10.135984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:44:10.135984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:44:10.135984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:44:10.135984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:10.135984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:10.135984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:10.135984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:10.135984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:10.135984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:10.136788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:10.136788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:10.136788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:10.136788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:10.136788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:10.136788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:10.136788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:10.136788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:10.136788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:10.136788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:10.136788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:44:10.136788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:10.136788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 10:44:10.136788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:10.136788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 433/876] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Aug 11 10:44:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:10.142427 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd459ac-2eef-4766-a799-b204c74054e0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:10.244999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd459ac-2eef-4766-a799-b204c74054e0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:10.259777 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:10.282796 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dcea26-b174-4d06-badc-53c85f73cc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:10.283411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcea26-b174-4d06-badc-53c85f73cc8d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:10.283691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcea26-b174-4d06-badc-53c85f73cc8d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:10.283966 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcea26-b174-4d06-badc-53c85f73cc8d None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:10.284605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dcea26-b174-4d06-badc-53c85f73cc8d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:10.284965 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dcea26-b174-4d06-badc-53c85f73cc8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:10.286327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dcea26-b174-4d06-badc-53c85f73cc8d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:10.292088 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 444/877] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Aug 11 10:44:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:10.297873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5df35-0d5a-48d5-b870-7cb14d9bfe02 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:10.375688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:10.409104 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5df35-0d5a-48d5-b870-7cb14d9bfe02 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:10.445791 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54dcf9-775b-4f35-9410-01e1b32f3d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:10.446414 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54dcf9-775b-4f35-9410-01e1b32f3d78 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:10.446698 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54dcf9-775b-4f35-9410-01e1b32f3d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:10.447071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54dcf9-775b-4f35-9410-01e1b32f3d78 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:10.448100 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54dcf9-775b-4f35-9410-01e1b32f3d78 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:10.448426 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54dcf9-775b-4f35-9410-01e1b32f3d78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:10.449827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54dcf9-775b-4f35-9410-01e1b32f3d78 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:10.455602 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 434/878] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Aug 11 10:44:10 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:10.893364 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c7a29-4cf0-409f-acf6-8498594a0185 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:10.893745 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c7a29-4cf0-409f-acf6-8498594a0185 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:10.893937 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c7a29-4cf0-409f-acf6-8498594a0185 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:10.895516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 445/879] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:10.900784 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b1ace-80a2-4e56-8549-25ae8a5e0e51 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:10.901072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b1ace-80a2-4e56-8549-25ae8a5e0e51 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:10.901354 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b1ace-80a2-4e56-8549-25ae8a5e0e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:10.919731 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ee6b1ace-80a2-4e56-8549-25ae8a5e0e51 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:10.920914 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ee6b1ace-80a2-4e56-8549-25ae8a5e0e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:10.996974 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 435/880] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:10 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:11.019129 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c7a29-4cf0-409f-acf6-8498594a0185 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:11.154293 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c7a29-4cf0-409f-acf6-8498594a0185 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:11.197951 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef081b5-3db2-4eba-a1fd-92547304b4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:11.198625 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef081b5-3db2-4eba-a1fd-92547304b4a3 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:11.198941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef081b5-3db2-4eba-a1fd-92547304b4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:11.199224 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef081b5-3db2-4eba-a1fd-92547304b4a3 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:11.199883 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef081b5-3db2-4eba-a1fd-92547304b4a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:11.201243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef081b5-3db2-4eba-a1fd-92547304b4a3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:11.293165 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 446/881] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Aug 11 10:44:11 2022] POST /identity/v3/services => generated 269 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:44:11.408787 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5b74e-c3b9-4d26-83c5-15511a009875 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:11.409308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5b74e-c3b9-4d26-83c5-15511a009875 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:11.409514 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5b74e-c3b9-4d26-83c5-15511a009875 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:11.411391 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 436/882] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:11.417830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb722d6-5043-4b85-9060-11bb48ae0f81 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:11.418124 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb722d6-5043-4b85-9060-11bb48ae0f81 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:11.418388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb722d6-5043-4b85-9060-11bb48ae0f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:11.438727 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ebb722d6-5043-4b85-9060-11bb48ae0f81 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:11.439788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ebb722d6-5043-4b85-9060-11bb48ae0f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:11.473924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:11.523537 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 447/883] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:11.548423 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5b74e-c3b9-4d26-83c5-15511a009875 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:11.613527 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:11.655353 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5b74e-c3b9-4d26-83c5-15511a009875 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:11.696062 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7b66a-2d7f-4e5f-9c9e-4abc88ed20c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:11.696618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7b66a-2d7f-4e5f-9c9e-4abc88ed20c1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:11.697449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7b66a-2d7f-4e5f-9c9e-4abc88ed20c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:11.697777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7b66a-2d7f-4e5f-9c9e-4abc88ed20c1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:11.698815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7b66a-2d7f-4e5f-9c9e-4abc88ed20c1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:11.701308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7b66a-2d7f-4e5f-9c9e-4abc88ed20c1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:11.710873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-73f7b66a-2d7f-4e5f-9c9e-4abc88ed20c1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 10:44:11.710873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:11.710873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:44:11.710873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:44:11.710873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:44:11.710873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:44:11.710873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:44:11.710873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:11.710873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 10:44:11.710873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:11.710873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:11.710873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:11.710873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:11.710873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:11.710873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:11.710873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:11.710873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:11.711863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:11.711863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:11.711863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:11.711863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:11.711863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:11.711863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:11.711863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:44:11.711863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:44:11.711863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:44:11.711863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:44:11.711863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:11.711863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:11.711863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:11.711863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:11.711863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:11.711863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:11.713032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:11.713032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:11.713032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:11.713032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:11.713032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:11.713032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:11.713032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:11.713032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:11.713032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:11.713032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:11.713032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:44:11.713032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:11.713032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 10:44:11.713032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:11.713032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 437/884] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:44:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:11.718338 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb722d6-5043-4b85-9060-11bb48ae0f81 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:11.828180 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb722d6-5043-4b85-9060-11bb48ae0f81 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:11.863476 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307dba8-7714-4250-b274-4ce392a71c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:11.864082 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307dba8-7714-4250-b274-4ce392a71c86 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:11.864359 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307dba8-7714-4250-b274-4ce392a71c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:11.864629 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307dba8-7714-4250-b274-4ce392a71c86 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:11.865260 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307dba8-7714-4250-b274-4ce392a71c86 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:11.865557 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307dba8-7714-4250-b274-4ce392a71c86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:11.866968 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307dba8-7714-4250-b274-4ce392a71c86 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:11.870861 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d060f-dbba-4d56-8ace-4eaa92050d8d None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:11.871148 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d060f-dbba-4d56-8ace-4eaa92050d8d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:11.871421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d060f-dbba-4d56-8ace-4eaa92050d8d None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:11.872899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 448/886] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:44:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:11.873069 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 438/886] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:11.878372 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d060f-dbba-4d56-8ace-4eaa92050d8d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:11.878997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f4bab-1795-4be4-a552-c17b38ecbe29 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:11.879294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f4bab-1795-4be4-a552-c17b38ecbe29 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:11.879574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f4bab-1795-4be4-a552-c17b38ecbe29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:11.897754 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-840f4bab-1795-4be4-a552-c17b38ecbe29 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:11.898975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-840f4bab-1795-4be4-a552-c17b38ecbe29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:11.919738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:11.975867 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 449/887] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:12.000847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f4bab-1795-4be4-a552-c17b38ecbe29 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:12.016015 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d060f-dbba-4d56-8ace-4eaa92050d8d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:12.064019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:12.075823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a1828-7a71-4aa2-bfdd-0650bcce1e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:12.078252 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a1828-7a71-4aa2-bfdd-0650bcce1e4c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:12.078252 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a1828-7a71-4aa2-bfdd-0650bcce1e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:12.078252 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a1828-7a71-4aa2-bfdd-0650bcce1e4c None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:12.079069 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a1828-7a71-4aa2-bfdd-0650bcce1e4c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:12.079401 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a1828-7a71-4aa2-bfdd-0650bcce1e4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:12.080747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a1828-7a71-4aa2-bfdd-0650bcce1e4c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:12.093583 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 439/888] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:44:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:12.094502 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a1828-7a71-4aa2-bfdd-0650bcce1e4c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:12.142801 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f4bab-1795-4be4-a552-c17b38ecbe29 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:12.180150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cfed1-f475-4966-a165-0746f761ecea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:12.180813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cfed1-f475-4966-a165-0746f761ecea None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:12.181056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cfed1-f475-4966-a165-0746f761ecea None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:12.181430 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5cfed1-f475-4966-a165-0746f761ecea None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:12.192679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5cfed1-f475-4966-a165-0746f761ecea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:44:12.197663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-1a5cfed1-f475-4966-a165-0746f761ecea None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 10:44:12.197663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:12.197663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:12.197663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:12.197663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:12.197663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:12.197663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:12.197663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:12.197663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:12.197663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:12.197663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:12.197663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:12.197663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:44:12.197663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:44:12.197663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:44:12.197663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:44:12.198639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:44:12.198639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:44:12.198639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:44:12.198639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:44:12.198639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:12.198639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:12.198639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:12.198639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:12.198639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:12.198639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:12.198639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:12.198639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:12.198639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:12.198639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:12.198639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:12.198639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:12.199549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:12.199549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:12.199549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:12.199549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:12.199549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:44:12.199549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:44:12.199549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:44:12.199549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:44:12.199549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:44:12.199549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:44:12.199549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 10:44:12.199549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:12.203144 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 450/889] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Aug 11 10:44:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:12.205161 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cfed1-f475-4966-a165-0746f761ecea None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:12.224552 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:12.226689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a1828-7a71-4aa2-bfdd-0650bcce1e4c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:12.264877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a862b7-e13e-4d07-8954-8ae791fc66bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:12.265528 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a862b7-e13e-4d07-8954-8ae791fc66bc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:12.265813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a862b7-e13e-4d07-8954-8ae791fc66bc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:12.266142 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a862b7-e13e-4d07-8954-8ae791fc66bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:12.266819 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a862b7-e13e-4d07-8954-8ae791fc66bc None admin] RBAC: Adding query filter params (interface=public, service_id=f56b51cddaa84738bf59e304b70cd348, region_id=RegionOne) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:12.267208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a862b7-e13e-4d07-8954-8ae791fc66bc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:12.268549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a862b7-e13e-4d07-8954-8ae791fc66bc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:12.278651 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 440/890] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Aug 11 10:44:12 2022] GET /identity/v3/endpoints?service_id=f56b51cddaa84738bf59e304b70cd348&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:12.279581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a862b7-e13e-4d07-8954-8ae791fc66bc None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:12.323932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5cfed1-f475-4966-a165-0746f761ecea None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:12.354838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:12.360888 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bab6f9-3f3c-4578-bbbc-575d8b10a19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:12.361500 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bab6f9-3f3c-4578-bbbc-575d8b10a19c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:12.361776 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bab6f9-3f3c-4578-bbbc-575d8b10a19c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:12.362044 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bab6f9-3f3c-4578-bbbc-575d8b10a19c None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:12.362704 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bab6f9-3f3c-4578-bbbc-575d8b10a19c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:12.363052 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bab6f9-3f3c-4578-bbbc-575d8b10a19c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:12.364449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bab6f9-3f3c-4578-bbbc-575d8b10a19c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:12.379206 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 451/891] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Aug 11 10:44:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:12.380773 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bab6f9-3f3c-4578-bbbc-575d8b10a19c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:12.413551 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a862b7-e13e-4d07-8954-8ae791fc66bc None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:12.450017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edf0bf-5702-4f96-b386-c74761151196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:12.450640 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edf0bf-5702-4f96-b386-c74761151196 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:12.451034 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edf0bf-5702-4f96-b386-c74761151196 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:12.451309 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edf0bf-5702-4f96-b386-c74761151196 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:12.451904 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42edf0bf-5702-4f96-b386-c74761151196 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:12.453372 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42edf0bf-5702-4f96-b386-c74761151196 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:12.463564 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 441/892] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Aug 11 10:44:12 2022] GET /identity/v3/services => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:44:12.477633 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:12.502493 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bab6f9-3f3c-4578-bbbc-575d8b10a19c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:12.542954 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc01fe-ce01-4e12-9dbb-766c76bdf914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:12.543613 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc01fe-ce01-4e12-9dbb-766c76bdf914 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:12.543895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc01fe-ce01-4e12-9dbb-766c76bdf914 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:12.544169 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc01fe-ce01-4e12-9dbb-766c76bdf914 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:12.557094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc01fe-ce01-4e12-9dbb-766c76bdf914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:12.558593 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc01fe-ce01-4e12-9dbb-766c76bdf914 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:12.574066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-01dc01fe-ce01-4e12-9dbb-766c76bdf914 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:12.574066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:12.574066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:12.574066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:12.574066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:12.574066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:12.574066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:12.574066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:12.574066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:12.574066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:12.574066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:12.574066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:12.574066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:12.574066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:12.574066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:12.574066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:12.575123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:12.575123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:12.575123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:12.575123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:12.575123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:12.575123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:12.575123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:12.575123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:12.575123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:12.575123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:12.575123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:12.575123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:12.575123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:12.575123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:12.575123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:12.575123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:12.575123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:12.575976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:12.575976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:12.575976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:12.575976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 452/893] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:12.582316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edf0bf-5702-4f96-b386-c74761151196 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:12.638815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0856d8-c58a-4199-a6a0-074d96d66452 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:12.639438 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0856d8-c58a-4199-a6a0-074d96d66452 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:12.639894 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0856d8-c58a-4199-a6a0-074d96d66452 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:12.641835 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 453/894] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:44:12.647924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080502c-e32a-4386-b7a7-067179663bf8 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:12.648425 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080502c-e32a-4386-b7a7-067179663bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:12.648883 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080502c-e32a-4386-b7a7-067179663bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:12.668098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c080502c-e32a-4386-b7a7-067179663bf8 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:12.669277 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c080502c-e32a-4386-b7a7-067179663bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:12.705246 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edf0bf-5702-4f96-b386-c74761151196 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:12.727115 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:12.750871 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 454/895] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:12.755720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3597f1b-adaa-4625-98e1-9cb5fd04d10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:12.756553 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3597f1b-adaa-4625-98e1-9cb5fd04d10b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:12.756992 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3597f1b-adaa-4625-98e1-9cb5fd04d10b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:12.757417 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3597f1b-adaa-4625-98e1-9cb5fd04d10b None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:12.758195 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3597f1b-adaa-4625-98e1-9cb5fd04d10b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:12.758639 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3597f1b-adaa-4625-98e1-9cb5fd04d10b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:12.760230 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3597f1b-adaa-4625-98e1-9cb5fd04d10b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:12.773127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 442/896] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:12.778448 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080502c-e32a-4386-b7a7-067179663bf8 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:12.780470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3597f1b-adaa-4625-98e1-9cb5fd04d10b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:12.842447 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:12.886108 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080502c-e32a-4386-b7a7-067179663bf8 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:12.922952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3a6d1-f654-4407-af69-754106b7f3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:12.923848 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3a6d1-f654-4407-af69-754106b7f3d1 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:12.924267 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3a6d1-f654-4407-af69-754106b7f3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:12.924731 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3a6d1-f654-4407-af69-754106b7f3d1 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:12.924887 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3597f1b-adaa-4625-98e1-9cb5fd04d10b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:12.925718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3a6d1-f654-4407-af69-754106b7f3d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:12.927374 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3a6d1-f654-4407-af69-754106b7f3d1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:12.962227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c619bae-3094-4646-aa01-a62c76d6cb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:12.963168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c619bae-3094-4646-aa01-a62c76d6cb7d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:12.963546 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c619bae-3094-4646-aa01-a62c76d6cb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:12.963889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c619bae-3094-4646-aa01-a62c76d6cb7d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:12.971364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c619bae-3094-4646-aa01-a62c76d6cb7d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:12.975760 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c619bae-3094-4646-aa01-a62c76d6cb7d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:12.985938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-1c619bae-3094-4646-aa01-a62c76d6cb7d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 10:44:12.985938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:12.985938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:12.985938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:12.985938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:12.985938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:12.985938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:12.985938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:12.985938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:12.985938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:12.985938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:12.985938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:12.985938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:44:12.985938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:44:12.985938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:44:12.985938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:44:12.986906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:12.986906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:12.986906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:44:12.986906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:12.986906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:44:12.986906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:12.986906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:12.986906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:12.986906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:12.986906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:12.986906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:12.986906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:12.986906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:12.986906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:12.986906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:12.986906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:12.986906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:12.986906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:12.987834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:12.987834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:12.987834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:44:12.987834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:44:12.987834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:44:12.987834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:44:12.987834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:44:12.987834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:44:12.987834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 10:44:12.987834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:12.991049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 443/897] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Aug 11 10:44:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:12.992681 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c619bae-3094-4646-aa01-a62c76d6cb7d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:13.010363 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 455/898] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Aug 11 10:44:12 2022] POST /identity/v3/services => generated 241 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:44:13.049798 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:13.114180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c619bae-3094-4646-aa01-a62c76d6cb7d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:13.157577 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0494e7-986c-4277-bdf5-c78c60b5f88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:13.158202 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0494e7-986c-4277-bdf5-c78c60b5f88b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:13.158541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0494e7-986c-4277-bdf5-c78c60b5f88b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:13.158849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0494e7-986c-4277-bdf5-c78c60b5f88b None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:13.159590 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0494e7-986c-4277-bdf5-c78c60b5f88b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:13.159899 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0494e7-986c-4277-bdf5-c78c60b5f88b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:13.161438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0494e7-986c-4277-bdf5-c78c60b5f88b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:13.182594 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 444/899] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Aug 11 10:44:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:13.188496 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3a6d1-f654-4407-af69-754106b7f3d1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:13.296482 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3a6d1-f654-4407-af69-754106b7f3d1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:13.316942 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:13.332324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b451b-a5b6-4a09-a820-fb6232ff34e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:13.334117 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b451b-a5b6-4a09-a820-fb6232ff34e1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:13.334117 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b451b-a5b6-4a09-a820-fb6232ff34e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:13.334117 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b451b-a5b6-4a09-a820-fb6232ff34e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:13.404615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b451b-a5b6-4a09-a820-fb6232ff34e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:13.406064 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b451b-a5b6-4a09-a820-fb6232ff34e1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:13.483825 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e0fb2-2f44-4fb9-b899-25b71c73e9f9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:13.484362 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e0fb2-2f44-4fb9-b899-25b71c73e9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:13.484362 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e0fb2-2f44-4fb9-b899-25b71c73e9f9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:13.486445 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 445/900] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:44:13.491363 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3327e-1bfa-4f79-853b-11f632f88849 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:13.491651 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3327e-1bfa-4f79-853b-11f632f88849 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:13.491913 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3327e-1bfa-4f79-853b-11f632f88849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:13.510192 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-27f3327e-1bfa-4f79-853b-11f632f88849 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:13.511397 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-27f3327e-1bfa-4f79-853b-11f632f88849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:13.518468 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 456/901] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:44:13 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 11 10:44:13.524147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b451b-a5b6-4a09-a820-fb6232ff34e1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:13.556614 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:13.593150 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 446/902] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 10:44:13.612929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3327e-1bfa-4f79-853b-11f632f88849 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:13.640555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:13.649448 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b451b-a5b6-4a09-a820-fb6232ff34e1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:13.702056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985e4ea-66e9-4a03-9f35-fd7422f02fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:13.703093 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985e4ea-66e9-4a03-9f35-fd7422f02fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:13.703839 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985e4ea-66e9-4a03-9f35-fd7422f02fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:13.704812 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985e4ea-66e9-4a03-9f35-fd7422f02fb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:13.720087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985e4ea-66e9-4a03-9f35-fd7422f02fb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:13.722509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985e4ea-66e9-4a03-9f35-fd7422f02fb8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:13.723415 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3327e-1bfa-4f79-853b-11f632f88849 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:13.743005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e985e4ea-66e9-4a03-9f35-fd7422f02fb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:13.743005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:13.743005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:13.743005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:13.743005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:13.743005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:13.743005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:13.743005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:13.743005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:13.743005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:13.743005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:13.743005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:13.743005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:13.743005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:13.743005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:13.743005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:13.744056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:13.744056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:13.744056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:13.744056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:13.744056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:13.744056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:13.744056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:13.744056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:13.744056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:13.744056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:13.744056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:13.744056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:13.744056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:13.744056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:13.744056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:13.744056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:13.744056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:13.745373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:13.745373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:13.745373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:13.745373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 457/903] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:13.750543 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985e4ea-66e9-4a03-9f35-fd7422f02fb8 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:13.764986 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5520bc-04d2-4847-9a47-12a5044708bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:13.765626 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5520bc-04d2-4847-9a47-12a5044708bd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:13.765952 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5520bc-04d2-4847-9a47-12a5044708bd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:13.766235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5520bc-04d2-4847-9a47-12a5044708bd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:13.766858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5520bc-04d2-4847-9a47-12a5044708bd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:13.768224 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5520bc-04d2-4847-9a47-12a5044708bd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:13.778370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-0a5520bc-04d2-4847-9a47-12a5044708bd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 10:44:13.778370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:13.778370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:44:13.778370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:44:13.778370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:44:13.778370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:44:13.778370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:44:13.778370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:13.778370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 10:44:13.778370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:13.778370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:13.778370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:13.778370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:13.778370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:13.778370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:13.778370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:13.779411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:13.779411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:13.779411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:13.779411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:13.779411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:13.779411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:13.779411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:13.779411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:44:13.779411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:44:13.779411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:44:13.779411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:44:13.779411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:13.779411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:13.779411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:13.779411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:13.779411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:13.779411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:13.780849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:13.780849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:13.780849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:13.780849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:13.780849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:13.780849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:13.780849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:13.780849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:13.780849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:13.780849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:13.780849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:44:13.780849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:13.780849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 10:44:13.780849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:13.780849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 447/904] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Aug 11 10:44:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:13.785401 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5520bc-04d2-4847-9a47-12a5044708bd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:13.861469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:13.893361 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985e4ea-66e9-4a03-9f35-fd7422f02fb8 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:13.905497 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:13.923103 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5520bc-04d2-4847-9a47-12a5044708bd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:13.929262 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18b25f-ad60-463c-9ebb-261f06ca17f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:13.929876 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18b25f-ad60-463c-9ebb-261f06ca17f2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:13.930152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18b25f-ad60-463c-9ebb-261f06ca17f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:13.930418 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18b25f-ad60-463c-9ebb-261f06ca17f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:13.931131 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18b25f-ad60-463c-9ebb-261f06ca17f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:13.931470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18b25f-ad60-463c-9ebb-261f06ca17f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:13.932889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18b25f-ad60-463c-9ebb-261f06ca17f2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:13.945458 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 458/905] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:13.952189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18b25f-ad60-463c-9ebb-261f06ca17f2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:13.965551 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929e951-fced-4854-abe4-9315f28adff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:13.966257 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929e951-fced-4854-abe4-9315f28adff0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:13.966638 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929e951-fced-4854-abe4-9315f28adff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:13.967020 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929e951-fced-4854-abe4-9315f28adff0 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:13.967758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929e951-fced-4854-abe4-9315f28adff0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:13.968124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929e951-fced-4854-abe4-9315f28adff0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:13.969541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929e951-fced-4854-abe4-9315f28adff0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:13.979016 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 448/906] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Aug 11 10:44:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:13.980820 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929e951-fced-4854-abe4-9315f28adff0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:14.062110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18b25f-ad60-463c-9ebb-261f06ca17f2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:14.085254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929e951-fced-4854-abe4-9315f28adff0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:14.094666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:14.100478 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b4906-9ac4-4167-b124-2d80d96bc5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:14.101399 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b4906-9ac4-4167-b124-2d80d96bc5c9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:14.101880 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b4906-9ac4-4167-b124-2d80d96bc5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:14.102424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b4906-9ac4-4167-b124-2d80d96bc5c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:14.110376 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b4906-9ac4-4167-b124-2d80d96bc5c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:14.115090 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b4906-9ac4-4167-b124-2d80d96bc5c9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:14.121465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cc7e2-a71c-4f47-b1e6-314e03692f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:14.122125 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cc7e2-a71c-4f47-b1e6-314e03692f29 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:14.122414 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cc7e2-a71c-4f47-b1e6-314e03692f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:14.122686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3cc7e2-a71c-4f47-b1e6-314e03692f29 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:14.123336 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3cc7e2-a71c-4f47-b1e6-314e03692f29 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:14.123637 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3cc7e2-a71c-4f47-b1e6-314e03692f29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:14.125038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3cc7e2-a71c-4f47-b1e6-314e03692f29 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:14.126798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-3a9b4906-9ac4-4167-b124-2d80d96bc5c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:14.126798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:14.126798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:14.126798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:14.126798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:14.126798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:14.126798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:14.126798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:14.126798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:14.126798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:14.126798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:14.126798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:14.126798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:44:14.126798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:44:14.126798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:44:14.127641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:44:14.127641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:14.127641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:14.127641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:14.127641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:14.127641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:14.127641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:14.127641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:14.127641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:14.127641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:14.127641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:14.127641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:14.127641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:14.127641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:14.127641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:14.127641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:14.127641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:14.128479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:44:14.128479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:44:14.128479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:44:14.128479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:44:14.128479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:44:14.128479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:44:14.128479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:14.128479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:14.135309 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 449/907] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Aug 11 10:44:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:14.136583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 459/908] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:44:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:14.136718 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cc7e2-a71c-4f47-b1e6-314e03692f29 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:14.138154 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b4906-9ac4-4167-b124-2d80d96bc5c9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:14.157884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:14.250716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3cc7e2-a71c-4f47-b1e6-314e03692f29 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:14.272260 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b4906-9ac4-4167-b124-2d80d96bc5c9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:14.293445 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ad4e1-c8f2-431c-b99e-17553818d337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:14.294439 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ad4e1-c8f2-431c-b99e-17553818d337 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:14.294918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ad4e1-c8f2-431c-b99e-17553818d337 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:14.295339 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ad4e1-c8f2-431c-b99e-17553818d337 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:14.296249 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ad4e1-c8f2-431c-b99e-17553818d337 None admin] RBAC: Adding query filter params (interface=public, service_id=e406e8bc27e749f384a9d9e01303fb59, region_id=RegionOne) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:14.296706 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ad4e1-c8f2-431c-b99e-17553818d337 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:14.298360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ad4e1-c8f2-431c-b99e-17553818d337 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:14.304624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 450/909] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Aug 11 10:44:14 2022] GET /identity/v3/endpoints?service_id=e406e8bc27e749f384a9d9e01303fb59&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:14.310461 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ad4e1-c8f2-431c-b99e-17553818d337 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:14.319690 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2806cca-5a4b-4864-ac09-fa04870c99a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:14.320402 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2806cca-5a4b-4864-ac09-fa04870c99a0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:14.320753 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2806cca-5a4b-4864-ac09-fa04870c99a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:14.321091 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2806cca-5a4b-4864-ac09-fa04870c99a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:14.322429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2806cca-5a4b-4864-ac09-fa04870c99a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:14.322833 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2806cca-5a4b-4864-ac09-fa04870c99a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:14.325102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2806cca-5a4b-4864-ac09-fa04870c99a0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:14.346282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 460/910] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:44:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:14.347636 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2806cca-5a4b-4864-ac09-fa04870c99a0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:14.402884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:14.418591 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:14.447914 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ad4e1-c8f2-431c-b99e-17553818d337 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:14.455699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2806cca-5a4b-4864-ac09-fa04870c99a0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:14.488474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ec442-01a0-44f2-a56b-662c6063b36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:14.489805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ec442-01a0-44f2-a56b-662c6063b36b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:14.490313 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ec442-01a0-44f2-a56b-662c6063b36b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:14.490819 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ec442-01a0-44f2-a56b-662c6063b36b None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:14.491653 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ec442-01a0-44f2-a56b-662c6063b36b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:14.493335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ec442-01a0-44f2-a56b-662c6063b36b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:14.501015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ddcc80-3f26-407f-bf8b-8b49086e1cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:14.501626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddcc80-3f26-407f-bf8b-8b49086e1cbb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:14.501900 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddcc80-3f26-407f-bf8b-8b49086e1cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:14.502170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddcc80-3f26-407f-bf8b-8b49086e1cbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:14.502923 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ddcc80-3f26-407f-bf8b-8b49086e1cbb None admin] RBAC: Adding query filter params (role.id=0abfe51f95874cceae89482cf378713c, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=9751264123914c27b961009f75067660) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:14.503230 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ddcc80-3f26-407f-bf8b-8b49086e1cbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:14.504159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 451/911] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Aug 11 10:44:14 2022] GET /identity/v3/services => generated 1497 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:44:14.504648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ddcc80-3f26-407f-bf8b-8b49086e1cbb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:14.520063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 461/912] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:44:14 2022] GET /identity/v3/role_assignments?user.id=9751264123914c27b961009f75067660&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=0abfe51f95874cceae89482cf378713c => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:14.605278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbee7d7-e663-4e40-aa95-0c8386652e15 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:14.605931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbee7d7-e663-4e40-aa95-0c8386652e15 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:14.606418 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbee7d7-e663-4e40-aa95-0c8386652e15 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:14.608146 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 452/913] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:14.614245 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c547804-e8a1-40f3-b69d-3d5b80ade443 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:14.614594 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c547804-e8a1-40f3-b69d-3d5b80ade443 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:14.614832 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c547804-e8a1-40f3-b69d-3d5b80ade443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:14.635748 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-8c547804-e8a1-40f3-b69d-3d5b80ade443 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:14.637005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8c547804-e8a1-40f3-b69d-3d5b80ade443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:14.716151 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 462/914] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:14.739524 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbee7d7-e663-4e40-aa95-0c8386652e15 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:14.849449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbee7d7-e663-4e40-aa95-0c8386652e15 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:14.886618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371c39a-ad14-47d3-a650-ab599138876e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:14.887286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371c39a-ad14-47d3-a650-ab599138876e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:14.887563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371c39a-ad14-47d3-a650-ab599138876e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:14.887832 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d371c39a-ad14-47d3-a650-ab599138876e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:14.888410 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371c39a-ad14-47d3-a650-ab599138876e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:14.889759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d371c39a-ad14-47d3-a650-ab599138876e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:14.898926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-d371c39a-ad14-47d3-a650-ab599138876e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 10:44:14.898926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:14.898926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:44:14.898926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:44:14.898926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:44:14.898926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:44:14.898926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:44:14.898926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:14.898926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 10:44:14.898926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:14.898926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:14.898926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:14.898926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:14.898926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:14.898926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:14.898926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:14.898926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:14.900435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:14.900435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:14.900435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:14.900435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:14.900435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:14.900435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:14.900435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:44:14.900435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:44:14.900435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:44:14.900435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:44:14.900435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:14.900435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:14.900435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:14.900435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:14.900435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:14.900435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:14.901729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:14.901729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:14.901729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:14.901729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:14.901729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:14.901729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:14.901729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:14.901729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:14.901729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:14.901729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:14.901729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:44:14.901729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:14.901729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 11 10:44:14.901729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:14.901729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 453/915] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:44:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:14.907893 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c547804-e8a1-40f3-b69d-3d5b80ade443 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:14.959046 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:15.016356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c547804-e8a1-40f3-b69d-3d5b80ade443 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:15.054628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be454be-b057-4f21-a801-47fcd81a0c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:15.055332 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be454be-b057-4f21-a801-47fcd81a0c14 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:15.055615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be454be-b057-4f21-a801-47fcd81a0c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:15.055892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be454be-b057-4f21-a801-47fcd81a0c14 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:15.056867 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be454be-b057-4f21-a801-47fcd81a0c14 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:15.057298 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be454be-b057-4f21-a801-47fcd81a0c14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:15.058676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be454be-b057-4f21-a801-47fcd81a0c14 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:15.064038 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 463/916] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:44:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:15.069512 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371c39a-ad14-47d3-a650-ab599138876e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:15.082105 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:15.183624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d371c39a-ad14-47d3-a650-ab599138876e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:15.220496 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b9e811-340c-4ff9-bd93-3c70ca5c5756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:15.221118 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9e811-340c-4ff9-bd93-3c70ca5c5756 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:15.221400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9e811-340c-4ff9-bd93-3c70ca5c5756 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:15.221676 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9e811-340c-4ff9-bd93-3c70ca5c5756 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:15.222311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9e811-340c-4ff9-bd93-3c70ca5c5756 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:15.222615 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9e811-340c-4ff9-bd93-3c70ca5c5756 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:15.224109 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b9e811-340c-4ff9-bd93-3c70ca5c5756 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:15.230425 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 454/917] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Aug 11 10:44:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:15.236270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be454be-b057-4f21-a801-47fcd81a0c14 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:15.242527 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662bc67-79df-421a-921b-333dc44bc2df None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:15.242849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662bc67-79df-421a-921b-333dc44bc2df None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:15.243131 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662bc67-79df-421a-921b-333dc44bc2df None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:15.244962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 455/918] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:44:15.249938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c692f-dd4f-468e-9928-de6071b19a14 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:15.250224 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c692f-dd4f-468e-9928-de6071b19a14 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:15.250500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c692f-dd4f-468e-9928-de6071b19a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:15.269746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5d7c692f-dd4f-468e-9928-de6071b19a14 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:15.270865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5d7c692f-dd4f-468e-9928-de6071b19a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:15.354909 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 456/919] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 10:44:15.360566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be454be-b057-4f21-a801-47fcd81a0c14 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:15.371679 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c692f-dd4f-468e-9928-de6071b19a14 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:15.373034 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:15.374859 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:15.399039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818e2b5-6440-4ab7-835a-3da98279fbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:15.400144 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818e2b5-6440-4ab7-835a-3da98279fbd6 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:15.400631 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818e2b5-6440-4ab7-835a-3da98279fbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:15.401117 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818e2b5-6440-4ab7-835a-3da98279fbd6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:15.401985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818e2b5-6440-4ab7-835a-3da98279fbd6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:15.404757 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818e2b5-6440-4ab7-835a-3da98279fbd6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:15.467059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 464/920] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 10:44:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:44:15.479169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c692f-dd4f-468e-9928-de6071b19a14 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:15.527002 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cfb43-f920-4bb8-aa75-b0ea23274765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:15.527630 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cfb43-f920-4bb8-aa75-b0ea23274765 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:15.527957 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cfb43-f920-4bb8-aa75-b0ea23274765 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:15.528230 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cfb43-f920-4bb8-aa75-b0ea23274765 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:15.528819 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cfb43-f920-4bb8-aa75-b0ea23274765 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:15.530306 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cfb43-f920-4bb8-aa75-b0ea23274765 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:15.540021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e39cfb43-f920-4bb8-aa75-b0ea23274765 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 10:44:15.540021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:15.540021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:44:15.540021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:44:15.540021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:44:15.540021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:44:15.540021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:44:15.540021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:15.540021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 10:44:15.540021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:15.540021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:15.540021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:15.540021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:15.540021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:15.540021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:15.540021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:15.540021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:15.541134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:15.541134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:15.541134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:15.541134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:15.541134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:15.541134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:15.541134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:44:15.541134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:44:15.541134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:44:15.541134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:44:15.541134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:15.541134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:15.541134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:15.541134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:15.541134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:15.541134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:15.541953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:15.541953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:15.541953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:15.541953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:15.541953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:15.541953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:15.541953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:15.541953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:15.541953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:15.541953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:15.541953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:44:15.541953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:15.541953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 10:44:15.541953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:15.546565 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 457/921] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Aug 11 10:44:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:15.548087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818e2b5-6440-4ab7-835a-3da98279fbd6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:15.660586 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818e2b5-6440-4ab7-835a-3da98279fbd6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:15.698107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d638f3-16c5-407c-a976-4c983c8b8ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:15.698871 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d638f3-16c5-407c-a976-4c983c8b8ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:15.699104 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d638f3-16c5-407c-a976-4c983c8b8ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:15.699377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d638f3-16c5-407c-a976-4c983c8b8ee2 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:15.700011 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d638f3-16c5-407c-a976-4c983c8b8ee2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:15.700312 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d638f3-16c5-407c-a976-4c983c8b8ee2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:15.701678 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d638f3-16c5-407c-a976-4c983c8b8ee2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:15.709277 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 465/922] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Aug 11 10:44:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:15.713976 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cfb43-f920-4bb8-aa75-b0ea23274765 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:15.780741 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:15.825467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cfb43-f920-4bb8-aa75-b0ea23274765 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:15.861078 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa584cd-413b-4412-8e3a-ac7047e06b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:15.861691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa584cd-413b-4412-8e3a-ac7047e06b17 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:15.861972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa584cd-413b-4412-8e3a-ac7047e06b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:15.862246 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa584cd-413b-4412-8e3a-ac7047e06b17 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:15.862911 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa584cd-413b-4412-8e3a-ac7047e06b17 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:15.863213 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa584cd-413b-4412-8e3a-ac7047e06b17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:15.864577 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa584cd-413b-4412-8e3a-ac7047e06b17 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:15.870361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 458/923] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Aug 11 10:44:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:15.876042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d638f3-16c5-407c-a976-4c983c8b8ee2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:15.909487 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:15.986789 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d638f3-16c5-407c-a976-4c983c8b8ee2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:16.027092 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17432998-a705-4d27-abc3-7538227ff26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:16.028066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17432998-a705-4d27-abc3-7538227ff26e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:16.028571 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17432998-a705-4d27-abc3-7538227ff26e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:16.029039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17432998-a705-4d27-abc3-7538227ff26e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:16.035199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17432998-a705-4d27-abc3-7538227ff26e None admin] RBAC: Adding query filter params (interface=public, service_id=5edd9ec3dbfc487e88fdb9bfb44db2a0, region_id=RegionOne) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:16.035723 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17432998-a705-4d27-abc3-7538227ff26e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:16.037313 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17432998-a705-4d27-abc3-7538227ff26e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:16.045236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 466/924] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Aug 11 10:44:15 2022] GET /identity/v3/endpoints?service_id=5edd9ec3dbfc487e88fdb9bfb44db2a0&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:16.051053 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa584cd-413b-4412-8e3a-ac7047e06b17 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:16.157645 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa584cd-413b-4412-8e3a-ac7047e06b17 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:16.187481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:16.193474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af172574-7e44-418c-86b1-bf883475ecea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:16.194094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af172574-7e44-418c-86b1-bf883475ecea None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:16.194374 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af172574-7e44-418c-86b1-bf883475ecea None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:16.194651 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af172574-7e44-418c-86b1-bf883475ecea None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:16.195293 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af172574-7e44-418c-86b1-bf883475ecea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:16.197327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af172574-7e44-418c-86b1-bf883475ecea None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:16.205813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 459/925] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Aug 11 10:44:16 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:44:16.597767 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a515258-987e-46ba-8ee1-bcf4c3d1c20e None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:16.598315 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a515258-987e-46ba-8ee1-bcf4c3d1c20e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:16.598315 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a515258-987e-46ba-8ee1-bcf4c3d1c20e None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:16.599935 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 467/926] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:16.605465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7894f-7f22-478f-bf30-a8e4e6f44012 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:16.605883 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7894f-7f22-478f-bf30-a8e4e6f44012 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:16.606052 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7894f-7f22-478f-bf30-a8e4e6f44012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:16.624816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f5b7894f-7f22-478f-bf30-a8e4e6f44012 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:16.626000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f5b7894f-7f22-478f-bf30-a8e4e6f44012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:16.696250 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 460/927] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:16.718456 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a515258-987e-46ba-8ee1-bcf4c3d1c20e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:16.748261 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e64e9f-7e9e-4bc4-b608-7b1fe66ad92a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:16.748756 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e64e9f-7e9e-4bc4-b608-7b1fe66ad92a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:16.749148 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e64e9f-7e9e-4bc4-b608-7b1fe66ad92a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:16.750956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 461/928] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:44:16.758794 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a36972-4114-43f9-9393-299c97cab140 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:16.758794 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a36972-4114-43f9-9393-299c97cab140 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:16.758794 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a36972-4114-43f9-9393-299c97cab140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:16.776204 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-87a36972-4114-43f9-9393-299c97cab140 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:16.777406 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-87a36972-4114-43f9-9393-299c97cab140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:16.833891 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:16.845317 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a515258-987e-46ba-8ee1-bcf4c3d1c20e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:16.862018 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 462/929] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 10:44:16.891130 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a36972-4114-43f9-9393-299c97cab140 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:16.892454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b965b79-a335-4d0e-8d2c-759e8c5890d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:16.893097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b965b79-a335-4d0e-8d2c-759e8c5890d3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:16.893378 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b965b79-a335-4d0e-8d2c-759e8c5890d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:16.893650 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b965b79-a335-4d0e-8d2c-759e8c5890d3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:16.907636 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b965b79-a335-4d0e-8d2c-759e8c5890d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:44:16.914112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-6b965b79-a335-4d0e-8d2c-759e8c5890d3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 10:44:16.914112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:16.914112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:16.914112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:16.914112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:16.914112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:16.914112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:16.914112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:16.914112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:16.914112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:16.914112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:16.914112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:16.914112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:44:16.914112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:44:16.914112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:44:16.914112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:44:16.915141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:44:16.915141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:44:16.915141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:44:16.915141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:44:16.915141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:16.915141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:16.915141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:16.915141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:16.915141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:16.915141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:16.915141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:16.915141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:16.915141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:16.915141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:16.915141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:16.915141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:16.917176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:16.917176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:16.917176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:16.917176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:16.917176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:44:16.917176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:44:16.917176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:44:16.917176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:44:16.917176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:44:16.917176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:44:16.917176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 10:44:16.917176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:16.917176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 468/930] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Aug 11 10:44:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:16.921586 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b965b79-a335-4d0e-8d2c-759e8c5890d3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:16.959132 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:17.029305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a36972-4114-43f9-9393-299c97cab140 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:17.052198 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b965b79-a335-4d0e-8d2c-759e8c5890d3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:17.076376 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb2ae9-7f86-4279-9100-d9c0087e4aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:17.077180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb2ae9-7f86-4279-9100-d9c0087e4aea None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:17.077597 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb2ae9-7f86-4279-9100-d9c0087e4aea None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:17.077973 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb2ae9-7f86-4279-9100-d9c0087e4aea None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:17.078664 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb2ae9-7f86-4279-9100-d9c0087e4aea None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:17.080605 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb2ae9-7f86-4279-9100-d9c0087e4aea None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:17.093000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-1fdb2ae9-7f86-4279-9100-d9c0087e4aea None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 10:44:17.093000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:17.093000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:44:17.093000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:44:17.093000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:44:17.093000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:44:17.093000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:44:17.093000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:17.093000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 10:44:17.093000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:17.093000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:17.093000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:17.093000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:17.093000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:17.093000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:17.093000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:17.093968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:17.093968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:17.093968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:17.093968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:17.093968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:17.093968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:17.093968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:17.093968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:44:17.093968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:44:17.093968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:44:17.093968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:44:17.093968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:17.093968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:17.093968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:17.093968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:17.093968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:17.093968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:17.095128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:17.095128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:17.095128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:17.095128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:17.095128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:17.095128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:17.095128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:17.095128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:17.095128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:17.095128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:17.095128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:44:17.095128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:17.095128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 11 10:44:17.095128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:17.098443 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffda437-dc04-4e0a-aeb0-3ac70be3b277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:17.099362 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffda437-dc04-4e0a-aeb0-3ac70be3b277 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:17.099486 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 463/931] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Aug 11 10:44:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:17.099944 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffda437-dc04-4e0a-aeb0-3ac70be3b277 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:17.100392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffda437-dc04-4e0a-aeb0-3ac70be3b277 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:17.100542 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb2ae9-7f86-4279-9100-d9c0087e4aea None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:17.101549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffda437-dc04-4e0a-aeb0-3ac70be3b277 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:17.102033 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffda437-dc04-4e0a-aeb0-3ac70be3b277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:17.103884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffda437-dc04-4e0a-aeb0-3ac70be3b277 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:17.117672 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 469/932] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Aug 11 10:44:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:17.123677 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffda437-dc04-4e0a-aeb0-3ac70be3b277 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:17.149489 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:17.222134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb2ae9-7f86-4279-9100-d9c0087e4aea None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:17.239252 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:17.262296 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168ba28-57d5-4c90-9f35-42e5d3360eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:17.262939 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168ba28-57d5-4c90-9f35-42e5d3360eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:17.263220 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168ba28-57d5-4c90-9f35-42e5d3360eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:17.263491 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168ba28-57d5-4c90-9f35-42e5d3360eb9 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:17.264118 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168ba28-57d5-4c90-9f35-42e5d3360eb9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:17.264474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168ba28-57d5-4c90-9f35-42e5d3360eb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:17.265710 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffda437-dc04-4e0a-aeb0-3ac70be3b277 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:17.265824 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168ba28-57d5-4c90-9f35-42e5d3360eb9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:17.278849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 464/933] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Aug 11 10:44:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:17.284689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168ba28-57d5-4c90-9f35-42e5d3360eb9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:17.310190 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c74fb-174e-472b-a850-400f38655e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:17.310991 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c74fb-174e-472b-a850-400f38655e49 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:17.311270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c74fb-174e-472b-a850-400f38655e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:17.311585 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c74fb-174e-472b-a850-400f38655e49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:17.324971 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c74fb-174e-472b-a850-400f38655e49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:17.326549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c74fb-174e-472b-a850-400f38655e49 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:17.341269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-449c74fb-174e-472b-a850-400f38655e49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:17.341269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:17.341269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:17.341269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:17.341269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:17.341269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:17.341269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:17.341269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:17.341269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:17.341269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:17.341269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:17.341269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:17.341269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:17.341269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:17.341269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:17.341269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:17.342212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:17.342212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:17.342212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:17.342212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:17.342212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:17.342212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:17.342212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:17.342212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:17.342212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:17.342212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:17.342212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:17.342212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:17.342212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:17.342212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:17.342212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:17.342212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:17.342212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:17.343098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:17.343098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:17.343098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:17.343098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 470/934] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:17.347763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c74fb-174e-472b-a850-400f38655e49 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:17.431190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168ba28-57d5-4c90-9f35-42e5d3360eb9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:17.434186 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:17.476185 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9865c2f-5a88-4ecf-a860-9ff517ea4012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:17.476852 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9865c2f-5a88-4ecf-a860-9ff517ea4012 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:17.477136 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9865c2f-5a88-4ecf-a860-9ff517ea4012 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:17.477409 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9865c2f-5a88-4ecf-a860-9ff517ea4012 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:17.478568 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9865c2f-5a88-4ecf-a860-9ff517ea4012 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:17.478925 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9865c2f-5a88-4ecf-a860-9ff517ea4012 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:17.480377 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9865c2f-5a88-4ecf-a860-9ff517ea4012 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:17.483356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c74fb-174e-472b-a850-400f38655e49 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:17.493877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 465/935] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Aug 11 10:44:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:17.494435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9865c2f-5a88-4ecf-a860-9ff517ea4012 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:17.523373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbf34b-2062-468a-8ed6-fa6d33440152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:17.523985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbf34b-2062-468a-8ed6-fa6d33440152 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:17.524312 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbf34b-2062-468a-8ed6-fa6d33440152 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:17.524584 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbf34b-2062-468a-8ed6-fa6d33440152 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:17.525294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbf34b-2062-468a-8ed6-fa6d33440152 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:17.525641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbf34b-2062-468a-8ed6-fa6d33440152 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:17.527097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfbf34b-2062-468a-8ed6-fa6d33440152 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:17.539831 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 471/936] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:17.545763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbf34b-2062-468a-8ed6-fa6d33440152 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:17.554450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:17.612473 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9865c2f-5a88-4ecf-a860-9ff517ea4012 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:17.647104 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ffa2f4-4e74-410f-8dc4-43aa98004d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:17.647793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffa2f4-4e74-410f-8dc4-43aa98004d55 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:17.647978 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffa2f4-4e74-410f-8dc4-43aa98004d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:17.648249 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ffa2f4-4e74-410f-8dc4-43aa98004d55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:17.648909 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffa2f4-4e74-410f-8dc4-43aa98004d55 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:17.650428 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ffa2f4-4e74-410f-8dc4-43aa98004d55 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:17.658702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbf34b-2062-468a-8ed6-fa6d33440152 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:17.687624 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:17.695049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4270a6-b42f-44ae-b9ce-05ea896b20c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:17.695678 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4270a6-b42f-44ae-b9ce-05ea896b20c0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:17.695959 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4270a6-b42f-44ae-b9ce-05ea896b20c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:17.696233 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4270a6-b42f-44ae-b9ce-05ea896b20c0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:17.704165 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4270a6-b42f-44ae-b9ce-05ea896b20c0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:17.705689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4270a6-b42f-44ae-b9ce-05ea896b20c0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:17.718054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-9b4270a6-b42f-44ae-b9ce-05ea896b20c0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 10:44:17.718054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:17.718054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:17.718054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:17.718054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:17.718054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:17.718054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:17.718054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:17.718054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:17.718054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:17.718054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:17.718054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:17.718054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:44:17.718054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:44:17.718054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:44:17.718054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:44:17.724915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:17.724915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:17.724915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:44:17.724915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:17.724915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:44:17.724915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:17.724915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:17.724915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:17.724915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:17.724915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:17.724915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:17.724915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:17.724915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:17.724915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:17.724915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:17.724915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:17.724915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:17.724915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:17.726057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:17.726057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:17.726057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:44:17.726057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:44:17.726057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:44:17.726057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:44:17.726057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:44:17.726057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:44:17.726057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 10:44:17.726057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:17.726057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 472/937] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Aug 11 10:44:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:17.726057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8c4dc-bd98-4f88-941a-a013794f0d80 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:17.726057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8c4dc-bd98-4f88-941a-a013794f0d80 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:17.727091 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8c4dc-bd98-4f88-941a-a013794f0d80 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:17.727091 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 473/938] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:17.727091 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8c4dc-bd98-4f88-941a-a013794f0d80 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:17.739278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 466/939] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 10:44:17 2022] POST /identity/v3/endpoints => generated 347 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:44:17.741985 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7dda5-7385-47ba-8c2b-252ea3ae4e2e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:17.742435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7dda5-7385-47ba-8c2b-252ea3ae4e2e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:17.742874 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7dda5-7385-47ba-8c2b-252ea3ae4e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:17.776813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-31f7dda5-7385-47ba-8c2b-252ea3ae4e2e None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:17.779190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-31f7dda5-7385-47ba-8c2b-252ea3ae4e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:17.859356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8c4dc-bd98-4f88-941a-a013794f0d80 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:17.886164 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 467/940] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:17.901970 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80a9cc-dde5-4f86-8faf-bbcb97929e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:17.902887 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80a9cc-dde5-4f86-8faf-bbcb97929e00 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:17.903320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80a9cc-dde5-4f86-8faf-bbcb97929e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:17.903768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80a9cc-dde5-4f86-8faf-bbcb97929e00 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:17.904677 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80a9cc-dde5-4f86-8faf-bbcb97929e00 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:17.905125 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80a9cc-dde5-4f86-8faf-bbcb97929e00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:17.906718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80a9cc-dde5-4f86-8faf-bbcb97929e00 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:17.912198 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7dda5-7385-47ba-8c2b-252ea3ae4e2e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:17.934515 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 474/941] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Aug 11 10:44:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:17.942453 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80a9cc-dde5-4f86-8faf-bbcb97929e00 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:17.949990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:17.999446 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:18.036079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7dda5-7385-47ba-8c2b-252ea3ae4e2e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:18.077257 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4feb004-467c-4be0-a5c0-6f25798f299e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:18.078235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4feb004-467c-4be0-a5c0-6f25798f299e None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:18.078786 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4feb004-467c-4be0-a5c0-6f25798f299e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:18.079211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4feb004-467c-4be0-a5c0-6f25798f299e None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:18.080019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4feb004-467c-4be0-a5c0-6f25798f299e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:18.081635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4feb004-467c-4be0-a5c0-6f25798f299e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:18.081897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80a9cc-dde5-4f86-8faf-bbcb97929e00 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:18.084881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: WARNING keystone.server.flask.common [None req-d4feb004-467c-4be0-a5c0-6f25798f299e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 11 10:44:18.119839 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e710c36-135c-46d9-af64-d57bbc69ba88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:18.120591 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e710c36-135c-46d9-af64-d57bbc69ba88 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:18.120870 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e710c36-135c-46d9-af64-d57bbc69ba88 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:18.121140 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e710c36-135c-46d9-af64-d57bbc69ba88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:18.132284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e710c36-135c-46d9-af64-d57bbc69ba88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:18.133739 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e710c36-135c-46d9-af64-d57bbc69ba88 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:18.136004 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.sql.core [None req-d4feb004-467c-4be0-a5c0-6f25798f299e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 11 10:44:18.136004 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 11 10:44:18.136004 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [parameters: {'id': 'f182e68223cd4dd694bec48a94dd008b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 11 10:44:18.136004 dv-cinder-820027-17-smb devstack@keystone.service[81638]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81638) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 11 10:44:18.143525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-d4feb004-467c-4be0-a5c0-6f25798f299e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f182e68223cd4dd694bec48a94dd008b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f182e68223cd4dd694bec48a94dd008b. Aug 11 10:44:18.143525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:18.143525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 10:44:18.143525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 10:44:18.143525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 10:44:18.143525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 10:44:18.143525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 10:44:18.143525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 10:44:18.143525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 10:44:18.143525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application conn.query(q) Aug 11 10:44:18.143525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 10:44:18.143525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 10:44:18.143525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 10:44:18.144383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application result.read() Aug 11 10:44:18.144383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 10:44:18.144383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 10:44:18.144383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 10:44:18.144383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 10:44:18.144383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 10:44:18.144383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 10:44:18.144383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 10:44:18.144383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 10:44:18.144383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 11 10:44:18.144383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:18.144383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 11 10:44:18.144383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:18.144383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:18.144383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 11 10:44:18.144383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 11 10:44:18.144383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 11 10:44:18.144383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 11 10:44:18.145329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 10:44:18.145329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application next(self.gen) Aug 11 10:44:18.145329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 11 10:44:18.145329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application yield resource Aug 11 10:44:18.145329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 10:44:18.145329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application next(self.gen) Aug 11 10:44:18.145329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 11 10:44:18.145329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.session.rollback() Aug 11 10:44:18.145329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 11 10:44:18.145329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.force_reraise() Aug 11 10:44:18.145329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 11 10:44:18.145329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise self.value Aug 11 10:44:18.145329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 11 10:44:18.145329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 11 10:44:18.145329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 11 10:44:18.145329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application session.commit() Aug 11 10:44:18.145329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 11 10:44:18.146200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 11 10:44:18.146200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 11 10:44:18.146200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._prepare_impl() Aug 11 10:44:18.146200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 11 10:44:18.146200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.session.flush() Aug 11 10:44:18.146200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 11 10:44:18.146200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._flush(objects) Aug 11 10:44:18.146200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 11 10:44:18.146200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 11 10:44:18.146200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 11 10:44:18.146200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application compat.raise_( Aug 11 10:44:18.146200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 10:44:18.146200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception Aug 11 10:44:18.146200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 11 10:44:18.146200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application flush_context.execute() Aug 11 10:44:18.146200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 11 10:44:18.146200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rec.execute(self) Aug 11 10:44:18.147123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 11 10:44:18.147123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 11 10:44:18.147123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 11 10:44:18.147123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 11 10:44:18.147123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 11 10:44:18.147123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 11 10:44:18.147123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 11 10:44:18.147123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 11 10:44:18.147123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 11 10:44:18.147123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 11 10:44:18.147123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 11 10:44:18.147123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 11 10:44:18.147123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 11 10:44:18.147123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 11 10:44:18.147123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 11 10:44:18.149838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 11 10:44:18.149838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 10:44:18.149838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception Aug 11 10:44:18.149838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 10:44:18.149838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 10:44:18.149838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 10:44:18.149838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 10:44:18.149838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 10:44:18.149838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 10:44:18.149838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 10:44:18.149838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application conn.query(q) Aug 11 10:44:18.149838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 10:44:18.149838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 10:44:18.149838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 10:44:18.149838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application result.read() Aug 11 10:44:18.149838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 10:44:18.149838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 10:44:18.152211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 10:44:18.152211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 10:44:18.152211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 10:44:18.152211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 10:44:18.152211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 10:44:18.152211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 10:44:18.152211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 11 10:44:18.152211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 11 10:44:18.152211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [parameters: {'id': 'f182e68223cd4dd694bec48a94dd008b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 11 10:44:18.152211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 11 10:44:18.152211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:18.152211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:18.152211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:18.152211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:18.152211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 11 10:44:18.154895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 11 10:44:18.154895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 11 10:44:18.154895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 11 10:44:18.154895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 11 10:44:18.154895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:18.154895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:18.154895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:18.154895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:18.154895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:18.154895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:18.154895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:18.154895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:18.154895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:18.154895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:18.154895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:18.154895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:18.154895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:18.157597 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:18.157597 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 11 10:44:18.157597 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 11 10:44:18.157597 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:18.157597 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:18.157597 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 11 10:44:18.157597 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 11 10:44:18.157597 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f182e68223cd4dd694bec48a94dd008b. Aug 11 10:44:18.157597 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:18.157597 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 468/942] 10.222.0.43 () {60 vars in 1140 bytes} [Thu Aug 11 10:44:17 2022] POST /identity/v3/projects => generated 262 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:18.157597 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4feb004-467c-4be0-a5c0-6f25798f299e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:18.168759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-7e710c36-135c-46d9-af64-d57bbc69ba88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:18.168759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:18.168759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:18.168759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:18.168759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:18.168759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:18.168759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:18.168759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:18.168759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:18.168759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:18.168759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:18.168759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:18.168759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:18.168759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:18.168759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:18.168759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:18.174681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:18.174681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:18.174681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:18.174681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:18.174681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:18.174681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:18.174681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:18.174681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:18.174681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:18.174681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:18.174681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:18.174681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:18.174681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:18.174681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:18.174681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:18.174681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:18.174681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:18.175967 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:18.175967 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:18.175967 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:18.175967 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 475/943] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:18.177860 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e710c36-135c-46d9-af64-d57bbc69ba88 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:18.264234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:18.280708 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4feb004-467c-4be0-a5c0-6f25798f299e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:18.317109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:18.324483 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ceb195-a07f-4085-bed5-bbccf63696de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:18.324802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e710c36-135c-46d9-af64-d57bbc69ba88 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:18.325635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ceb195-a07f-4085-bed5-bbccf63696de None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:18.326311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ceb195-a07f-4085-bed5-bbccf63696de None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:18.326817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ceb195-a07f-4085-bed5-bbccf63696de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:18.337894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ceb195-a07f-4085-bed5-bbccf63696de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:18.341095 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ceb195-a07f-4085-bed5-bbccf63696de None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:18.356875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-a5ceb195-a07f-4085-bed5-bbccf63696de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:18.356875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:18.356875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:18.356875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:18.356875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:18.356875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:18.356875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:18.356875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:18.356875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:18.356875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:18.356875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:18.356875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:18.356875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:44:18.356875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:44:18.356875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:44:18.357809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:44:18.357809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:18.357809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:18.357809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:18.357809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:18.357809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:18.357809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:18.357809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:18.357809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:18.357809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:18.357809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:18.357809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:18.357809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:18.357809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:18.357809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:18.357809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:18.357809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:18.359018 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:44:18.359018 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:44:18.359018 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:44:18.359018 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:44:18.359018 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:44:18.359018 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:44:18.359018 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:18.359018 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:18.360932 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 469/944] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:44:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:18.368407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ceb195-a07f-4085-bed5-bbccf63696de None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:18.373771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80577a79-7c72-41cc-ac46-a35d55bc6cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:18.374683 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80577a79-7c72-41cc-ac46-a35d55bc6cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:18.375223 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80577a79-7c72-41cc-ac46-a35d55bc6cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:18.375696 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80577a79-7c72-41cc-ac46-a35d55bc6cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:18.376586 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80577a79-7c72-41cc-ac46-a35d55bc6cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:18.377153 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80577a79-7c72-41cc-ac46-a35d55bc6cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:18.379580 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80577a79-7c72-41cc-ac46-a35d55bc6cf7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:18.403256 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 476/945] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:18.404707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80577a79-7c72-41cc-ac46-a35d55bc6cf7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:18.499336 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ceb195-a07f-4085-bed5-bbccf63696de None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:18.524931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80577a79-7c72-41cc-ac46-a35d55bc6cf7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:18.535586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16cb170-86c5-430c-97c3-9a52c7f51392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:18.536175 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cb170-86c5-430c-97c3-9a52c7f51392 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:18.536459 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cb170-86c5-430c-97c3-9a52c7f51392 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:18.536734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16cb170-86c5-430c-97c3-9a52c7f51392 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:18.537397 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cb170-86c5-430c-97c3-9a52c7f51392 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:18.537728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cb170-86c5-430c-97c3-9a52c7f51392 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:18.539272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16cb170-86c5-430c-97c3-9a52c7f51392 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:18.560828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 470/946] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Aug 11 10:44:18 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:18.562193 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a268b16-1cfa-491f-b18c-9d63db99cc42 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:18.562485 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a268b16-1cfa-491f-b18c-9d63db99cc42 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:18.562788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a268b16-1cfa-491f-b18c-9d63db99cc42 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:18.568296 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 471/947] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:18.569984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11615d-2ed6-4352-bc01-45fb1801b666 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:18.570268 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11615d-2ed6-4352-bc01-45fb1801b666 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:18.570567 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11615d-2ed6-4352-bc01-45fb1801b666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:18.579275 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e27df1-1043-4834-8fff-2355a7e47e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:18.580495 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e27df1-1043-4834-8fff-2355a7e47e01 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:18.581004 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e27df1-1043-4834-8fff-2355a7e47e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:18.581482 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e27df1-1043-4834-8fff-2355a7e47e01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:18.584829 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:18.591992 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e27df1-1043-4834-8fff-2355a7e47e01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:18.593544 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e27df1-1043-4834-8fff-2355a7e47e01 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:18.600793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3f11615d-2ed6-4352-bc01-45fb1801b666 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:18.603136 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3f11615d-2ed6-4352-bc01-45fb1801b666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:18.612388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-49e27df1-1043-4834-8fff-2355a7e47e01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:18.612388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:18.612388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:18.612388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:18.612388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:18.612388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:18.612388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:18.612388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:18.612388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:18.612388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:18.612388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:18.612388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:18.612388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:44:18.612388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:44:18.612388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:44:18.613354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:44:18.613354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:18.613354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:18.613354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:18.613354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:18.613354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:18.613354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:18.613354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:18.613354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:18.613354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:18.613354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:18.613354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:18.613354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:18.613354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:18.613354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:18.613354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:18.613354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:18.614272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:44:18.614272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:44:18.614272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:44:18.614272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:44:18.614272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:44:18.614272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:44:18.614272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:18.614272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:18.614272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 477/948] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:44:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:18.620302 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e27df1-1043-4834-8fff-2355a7e47e01 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:18.647749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:18.713625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 472/949] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:18.738450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11615d-2ed6-4352-bc01-45fb1801b666 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:18.780023 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e27df1-1043-4834-8fff-2355a7e47e01 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:18.825026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ef32c-999b-449b-ac76-18e342f87d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:18.825773 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ef32c-999b-449b-ac76-18e342f87d5b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:18.826053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ef32c-999b-449b-ac76-18e342f87d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:18.826326 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ef32c-999b-449b-ac76-18e342f87d5b None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:18.827135 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ef32c-999b-449b-ac76-18e342f87d5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:18.827442 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ef32c-999b-449b-ac76-18e342f87d5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:18.828942 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ef32c-999b-449b-ac76-18e342f87d5b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:18.845476 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 478/950] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:44:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:18.847997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ef32c-999b-449b-ac76-18e342f87d5b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:18.864649 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11615d-2ed6-4352-bc01-45fb1801b666 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:18.905276 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f88358-5a1d-4b44-9aaf-ff82c07657fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:18.905918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f88358-5a1d-4b44-9aaf-ff82c07657fb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:18.906218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f88358-5a1d-4b44-9aaf-ff82c07657fb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:18.906449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f88358-5a1d-4b44-9aaf-ff82c07657fb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:18.907080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f88358-5a1d-4b44-9aaf-ff82c07657fb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:18.908446 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f88358-5a1d-4b44-9aaf-ff82c07657fb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:18.917635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c8f88358-5a1d-4b44-9aaf-ff82c07657fb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 10:44:18.917635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:18.917635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:44:18.917635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:44:18.917635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:44:18.917635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:44:18.917635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:44:18.917635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:18.917635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 10:44:18.917635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:18.917635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:18.917635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:18.917635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:18.917635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:18.917635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:18.917635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:18.917635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:18.919703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:18.919703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:18.919703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:18.919703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:18.919703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:18.919703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:18.919703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:44:18.919703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:44:18.919703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:44:18.919703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:44:18.919703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:18.919703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:18.919703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:18.919703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:18.919703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:18.919703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:18.921548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:18.921548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:18.921548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:18.921548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:18.921548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:18.921548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:18.921548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:18.921548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:18.921548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:18.921548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:18.921548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:44:18.921548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:18.921548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 10:44:18.921548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:18.921548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:18.921548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 473/951] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Aug 11 10:44:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:18.927797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f88358-5a1d-4b44-9aaf-ff82c07657fb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:18.951706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:18.981053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ef32c-999b-449b-ac76-18e342f87d5b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:19.022586 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99116482-c491-4067-ab9f-100261b40461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:19.023400 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116482-c491-4067-ab9f-100261b40461 None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:19.023726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116482-c491-4067-ab9f-100261b40461 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:19.024138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116482-c491-4067-ab9f-100261b40461 None admin] PATH_INFO: `/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/9751264123914c27b961009f75067660/roles/0abfe51f95874cceae89482cf378713c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:19.027392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99116482-c491-4067-ab9f-100261b40461 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb12c96bf3a84df0b86967fbe93d1c17, user_id=9751264123914c27b961009f75067660, role_id=0abfe51f95874cceae89482cf378713c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:19.029003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99116482-c491-4067-ab9f-100261b40461 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:19.083210 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f88358-5a1d-4b44-9aaf-ff82c07657fb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:19.109262 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 479/952] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:44:18 2022] PUT /identity/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/9751264123914c27b961009f75067660/roles/0abfe51f95874cceae89482cf378713c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:44:19.126029 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82660091-6fba-4f30-949a-aec0fff1cf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:19.126737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82660091-6fba-4f30-949a-aec0fff1cf89 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:19.127111 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82660091-6fba-4f30-949a-aec0fff1cf89 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:19.127391 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82660091-6fba-4f30-949a-aec0fff1cf89 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:19.128044 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82660091-6fba-4f30-949a-aec0fff1cf89 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:19.128402 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82660091-6fba-4f30-949a-aec0fff1cf89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:19.129980 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82660091-6fba-4f30-949a-aec0fff1cf89 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:19.137129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 474/953] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Aug 11 10:44:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:19.142738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99116482-c491-4067-ab9f-100261b40461 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:19.270284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99116482-c491-4067-ab9f-100261b40461 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:19.308439 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d7f5c-ebb3-40f9-8695-a30c944300a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:19.308978 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d7f5c-ebb3-40f9-8695-a30c944300a2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:19.309251 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d7f5c-ebb3-40f9-8695-a30c944300a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:19.309519 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d7f5c-ebb3-40f9-8695-a30c944300a2 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:19.310159 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d7f5c-ebb3-40f9-8695-a30c944300a2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:19.310459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d7f5c-ebb3-40f9-8695-a30c944300a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:19.311851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d7f5c-ebb3-40f9-8695-a30c944300a2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:19.313183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:19.317814 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 480/954] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Aug 11 10:44:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:19.324365 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82660091-6fba-4f30-949a-aec0fff1cf89 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:19.395842 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:19.437938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82660091-6fba-4f30-949a-aec0fff1cf89 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:19.473213 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746537f-59b8-4388-81bf-e5e0614622c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:19.474159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746537f-59b8-4388-81bf-e5e0614622c2 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:19.474615 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746537f-59b8-4388-81bf-e5e0614622c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:19.475081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746537f-59b8-4388-81bf-e5e0614622c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:19.475942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746537f-59b8-4388-81bf-e5e0614622c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:19.477499 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746537f-59b8-4388-81bf-e5e0614622c2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:19.544327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 475/955] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 10:44:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:44:19.928655 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d256bd-db70-464f-9b0a-b30ba89d9b65 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:19.929210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d256bd-db70-464f-9b0a-b30ba89d9b65 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:19.929210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d256bd-db70-464f-9b0a-b30ba89d9b65 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:19.930674 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 481/956] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:19.936554 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ba875-4862-4f84-ac9e-27f18552041a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:19.936975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ba875-4862-4f84-ac9e-27f18552041a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:19.937185 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ba875-4862-4f84-ac9e-27f18552041a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:19.956358 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1c2ba875-4862-4f84-ac9e-27f18552041a None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:19.957676 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1c2ba875-4862-4f84-ac9e-27f18552041a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:20.043768 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 476/957] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:20.064918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d256bd-db70-464f-9b0a-b30ba89d9b65 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:20.177490 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d256bd-db70-464f-9b0a-b30ba89d9b65 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:20.214281 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75421c-c3ef-45d7-b7aa-e77a31b522c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:20.214859 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75421c-c3ef-45d7-b7aa-e77a31b522c7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:20.215141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75421c-c3ef-45d7-b7aa-e77a31b522c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:20.215412 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75421c-c3ef-45d7-b7aa-e77a31b522c7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:20.215996 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75421c-c3ef-45d7-b7aa-e77a31b522c7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:20.217422 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75421c-c3ef-45d7-b7aa-e77a31b522c7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:20.226531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-5c75421c-c3ef-45d7-b7aa-e77a31b522c7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 10:44:20.226531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:20.226531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:44:20.226531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:44:20.226531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:44:20.226531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:44:20.226531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:44:20.226531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:20.226531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 10:44:20.226531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:20.226531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:20.226531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:20.226531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:20.226531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:20.226531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:20.226531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:20.226531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:20.227682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:20.227682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:20.227682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:20.227682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:20.227682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:20.227682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:20.227682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:44:20.227682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:44:20.227682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:44:20.227682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:44:20.227682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:20.227682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:20.227682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:20.227682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:20.227682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:20.227682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:20.228630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:20.228630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:20.228630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:20.228630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:20.228630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:20.228630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:20.228630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:20.228630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:20.228630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:20.228630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:20.228630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:44:20.228630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:20.228630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 10:44:20.228630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:20.228630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 482/958] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:44:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:20.236735 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ba875-4862-4f84-ac9e-27f18552041a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:20.284683 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:20.343968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ba875-4862-4f84-ac9e-27f18552041a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:20.379976 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ce9a8-85fc-4a73-80d6-120043685478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:20.380587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ce9a8-85fc-4a73-80d6-120043685478 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:20.380865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ce9a8-85fc-4a73-80d6-120043685478 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:20.381132 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ce9a8-85fc-4a73-80d6-120043685478 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:20.381761 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ce9a8-85fc-4a73-80d6-120043685478 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:20.382056 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ce9a8-85fc-4a73-80d6-120043685478 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:20.383446 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ce9a8-85fc-4a73-80d6-120043685478 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:20.389187 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 477/959] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Aug 11 10:44:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:20.394990 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75421c-c3ef-45d7-b7aa-e77a31b522c7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:20.459479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:20.500339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75421c-c3ef-45d7-b7aa-e77a31b522c7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:20.535248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67836e94-a887-4618-983c-1651be8b08ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:20.535864 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67836e94-a887-4618-983c-1651be8b08ec None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:20.536144 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67836e94-a887-4618-983c-1651be8b08ec None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:20.536418 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67836e94-a887-4618-983c-1651be8b08ec None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:20.537052 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67836e94-a887-4618-983c-1651be8b08ec None admin] RBAC: Adding query filter params (type=compute) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:20.537354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67836e94-a887-4618-983c-1651be8b08ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:20.538795 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67836e94-a887-4618-983c-1651be8b08ec None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:20.544392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 483/960] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Aug 11 10:44:20 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:20.863973 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f98b3-a584-4069-ba20-3f0fba83f208 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:20.864354 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f98b3-a584-4069-ba20-3f0fba83f208 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:20.864538 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f98b3-a584-4069-ba20-3f0fba83f208 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:20.866144 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 478/961] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:20.872313 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0f510-be21-49f3-86a4-6b75097e98c6 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:20.872608 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0f510-be21-49f3-86a4-6b75097e98c6 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:20.872890 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f0f510-be21-49f3-86a4-6b75097e98c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:20.891453 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-21f0f510-be21-49f3-86a4-6b75097e98c6 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:20.892645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-21f0f510-be21-49f3-86a4-6b75097e98c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:20.967177 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 484/962] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:20.990865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f98b3-a584-4069-ba20-3f0fba83f208 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:21.104945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f98b3-a584-4069-ba20-3f0fba83f208 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:21.115722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:21.142407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be663ee2-99d1-4971-8a9b-395712cdf21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:21.143044 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be663ee2-99d1-4971-8a9b-395712cdf21e None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:21.143325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be663ee2-99d1-4971-8a9b-395712cdf21e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:21.143596 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be663ee2-99d1-4971-8a9b-395712cdf21e None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:21.144238 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be663ee2-99d1-4971-8a9b-395712cdf21e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:21.145726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be663ee2-99d1-4971-8a9b-395712cdf21e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:21.199411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.sql.core [None req-be663ee2-99d1-4971-8a9b-395712cdf21e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 11 10:44:21.199411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 11 10:44:21.199411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [parameters: {'user_id': '6db6c3196d6e403bb13ca10265fc2a5a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 11 10:44:21.199411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81638) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 11 10:44:21.206448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-be663ee2-99d1-4971-8a9b-395712cdf21e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 11 10:44:21.206448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:21.206448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 10:44:21.206448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 10:44:21.206448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 10:44:21.206448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 10:44:21.206448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 10:44:21.206448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 10:44:21.206448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 10:44:21.206448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application conn.query(q) Aug 11 10:44:21.206448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 10:44:21.206448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 10:44:21.206448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 10:44:21.206448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application result.read() Aug 11 10:44:21.206448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 10:44:21.208419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 10:44:21.208419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 10:44:21.208419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 10:44:21.208419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 10:44:21.208419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 10:44:21.208419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 10:44:21.208419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 10:44:21.208419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 11 10:44:21.208419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:21.208419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 11 10:44:21.208419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:21.208419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:21.208419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 11 10:44:21.208419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 11 10:44:21.208419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 11 10:44:21.208419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 11 10:44:21.208419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 10:44:21.208419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application next(self.gen) Aug 11 10:44:21.210154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 11 10:44:21.210154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application yield resource Aug 11 10:44:21.210154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 11 10:44:21.210154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application next(self.gen) Aug 11 10:44:21.210154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 11 10:44:21.210154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.session.rollback() Aug 11 10:44:21.210154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 11 10:44:21.210154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.force_reraise() Aug 11 10:44:21.210154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 11 10:44:21.210154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise self.value Aug 11 10:44:21.210154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 11 10:44:21.210154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 11 10:44:21.210154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 11 10:44:21.210154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application session.commit() Aug 11 10:44:21.210154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 11 10:44:21.210154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 11 10:44:21.210154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 11 10:44:21.211729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._prepare_impl() Aug 11 10:44:21.211729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 11 10:44:21.211729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.session.flush() Aug 11 10:44:21.211729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 11 10:44:21.211729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._flush(objects) Aug 11 10:44:21.211729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 11 10:44:21.211729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 11 10:44:21.211729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 11 10:44:21.211729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application compat.raise_( Aug 11 10:44:21.211729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 10:44:21.211729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception Aug 11 10:44:21.211729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 11 10:44:21.211729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application flush_context.execute() Aug 11 10:44:21.211729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 11 10:44:21.211729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rec.execute(self) Aug 11 10:44:21.211729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 11 10:44:21.211729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 11 10:44:21.214143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 11 10:44:21.214143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 11 10:44:21.214143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 11 10:44:21.214143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 11 10:44:21.214143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 11 10:44:21.214143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 11 10:44:21.214143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 11 10:44:21.214143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 11 10:44:21.214143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 11 10:44:21.214143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 11 10:44:21.214143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 11 10:44:21.214143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 11 10:44:21.214143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 11 10:44:21.214143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 11 10:44:21.214143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 11 10:44:21.214143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception Aug 11 10:44:21.216153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 11 10:44:21.216153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 11 10:44:21.216153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 11 10:44:21.216153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 11 10:44:21.216153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 11 10:44:21.216153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application result = self._query(query) Aug 11 10:44:21.216153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 11 10:44:21.216153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application conn.query(q) Aug 11 10:44:21.216153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 11 10:44:21.216153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 11 10:44:21.216153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 11 10:44:21.216153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application result.read() Aug 11 10:44:21.216153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 11 10:44:21.216153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 11 10:44:21.216153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 11 10:44:21.216153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 11 10:44:21.223129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 11 10:44:21.223129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 11 10:44:21.223129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 11 10:44:21.223129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 11 10:44:21.223129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 11 10:44:21.223129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 11 10:44:21.223129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [parameters: {'user_id': '6db6c3196d6e403bb13ca10265fc2a5a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 11 10:44:21.223129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 11 10:44:21.223129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:21.223129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:21.223129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:21.223129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:21.223129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:21.223129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:21.223129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:21.225068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:21.225068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:21.225068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:21.225068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:21.225068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:21.225068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:21.225068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:21.225068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 11 10:44:21.225068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 11 10:44:21.225068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:21.225068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:21.225068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:44:21.225068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:21.225068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:44:21.225068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:21.225068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 11 10:44:21.225068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 11 10:44:21.227289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 11 10:44:21.227289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 11 10:44:21.227289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 11 10:44:21.227289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 11 10:44:21.227289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 11 10:44:21.227289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:21.227289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 479/963] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Aug 11 10:44:20 2022] POST /identity/v3/users => generated 160 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:21.228392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0f510-be21-49f3-86a4-6b75097e98c6 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:21.255007 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ad17e-b38c-43b7-931b-8e11a5af31c4 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:21.255338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ad17e-b38c-43b7-931b-8e11a5af31c4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:21.255596 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ad17e-b38c-43b7-931b-8e11a5af31c4 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:21.261851 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 480/964] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:21.267695 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bf0c9-e46a-48a2-8897-6fcb017d3ad3 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:21.268048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bf0c9-e46a-48a2-8897-6fcb017d3ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:21.268392 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bf0c9-e46a-48a2-8897-6fcb017d3ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:21.291170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-824bf0c9-e46a-48a2-8897-6fcb017d3ad3 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:21.292838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-824bf0c9-e46a-48a2-8897-6fcb017d3ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:21.319421 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:21.330067 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f0f510-be21-49f3-86a4-6b75097e98c6 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:21.375285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe43d65-fefa-4358-96bc-37feef0700a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:21.376009 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe43d65-fefa-4358-96bc-37feef0700a0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:21.376353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe43d65-fefa-4358-96bc-37feef0700a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:21.376657 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 481/965] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 10:44:21.376943 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe43d65-fefa-4358-96bc-37feef0700a0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:21.390746 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe43d65-fefa-4358-96bc-37feef0700a0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:21.392422 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe43d65-fefa-4358-96bc-37feef0700a0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:21.403691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bf0c9-e46a-48a2-8897-6fcb017d3ad3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:21.405985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-cbe43d65-fefa-4358-96bc-37feef0700a0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 10:44:21.405985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:21.405985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:21.405985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:21.405985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:21.405985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:21.405985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:21.405985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:21.405985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:21.405985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:21.405985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:21.405985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:21.405985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:44:21.405985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:44:21.405985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:44:21.405985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:44:21.407779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:21.407779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:21.407779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:44:21.407779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:21.407779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:44:21.407779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:21.407779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:21.407779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:21.407779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:21.407779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:21.407779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:21.407779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:21.407779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:21.407779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:21.407779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:21.407779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:21.407779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:21.407779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:21.409595 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:21.409595 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:21.409595 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:44:21.409595 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:44:21.409595 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:44:21.409595 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:44:21.409595 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:44:21.409595 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:44:21.409595 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 11 10:44:21.409595 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:21.409595 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 485/966] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:44:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:21.414917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe43d65-fefa-4358-96bc-37feef0700a0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:21.510514 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:21.514605 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bf0c9-e46a-48a2-8897-6fcb017d3ad3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:21.522713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe43d65-fefa-4358-96bc-37feef0700a0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:21.541515 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:21.550971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931009c-2fef-43dd-821f-2dd52894ef76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:21.551802 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931009c-2fef-43dd-821f-2dd52894ef76 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:21.552258 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931009c-2fef-43dd-821f-2dd52894ef76 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:21.552669 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931009c-2fef-43dd-821f-2dd52894ef76 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:21.561873 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63994155-053c-473c-8644-11d07875c5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:21.562492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63994155-053c-473c-8644-11d07875c5ae None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:21.562801 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63994155-053c-473c-8644-11d07875c5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:21.563078 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63994155-053c-473c-8644-11d07875c5ae None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:21.563783 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63994155-053c-473c-8644-11d07875c5ae None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:21.564087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63994155-053c-473c-8644-11d07875c5ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:21.565515 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931009c-2fef-43dd-821f-2dd52894ef76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:44:21.565635 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63994155-053c-473c-8644-11d07875c5ae None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:21.570827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-d931009c-2fef-43dd-821f-2dd52894ef76 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 10:44:21.570827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:21.570827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:21.570827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:21.570827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:21.570827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:21.570827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:21.570827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:21.570827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:21.570827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:21.570827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:21.570827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:21.570827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:44:21.570827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:44:21.570827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:44:21.570827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:44:21.572048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:44:21.572048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:44:21.572048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:44:21.572048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:44:21.572048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:21.572048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:21.572048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:21.572048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:21.572048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:21.572048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:21.572048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:21.572048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:21.572048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:21.572048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:21.572048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:21.572048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:21.573042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:21.573042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:21.573042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:21.573042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:21.573042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:44:21.573042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:44:21.573042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:44:21.573042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:44:21.573042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:44:21.573042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:44:21.573042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 10:44:21.573042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:21.580237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 482/967] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Aug 11 10:44:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:21.580987 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931009c-2fef-43dd-821f-2dd52894ef76 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:21.614873 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 486/968] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Aug 11 10:44:21 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:21.705031 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931009c-2fef-43dd-821f-2dd52894ef76 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:21.745985 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b7c27-ffbb-4d9c-885b-67333513e77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:21.746675 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957032a1-8c5d-4684-953b-7d96bda86a17 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:21.746993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957032a1-8c5d-4684-953b-7d96bda86a17 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:21.747267 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957032a1-8c5d-4684-953b-7d96bda86a17 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:21.747833 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b7c27-ffbb-4d9c-885b-67333513e77f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:21.748325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b7c27-ffbb-4d9c-885b-67333513e77f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:21.748868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 487/969] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:21.749130 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b7c27-ffbb-4d9c-885b-67333513e77f None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:21.750075 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b7c27-ffbb-4d9c-885b-67333513e77f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:21.750584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b7c27-ffbb-4d9c-885b-67333513e77f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:21.752319 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748b7c27-ffbb-4d9c-885b-67333513e77f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:21.754430 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0d97b-8504-4e47-bc53-c32e5e316cb0 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:21.754719 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0d97b-8504-4e47-bc53-c32e5e316cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:21.755033 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0d97b-8504-4e47-bc53-c32e5e316cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:21.764244 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 483/970] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Aug 11 10:44:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:21.773055 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b7c27-ffbb-4d9c-885b-67333513e77f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:21.776399 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-8ae0d97b-8504-4e47-bc53-c32e5e316cb0 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:21.777593 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8ae0d97b-8504-4e47-bc53-c32e5e316cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:21.804985 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:21.861285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 488/971] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 10:44:21.884397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0d97b-8504-4e47-bc53-c32e5e316cb0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:21.909335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b7c27-ffbb-4d9c-885b-67333513e77f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:21.948046 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0567303-f8f7-49f9-b2e1-a56603cffc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:21.948689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0567303-f8f7-49f9-b2e1-a56603cffc20 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:21.948974 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0567303-f8f7-49f9-b2e1-a56603cffc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:21.949249 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0567303-f8f7-49f9-b2e1-a56603cffc20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:21.959784 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0567303-f8f7-49f9-b2e1-a56603cffc20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:21.961181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0567303-f8f7-49f9-b2e1-a56603cffc20 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:21.976823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c0567303-f8f7-49f9-b2e1-a56603cffc20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:21.976823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:21.976823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:21.976823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:21.976823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:21.976823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:21.976823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:21.976823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:21.976823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:21.976823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:21.976823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:21.976823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:21.976823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:21.976823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:21.976823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:21.976823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:21.977795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:21.977795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:21.977795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:21.977795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:21.977795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:21.977795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:21.977795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:21.977795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:21.977795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:21.977795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:21.977795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:21.977795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:21.977795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:21.977795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:21.977795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:21.977795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:21.977795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:21.983715 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:21.983715 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:21.983715 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:21.983715 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 484/972] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:21.985545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0567303-f8f7-49f9-b2e1-a56603cffc20 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:22.014221 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0d97b-8504-4e47-bc53-c32e5e316cb0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:22.018444 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:22.058551 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86100516-b803-4123-af1c-cc721e2b34ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:22.059220 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86100516-b803-4123-af1c-cc721e2b34ce None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:22.059499 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86100516-b803-4123-af1c-cc721e2b34ce None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:22.059774 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86100516-b803-4123-af1c-cc721e2b34ce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:22.060422 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86100516-b803-4123-af1c-cc721e2b34ce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:22.062183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86100516-b803-4123-af1c-cc721e2b34ce None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:22.070850 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:22.072283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-86100516-b803-4123-af1c-cc721e2b34ce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 10:44:22.072283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:22.072283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:44:22.072283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:44:22.072283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:44:22.072283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:44:22.072283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:44:22.072283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:22.072283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 10:44:22.072283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:22.072283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:22.072283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:22.072283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:22.072283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:22.072283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:22.072283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:22.072283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:22.073480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:22.073480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:22.073480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:22.073480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:22.073480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:22.073480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:22.073480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:44:22.073480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:44:22.073480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:44:22.073480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:44:22.073480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:22.073480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:22.073480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:22.073480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:22.073480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:22.073480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:22.079877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:22.079877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:22.079877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:22.079877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:22.079877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:22.079877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:22.079877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:22.079877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:22.079877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:22.079877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:22.079877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:44:22.079877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:22.079877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 10:44:22.079877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:22.079877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 489/973] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Aug 11 10:44:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:22.080911 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86100516-b803-4123-af1c-cc721e2b34ce None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:22.097832 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0567303-f8f7-49f9-b2e1-a56603cffc20 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:22.134991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd395f-7f46-45bb-a92e-a69fc08598af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:22.135591 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd395f-7f46-45bb-a92e-a69fc08598af None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:22.135870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd395f-7f46-45bb-a92e-a69fc08598af None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:22.136141 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd395f-7f46-45bb-a92e-a69fc08598af None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:22.136780 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd395f-7f46-45bb-a92e-a69fc08598af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:22.137078 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd395f-7f46-45bb-a92e-a69fc08598af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:22.138669 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd395f-7f46-45bb-a92e-a69fc08598af None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:22.156153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 485/974] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:22.157042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd395f-7f46-45bb-a92e-a69fc08598af None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:22.182666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86100516-b803-4123-af1c-cc721e2b34ce None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:22.217722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d48bf-47cf-4a25-9c26-3ee0910d53ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:22.218245 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d48bf-47cf-4a25-9c26-3ee0910d53ce None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:22.218522 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d48bf-47cf-4a25-9c26-3ee0910d53ce None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:22.218825 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d48bf-47cf-4a25-9c26-3ee0910d53ce None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:22.219457 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d48bf-47cf-4a25-9c26-3ee0910d53ce None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:22.219757 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d48bf-47cf-4a25-9c26-3ee0910d53ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:22.221122 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d48bf-47cf-4a25-9c26-3ee0910d53ce None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:22.226053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 490/975] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Aug 11 10:44:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:22.231323 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d48bf-47cf-4a25-9c26-3ee0910d53ce None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:22.262598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:22.263640 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd395f-7f46-45bb-a92e-a69fc08598af None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:22.301080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8843e14-dbc0-47a2-8243-f4bae8b514f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:22.301724 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8843e14-dbc0-47a2-8243-f4bae8b514f0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:22.302006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8843e14-dbc0-47a2-8243-f4bae8b514f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:22.302302 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8843e14-dbc0-47a2-8243-f4bae8b514f0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:22.305136 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:22.312049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8843e14-dbc0-47a2-8243-f4bae8b514f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:22.313383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8843e14-dbc0-47a2-8243-f4bae8b514f0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:22.324959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b8843e14-dbc0-47a2-8243-f4bae8b514f0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 10:44:22.324959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:22.324959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:22.324959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:22.324959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:22.324959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:22.324959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:22.324959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:22.324959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:22.324959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:22.324959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:22.324959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:22.324959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:44:22.324959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:44:22.324959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:44:22.324959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:44:22.325900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:22.325900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:22.325900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:44:22.325900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:22.325900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:44:22.325900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:22.325900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:22.325900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:22.325900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:22.325900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:22.325900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:22.325900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:22.325900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:22.325900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:22.325900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:22.325900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:22.325900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:22.325900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:22.326853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:22.326853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:22.326853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:44:22.326853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:44:22.326853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:44:22.326853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:44:22.326853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:44:22.326853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:44:22.326853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 11 10:44:22.326853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:22.326853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 486/976] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Aug 11 10:44:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:22.331793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8843e14-dbc0-47a2-8243-f4bae8b514f0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:22.340100 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d48bf-47cf-4a25-9c26-3ee0910d53ce None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:22.375927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47757f70-b031-4327-a70f-f21c211c369d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:22.376541 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47757f70-b031-4327-a70f-f21c211c369d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:22.377248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47757f70-b031-4327-a70f-f21c211c369d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:22.377248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47757f70-b031-4327-a70f-f21c211c369d None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:22.377797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47757f70-b031-4327-a70f-f21c211c369d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:22.378102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47757f70-b031-4327-a70f-f21c211c369d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:22.379594 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47757f70-b031-4327-a70f-f21c211c369d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:22.385068 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 491/977] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Aug 11 10:44:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:22.391137 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47757f70-b031-4327-a70f-f21c211c369d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:22.441293 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8843e14-dbc0-47a2-8243-f4bae8b514f0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:22.476869 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de53b1-7601-4b2e-924a-eda02fa372b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:22.477404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de53b1-7601-4b2e-924a-eda02fa372b9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:22.478462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de53b1-7601-4b2e-924a-eda02fa372b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:22.479145 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de53b1-7601-4b2e-924a-eda02fa372b9 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:22.479880 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de53b1-7601-4b2e-924a-eda02fa372b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:22.480504 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de53b1-7601-4b2e-924a-eda02fa372b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:22.481933 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de53b1-7601-4b2e-924a-eda02fa372b9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:22.498828 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:22.499566 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 487/978] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Aug 11 10:44:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:22.505226 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de53b1-7601-4b2e-924a-eda02fa372b9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:22.505362 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47757f70-b031-4327-a70f-f21c211c369d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:22.548315 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbce359-8414-4c18-ab74-029d7cab84e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:22.549072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbce359-8414-4c18-ab74-029d7cab84e7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:22.549320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbce359-8414-4c18-ab74-029d7cab84e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:22.549590 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbce359-8414-4c18-ab74-029d7cab84e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:22.550307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbce359-8414-4c18-ab74-029d7cab84e7 None admin] RBAC: Adding query filter params (interface=admin, service_id=5edd9ec3dbfc487e88fdb9bfb44db2a0, region_id=RegionOne) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:22.550884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbce359-8414-4c18-ab74-029d7cab84e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:22.552072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbce359-8414-4c18-ab74-029d7cab84e7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:22.557660 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 492/979] 10.222.0.43 () {56 vars in 1249 bytes} [Thu Aug 11 10:44:22 2022] GET /identity/v3/endpoints?service_id=5edd9ec3dbfc487e88fdb9bfb44db2a0&interface=admin®ion_id=RegionOne => generated 193 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:22.562906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbce359-8414-4c18-ab74-029d7cab84e7 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:22.563894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:22.616875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de53b1-7601-4b2e-924a-eda02fa372b9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:22.654726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3175b43-7ec0-43f1-8056-00d60fb06a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:22.655388 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3175b43-7ec0-43f1-8056-00d60fb06a84 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:22.655668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3175b43-7ec0-43f1-8056-00d60fb06a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:22.655938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3175b43-7ec0-43f1-8056-00d60fb06a84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:22.663386 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbce359-8414-4c18-ab74-029d7cab84e7 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:22.695960 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe71ee-c4b7-4dc3-bd4b-b70c2e2858b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:22.697085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe71ee-c4b7-4dc3-bd4b-b70c2e2858b3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:22.697364 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe71ee-c4b7-4dc3-bd4b-b70c2e2858b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:22.697630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe71ee-c4b7-4dc3-bd4b-b70c2e2858b3 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:22.698226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe71ee-c4b7-4dc3-bd4b-b70c2e2858b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:22.699619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe71ee-c4b7-4dc3-bd4b-b70c2e2858b3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:22.705405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 493/980] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Aug 11 10:44:22 2022] GET /identity/v3/services => generated 1497 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:44:22.706560 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b354323-88e5-4afd-ba2b-1a9ddc79062f None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:22.706862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b354323-88e5-4afd-ba2b-1a9ddc79062f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:22.707136 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b354323-88e5-4afd-ba2b-1a9ddc79062f None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:22.708317 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 494/981] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:22.714590 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f72a7-e2f9-4130-a7a6-c3ace398084e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:22.714900 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f72a7-e2f9-4130-a7a6-c3ace398084e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:22.715176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f72a7-e2f9-4130-a7a6-c3ace398084e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:22.734104 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-553f72a7-e2f9-4130-a7a6-c3ace398084e None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:22.734547 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3175b43-7ec0-43f1-8056-00d60fb06a84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:22.735262 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-553f72a7-e2f9-4130-a7a6-c3ace398084e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:22.736374 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3175b43-7ec0-43f1-8056-00d60fb06a84 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:22.758011 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:22.797411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:22.814032 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 495/982] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 10:44:22.837713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f72a7-e2f9-4130-a7a6-c3ace398084e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:22.854345 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 488/983] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:44:22 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 11 10:44:22.855773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3175b43-7ec0-43f1-8056-00d60fb06a84 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:22.954879 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f72a7-e2f9-4130-a7a6-c3ace398084e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:22.974689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3175b43-7ec0-43f1-8056-00d60fb06a84 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:22.990788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c829a-47df-4beb-b1d3-fadb23dd963b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:22.991336 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c829a-47df-4beb-b1d3-fadb23dd963b None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:22.991617 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c829a-47df-4beb-b1d3-fadb23dd963b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:22.991889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c829a-47df-4beb-b1d3-fadb23dd963b None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:22.992538 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c829a-47df-4beb-b1d3-fadb23dd963b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:22.994436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c829a-47df-4beb-b1d3-fadb23dd963b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:23.013794 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eafdc0-a580-4c0e-83a1-58ea673bbfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:23.014493 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eafdc0-a580-4c0e-83a1-58ea673bbfdb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:23.014716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eafdc0-a580-4c0e-83a1-58ea673bbfdb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:23.015017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eafdc0-a580-4c0e-83a1-58ea673bbfdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:23.025754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eafdc0-a580-4c0e-83a1-58ea673bbfdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:23.027268 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eafdc0-a580-4c0e-83a1-58ea673bbfdb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:23.043878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-82eafdc0-a580-4c0e-83a1-58ea673bbfdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:23.043878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:23.043878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:23.043878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:23.043878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:23.043878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:23.043878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:23.043878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:23.043878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:23.043878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:23.043878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:23.043878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:23.043878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:23.043878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:23.043878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:23.043878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:23.044813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:23.044813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:23.044813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:23.044813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:23.044813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:23.044813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:23.044813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:23.044813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:23.044813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:23.044813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:23.044813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:23.044813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:23.044813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:23.044813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:23.044813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:23.044813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:23.044813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:23.045714 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:23.045714 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:23.045714 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:23.045714 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 489/984] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:23.050432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eafdc0-a580-4c0e-83a1-58ea673bbfdb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:23.053923 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:23.064078 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 496/985] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Aug 11 10:44:22 2022] POST /identity/v3/services => generated 242 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:44:23.172529 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eafdc0-a580-4c0e-83a1-58ea673bbfdb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:23.217578 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12757de0-47e0-47fc-a016-7025a2088fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:23.218200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12757de0-47e0-47fc-a016-7025a2088fbb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:23.218486 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12757de0-47e0-47fc-a016-7025a2088fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:23.218791 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12757de0-47e0-47fc-a016-7025a2088fbb None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:23.219443 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12757de0-47e0-47fc-a016-7025a2088fbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:23.219748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12757de0-47e0-47fc-a016-7025a2088fbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:23.221111 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12757de0-47e0-47fc-a016-7025a2088fbb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:23.235914 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 490/986] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:23.241713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c829a-47df-4beb-b1d3-fadb23dd963b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:23.259141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:23.347497 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c829a-47df-4beb-b1d3-fadb23dd963b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:23.382272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038454b-859b-41a5-9d48-e8c18f97dfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:23.382948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038454b-859b-41a5-9d48-e8c18f97dfad None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:23.383233 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038454b-859b-41a5-9d48-e8c18f97dfad None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:23.383507 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038454b-859b-41a5-9d48-e8c18f97dfad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:23.391031 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038454b-859b-41a5-9d48-e8c18f97dfad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:23.392478 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038454b-859b-41a5-9d48-e8c18f97dfad None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:23.404270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-c038454b-859b-41a5-9d48-e8c18f97dfad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:23.404270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:23.404270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:23.404270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:23.404270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:23.404270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:23.404270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:23.404270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:23.404270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:23.404270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:23.404270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:23.404270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:23.404270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:44:23.404270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:44:23.404270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:44:23.405238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:44:23.405238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:23.405238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:23.405238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:23.405238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:23.405238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:23.405238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:23.405238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:23.405238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:23.405238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:23.405238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:23.405238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:23.405238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:23.405238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:23.405238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:23.405238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:23.405238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:23.406085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:44:23.406085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:44:23.406085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:44:23.406085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:44:23.406085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:44:23.406085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:44:23.406085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:23.406085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:23.406085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 497/987] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:44:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:23.412462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12757de0-47e0-47fc-a016-7025a2088fbb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:23.474925 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:23.516614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12757de0-47e0-47fc-a016-7025a2088fbb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:23.553439 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb5e73-cbed-4559-81b8-0402d08ae001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:23.554053 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb5e73-cbed-4559-81b8-0402d08ae001 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:23.554333 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb5e73-cbed-4559-81b8-0402d08ae001 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:23.554604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb5e73-cbed-4559-81b8-0402d08ae001 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:23.555324 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fb5e73-cbed-4559-81b8-0402d08ae001 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:23.555712 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fb5e73-cbed-4559-81b8-0402d08ae001 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:23.557619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fb5e73-cbed-4559-81b8-0402d08ae001 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:23.569891 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 491/988] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:44:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:23.575694 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038454b-859b-41a5-9d48-e8c18f97dfad None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:23.653023 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:23.678335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038454b-859b-41a5-9d48-e8c18f97dfad None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:23.712771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eafc09-acdb-4176-9419-04fada731da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:23.713377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eafc09-acdb-4176-9419-04fada731da5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:23.713656 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eafc09-acdb-4176-9419-04fada731da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:23.713931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eafc09-acdb-4176-9419-04fada731da5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:23.714651 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eafc09-acdb-4176-9419-04fada731da5 None admin] RBAC: Adding query filter params (role.id=0abfe51f95874cceae89482cf378713c, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=9751264123914c27b961009f75067660) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:23.715002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eafc09-acdb-4176-9419-04fada731da5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:23.716435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eafc09-acdb-4176-9419-04fada731da5 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:23.730783 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 498/989] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:44:23 2022] GET /identity/v3/role_assignments?user.id=9751264123914c27b961009f75067660&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=0abfe51f95874cceae89482cf378713c => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:24.732261 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844aa38b-ce4c-435b-95f6-49441f99a464 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:24.732782 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844aa38b-ce4c-435b-95f6-49441f99a464 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:24.732782 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844aa38b-ce4c-435b-95f6-49441f99a464 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:24.734550 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 492/990] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:24.739596 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff8383-93ae-41ed-91dd-0e4b2a167024 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:24.739990 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff8383-93ae-41ed-91dd-0e4b2a167024 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:24.740147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff8383-93ae-41ed-91dd-0e4b2a167024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:24.759964 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-56ff8383-93ae-41ed-91dd-0e4b2a167024 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:24.770465 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-56ff8383-93ae-41ed-91dd-0e4b2a167024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:24.830143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 499/991] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:24.852090 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844aa38b-ce4c-435b-95f6-49441f99a464 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:24.955026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844aa38b-ce4c-435b-95f6-49441f99a464 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:24.975487 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:25.007594 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ac380-033e-4904-ae19-666fe6700b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:25.007594 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ac380-033e-4904-ae19-666fe6700b1b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:25.007594 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ac380-033e-4904-ae19-666fe6700b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:25.007594 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ac380-033e-4904-ae19-666fe6700b1b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:25.008021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ac380-033e-4904-ae19-666fe6700b1b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:25.008021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ac380-033e-4904-ae19-666fe6700b1b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:25.008021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ab0ac380-033e-4904-ae19-666fe6700b1b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 10:44:25.008021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:25.008021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:44:25.008021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:44:25.008021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:44:25.008021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:44:25.008021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:44:25.008021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:25.008021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 10:44:25.008021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:25.008021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:25.009241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:25.009241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:25.009241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:25.009241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:25.009241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:25.009241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:25.009241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:25.009241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:25.009241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:25.009241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:25.009241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:25.009241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:25.009241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:44:25.009241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:44:25.009241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:44:25.009241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:44:25.009241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:25.010124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:25.010124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:25.010124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:25.010124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:25.010124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:25.010124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:25.010124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:25.010124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:25.010124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:25.010124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:25.010124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:25.010124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:25.010124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:25.010124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:25.010124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:25.010124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:44:25.010124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:25.011149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 11 10:44:25.011149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:25.011149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 493/992] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Aug 11 10:44:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:25.011324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff8383-93ae-41ed-91dd-0e4b2a167024 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:25.085193 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:25.101534 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a8b68-8344-4368-9aa2-cf279dfede0d None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:25.101823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a8b68-8344-4368-9aa2-cf279dfede0d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:25.102105 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a8b68-8344-4368-9aa2-cf279dfede0d None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:25.103852 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 494/993] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:44:25.108814 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf12258-68f8-419b-832a-5db4e5d9667c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:25.109107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf12258-68f8-419b-832a-5db4e5d9667c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:25.109387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf12258-68f8-419b-832a-5db4e5d9667c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:25.121095 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff8383-93ae-41ed-91dd-0e4b2a167024 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:25.128287 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9cf12258-68f8-419b-832a-5db4e5d9667c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:25.129476 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9cf12258-68f8-419b-832a-5db4e5d9667c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:25.157823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc3b67-56ab-4c22-870a-4d52dddbec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:25.158427 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc3b67-56ab-4c22-870a-4d52dddbec3b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:25.158706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc3b67-56ab-4c22-870a-4d52dddbec3b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:25.159008 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc3b67-56ab-4c22-870a-4d52dddbec3b None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:25.159636 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc3b67-56ab-4c22-870a-4d52dddbec3b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:25.159946 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc3b67-56ab-4c22-870a-4d52dddbec3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:25.161294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc3b67-56ab-4c22-870a-4d52dddbec3b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:25.166272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 500/994] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Aug 11 10:44:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:25.171806 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc3b67-56ab-4c22-870a-4d52dddbec3b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:25.207261 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 495/995] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:25 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:25.230471 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf12258-68f8-419b-832a-5db4e5d9667c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:25.275513 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc3b67-56ab-4c22-870a-4d52dddbec3b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:25.306127 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:25.311014 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96099a39-2fa1-451e-a3b3-ede640e8f51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:25.311620 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96099a39-2fa1-451e-a3b3-ede640e8f51a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:25.311906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96099a39-2fa1-451e-a3b3-ede640e8f51a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:25.312250 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96099a39-2fa1-451e-a3b3-ede640e8f51a None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:25.312789 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96099a39-2fa1-451e-a3b3-ede640e8f51a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:25.313085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96099a39-2fa1-451e-a3b3-ede640e8f51a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:25.314439 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96099a39-2fa1-451e-a3b3-ede640e8f51a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:25.319337 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 501/996] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Aug 11 10:44:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:25.324707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96099a39-2fa1-451e-a3b3-ede640e8f51a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:25.344824 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf12258-68f8-419b-832a-5db4e5d9667c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:25.361766 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:25.383324 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e07f9-cd8e-40d6-8a89-b6d376219a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:25.384536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e07f9-cd8e-40d6-8a89-b6d376219a3c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:25.384819 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e07f9-cd8e-40d6-8a89-b6d376219a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:25.385084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e07f9-cd8e-40d6-8a89-b6d376219a3c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:25.385654 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e07f9-cd8e-40d6-8a89-b6d376219a3c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:25.387044 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e07f9-cd8e-40d6-8a89-b6d376219a3c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:25.395830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-945e07f9-cd8e-40d6-8a89-b6d376219a3c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 10:44:25.395830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:25.395830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:44:25.395830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:44:25.395830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:44:25.395830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:44:25.395830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:44:25.395830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:25.395830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 10:44:25.395830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:25.395830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:25.395830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:25.395830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:25.395830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:25.395830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:25.395830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:25.395830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:25.396828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:25.396828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:25.396828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:25.396828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:25.396828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:25.396828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:25.396828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:44:25.396828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:44:25.396828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:44:25.396828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:44:25.396828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:25.396828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:25.396828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:25.396828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:25.396828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:25.396828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:25.397680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:25.397680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:25.397680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:25.397680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:25.397680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:25.397680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:25.397680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:25.397680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:25.397680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:25.397680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:25.397680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:44:25.397680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:25.397680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 10:44:25.397680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:25.397680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 496/997] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:44:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:25.402789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e07f9-cd8e-40d6-8a89-b6d376219a3c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:25.432404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96099a39-2fa1-451e-a3b3-ede640e8f51a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:25.467426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f18fe-c306-4630-bf32-1a9e71192388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:25.468037 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f18fe-c306-4630-bf32-1a9e71192388 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:25.468318 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f18fe-c306-4630-bf32-1a9e71192388 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:25.468591 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f18fe-c306-4630-bf32-1a9e71192388 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:25.469247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f18fe-c306-4630-bf32-1a9e71192388 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:25.470615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f18fe-c306-4630-bf32-1a9e71192388 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:25.504180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e07f9-cd8e-40d6-8a89-b6d376219a3c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:25.537188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda6142-e926-43ec-8eb8-1822b1aa25de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:25.537723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda6142-e926-43ec-8eb8-1822b1aa25de None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:25.538001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda6142-e926-43ec-8eb8-1822b1aa25de None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:25.538271 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda6142-e926-43ec-8eb8-1822b1aa25de None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:25.538927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda6142-e926-43ec-8eb8-1822b1aa25de None admin] RBAC: Adding query filter params (name=compute) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:25.539226 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda6142-e926-43ec-8eb8-1822b1aa25de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:25.541206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda6142-e926-43ec-8eb8-1822b1aa25de None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:25.547325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 497/998] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Aug 11 10:44:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:25.556528 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 502/999] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 10:44:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:44:25.556733 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda6142-e926-43ec-8eb8-1822b1aa25de None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:25.604674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:25.667671 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda6142-e926-43ec-8eb8-1822b1aa25de None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:25.712948 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457716d3-ab84-4a38-98a8-1f128c23dce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:25.713562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457716d3-ab84-4a38-98a8-1f128c23dce8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:25.713846 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457716d3-ab84-4a38-98a8-1f128c23dce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:25.714121 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457716d3-ab84-4a38-98a8-1f128c23dce8 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:25.714745 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457716d3-ab84-4a38-98a8-1f128c23dce8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:25.715075 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457716d3-ab84-4a38-98a8-1f128c23dce8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:25.716511 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457716d3-ab84-4a38-98a8-1f128c23dce8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:25.721732 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 498/1000] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Aug 11 10:44:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:25.729357 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f18fe-c306-4630-bf32-1a9e71192388 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:25.789743 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:25.793657 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765469b3-2ee4-41fd-8dfc-8452757aa1a4 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:25.794069 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765469b3-2ee4-41fd-8dfc-8452757aa1a4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:25.794228 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765469b3-2ee4-41fd-8dfc-8452757aa1a4 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:25.795610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 499/1001] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:25.800640 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cec70-1230-46bb-a5c9-eb286d677be6 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:25.800931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cec70-1230-46bb-a5c9-eb286d677be6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:25.801216 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cec70-1230-46bb-a5c9-eb286d677be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:25.820476 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c80cec70-1230-46bb-a5c9-eb286d677be6 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:25.822546 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c80cec70-1230-46bb-a5c9-eb286d677be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:25.838506 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f18fe-c306-4630-bf32-1a9e71192388 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:25.874706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffb619-57b7-4335-abb1-603eedc2827c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:25.875468 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffb619-57b7-4335-abb1-603eedc2827c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:25.875744 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffb619-57b7-4335-abb1-603eedc2827c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:25.876123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffb619-57b7-4335-abb1-603eedc2827c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:25.876847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffb619-57b7-4335-abb1-603eedc2827c None admin] RBAC: Adding query filter params (interface=public, service_id=90300d8759bb4b2c9e390aee8efa2ca3, region_id=RegionOne) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:25.877151 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffb619-57b7-4335-abb1-603eedc2827c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:25.878511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffb619-57b7-4335-abb1-603eedc2827c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:25.884496 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 503/1002] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Aug 11 10:44:25 2022] GET /identity/v3/endpoints?service_id=90300d8759bb4b2c9e390aee8efa2ca3&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:25.889961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffb619-57b7-4335-abb1-603eedc2827c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:25.898937 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 500/1003] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:25 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 10:44:25.917632 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cec70-1230-46bb-a5c9-eb286d677be6 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:25.950629 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:25.998495 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffb619-57b7-4335-abb1-603eedc2827c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:26.019866 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:26.028313 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cec70-1230-46bb-a5c9-eb286d677be6 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:26.039012 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c752f-1c4c-4696-bb37-b186612f6a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:26.039638 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c752f-1c4c-4696-bb37-b186612f6a5c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:26.039991 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c752f-1c4c-4696-bb37-b186612f6a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:26.040551 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c752f-1c4c-4696-bb37-b186612f6a5c None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:26.041247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c752f-1c4c-4696-bb37-b186612f6a5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:26.042601 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c752f-1c4c-4696-bb37-b186612f6a5c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:26.049003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 504/1004] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Aug 11 10:44:25 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:44:26.078187 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bc4f2-a98e-4846-882a-a27a004b39c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:26.079035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bc4f2-a98e-4846-882a-a27a004b39c0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:26.079385 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bc4f2-a98e-4846-882a-a27a004b39c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:26.079727 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bc4f2-a98e-4846-882a-a27a004b39c0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:26.080399 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bc4f2-a98e-4846-882a-a27a004b39c0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:26.081883 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bc4f2-a98e-4846-882a-a27a004b39c0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:26.091799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-340bc4f2-a98e-4846-882a-a27a004b39c0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 10:44:26.091799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:26.091799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:44:26.091799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:44:26.091799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:44:26.091799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:44:26.091799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:44:26.091799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:26.091799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 10:44:26.091799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:26.091799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:26.091799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:26.091799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:26.091799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:26.091799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:26.091799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:26.091799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:26.092834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:26.092834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:26.092834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:26.092834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:26.092834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:26.092834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:26.092834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:44:26.092834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:44:26.092834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:44:26.092834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:44:26.092834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:26.092834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:26.092834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:26.092834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:26.092834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:26.092834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:26.093633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:26.093633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:26.093633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:26.093633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:26.093633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:26.093633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:26.093633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:26.093633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:26.093633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:26.093633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:26.093633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:44:26.093633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:26.093633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 10:44:26.093633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:26.093633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 501/1005] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Aug 11 10:44:25 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:26.099243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c752f-1c4c-4696-bb37-b186612f6a5c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:26.210953 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c752f-1c4c-4696-bb37-b186612f6a5c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:26.247744 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f03cee-4458-48f2-b63d-68e1dbad1360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:26.248358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f03cee-4458-48f2-b63d-68e1dbad1360 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:26.248632 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f03cee-4458-48f2-b63d-68e1dbad1360 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:26.248896 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f03cee-4458-48f2-b63d-68e1dbad1360 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:26.249522 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f03cee-4458-48f2-b63d-68e1dbad1360 None admin] RBAC: Adding query filter params (name=image) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:26.249815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f03cee-4458-48f2-b63d-68e1dbad1360 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:26.251187 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f03cee-4458-48f2-b63d-68e1dbad1360 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:26.258795 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 505/1006] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:26.262213 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bc4f2-a98e-4846-882a-a27a004b39c0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:26.359290 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:26.365938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bc4f2-a98e-4846-882a-a27a004b39c0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:26.400035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2278d-e3fa-4d71-a024-27292ff29946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:26.400648 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2278d-e3fa-4d71-a024-27292ff29946 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:26.400927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2278d-e3fa-4d71-a024-27292ff29946 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:26.401201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2278d-e3fa-4d71-a024-27292ff29946 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:26.401824 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf2278d-e3fa-4d71-a024-27292ff29946 None admin] RBAC: Adding query filter params (type=image) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:26.402130 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf2278d-e3fa-4d71-a024-27292ff29946 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:26.403521 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf2278d-e3fa-4d71-a024-27292ff29946 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:26.408130 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 502/1007] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:26 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:27.694856 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93847d64-3f48-4116-9c9b-e090d2e1ca64 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:27.695402 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93847d64-3f48-4116-9c9b-e090d2e1ca64 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:27.695402 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93847d64-3f48-4116-9c9b-e090d2e1ca64 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:27.700783 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 506/1008] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:27.706074 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac2250-00c8-4708-8346-8db28e62ac05 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:27.706478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac2250-00c8-4708-8346-8db28e62ac05 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:27.706639 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac2250-00c8-4708-8346-8db28e62ac05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:27.724922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a0ac2250-00c8-4708-8346-8db28e62ac05 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:27.726110 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a0ac2250-00c8-4708-8346-8db28e62ac05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:27.796726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 503/1009] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:27 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:27.823810 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93847d64-3f48-4116-9c9b-e090d2e1ca64 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:27.876055 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:27.929667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93847d64-3f48-4116-9c9b-e090d2e1ca64 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:27.965205 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573da019-dbd3-426d-8c33-d7f9ba32bf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:27.965759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573da019-dbd3-426d-8c33-d7f9ba32bf4e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:27.966029 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573da019-dbd3-426d-8c33-d7f9ba32bf4e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:27.966294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573da019-dbd3-426d-8c33-d7f9ba32bf4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:27.967445 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573da019-dbd3-426d-8c33-d7f9ba32bf4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:27.968868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573da019-dbd3-426d-8c33-d7f9ba32bf4e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:27.975113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 507/1010] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:27.976568 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac2250-00c8-4708-8346-8db28e62ac05 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:28.077551 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:28.084303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e64da6-d5c7-4067-a151-fb70e13621d1 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:28.084594 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e64da6-d5c7-4067-a151-fb70e13621d1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:28.084871 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e64da6-d5c7-4067-a151-fb70e13621d1 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:28.086261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 508/1011] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:44:28.087577 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac2250-00c8-4708-8346-8db28e62ac05 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:28.091126 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a5fc0-2ea8-4708-acec-ad369edf8e1c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:28.091415 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a5fc0-2ea8-4708-acec-ad369edf8e1c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:28.091693 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a5fc0-2ea8-4708-acec-ad369edf8e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:28.111540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-085a5fc0-2ea8-4708-acec-ad369edf8e1c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:28.112713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-085a5fc0-2ea8-4708-acec-ad369edf8e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:28.125401 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4952791-a8ea-4db1-96cc-348c5a69b357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:28.126020 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4952791-a8ea-4db1-96cc-348c5a69b357 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:28.126405 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4952791-a8ea-4db1-96cc-348c5a69b357 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:28.126683 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4952791-a8ea-4db1-96cc-348c5a69b357 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:28.127463 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4952791-a8ea-4db1-96cc-348c5a69b357 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:28.128891 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4952791-a8ea-4db1-96cc-348c5a69b357 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:28.178060 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 509/1012] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:28 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 10:44:28.200832 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a5fc0-2ea8-4708-acec-ad369edf8e1c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:28.205820 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 504/1013] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Aug 11 10:44:27 2022] POST /identity/v3/projects => generated 311 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:44:28.262483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:28.320157 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a5fc0-2ea8-4708-acec-ad369edf8e1c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:28.357707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ec333-ca7e-4db9-8e33-b7d21a6f4d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:28.358626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ec333-ca7e-4db9-8e33-b7d21a6f4d0f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:28.358958 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ec333-ca7e-4db9-8e33-b7d21a6f4d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:28.359229 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ec333-ca7e-4db9-8e33-b7d21a6f4d0f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:28.359981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ec333-ca7e-4db9-8e33-b7d21a6f4d0f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:28.361299 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ec333-ca7e-4db9-8e33-b7d21a6f4d0f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:28.371549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-b76ec333-ca7e-4db9-8e33-b7d21a6f4d0f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 10:44:28.371549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:28.371549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:44:28.371549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:44:28.371549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:44:28.371549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:44:28.371549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:44:28.371549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:28.371549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 10:44:28.371549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:28.371549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:28.371549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:28.371549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:28.371549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:28.371549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:28.371549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:28.371549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:28.372582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:28.372582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:28.372582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:28.372582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:28.372582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:28.372582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:28.372582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:44:28.372582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:44:28.372582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:44:28.372582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:44:28.372582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:28.372582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:28.372582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:28.372582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:28.372582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:28.372582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:28.373384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:28.373384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:28.373384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:28.373384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:28.373384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:28.373384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:28.373384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:28.373384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:28.373384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:28.373384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:28.373384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:44:28.373384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:28.373384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 11 10:44:28.373384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:28.373384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 510/1014] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:44:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:28.378725 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4952791-a8ea-4db1-96cc-348c5a69b357 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:28.424011 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647e494-d0bd-4009-a3f3-844d05b68f23 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:28.424285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647e494-d0bd-4009-a3f3-844d05b68f23 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:28.424557 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647e494-d0bd-4009-a3f3-844d05b68f23 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:28.426002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 511/1015] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:28.431831 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7f1ac-f559-4b49-be6c-ac475f9f08f3 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:28.432113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7f1ac-f559-4b49-be6c-ac475f9f08f3 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:28.432385 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7f1ac-f559-4b49-be6c-ac475f9f08f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:28.450642 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-cfb7f1ac-f559-4b49-be6c-ac475f9f08f3 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:28.451867 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-cfb7f1ac-f559-4b49-be6c-ac475f9f08f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:28.492472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4952791-a8ea-4db1-96cc-348c5a69b357 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:28.523053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 512/1016] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:28 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 10:44:28.530292 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20256600-29c6-42ae-a6bb-e2ab7441d3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:28.530935 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20256600-29c6-42ae-a6bb-e2ab7441d3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:28.531219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20256600-29c6-42ae-a6bb-e2ab7441d3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:28.531492 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20256600-29c6-42ae-a6bb-e2ab7441d3d3 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:28.532126 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20256600-29c6-42ae-a6bb-e2ab7441d3d3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:28.532431 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20256600-29c6-42ae-a6bb-e2ab7441d3d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:28.533790 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20256600-29c6-42ae-a6bb-e2ab7441d3d3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:28.543255 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 505/1017] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Aug 11 10:44:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:28.544767 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7f1ac-f559-4b49-be6c-ac475f9f08f3 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:28.545378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20256600-29c6-42ae-a6bb-e2ab7441d3d3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:28.556986 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:28.589293 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:28.649980 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7f1ac-f559-4b49-be6c-ac475f9f08f3 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:28.651723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20256600-29c6-42ae-a6bb-e2ab7441d3d3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:28.687250 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aa031-5749-4edc-b2c9-dd6b2e43b4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:28.688004 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aa031-5749-4edc-b2c9-dd6b2e43b4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:28.688157 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d9452-3532-4d54-9b04-06b7f0edb2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:28.688371 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aa031-5749-4edc-b2c9-dd6b2e43b4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:28.688547 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aa031-5749-4edc-b2c9-dd6b2e43b4b8 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:28.688714 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d9452-3532-4d54-9b04-06b7f0edb2f1 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:28.688975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d9452-3532-4d54-9b04-06b7f0edb2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:28.689167 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7aa031-5749-4edc-b2c9-dd6b2e43b4b8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:28.689262 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d9452-3532-4d54-9b04-06b7f0edb2f1 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:28.689465 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7aa031-5749-4edc-b2c9-dd6b2e43b4b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:28.689873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d9452-3532-4d54-9b04-06b7f0edb2f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:28.690877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7aa031-5749-4edc-b2c9-dd6b2e43b4b8 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:28.691248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d9452-3532-4d54-9b04-06b7f0edb2f1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:28.696447 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 513/1018] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Aug 11 10:44:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:28.702121 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aa031-5749-4edc-b2c9-dd6b2e43b4b8 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:28.794395 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 506/1019] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Aug 11 10:44:28 2022] POST /identity/v3/services => generated 242 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:44:28.803348 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aa031-5749-4edc-b2c9-dd6b2e43b4b8 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:28.807048 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:28.850057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fcba51-dc16-403b-9c60-e68c6479b632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:28.850681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcba51-dc16-403b-9c60-e68c6479b632 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:28.850989 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcba51-dc16-403b-9c60-e68c6479b632 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:28.851259 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fcba51-dc16-403b-9c60-e68c6479b632 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:28.851922 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcba51-dc16-403b-9c60-e68c6479b632 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:28.854062 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fcba51-dc16-403b-9c60-e68c6479b632 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:28.938108 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 514/1020] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 10:44:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 10:44:30.303875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cff18f-5ed6-4f51-9c6c-eb056ff6cb9f None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:30.304366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cff18f-5ed6-4f51-9c6c-eb056ff6cb9f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:30.304366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cff18f-5ed6-4f51-9c6c-eb056ff6cb9f None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:30.305795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 507/1021] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:30.311049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a5241-4fab-48a3-a976-ee5df2265fa5 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:30.311464 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a5241-4fab-48a3-a976-ee5df2265fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:30.311604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a5241-4fab-48a3-a976-ee5df2265fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:30.330131 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ae3a5241-4fab-48a3-a976-ee5df2265fa5 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:30.331330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ae3a5241-4fab-48a3-a976-ee5df2265fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:30.405920 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 515/1022] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:30.429957 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cff18f-5ed6-4f51-9c6c-eb056ff6cb9f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:30.499536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:30.535662 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cff18f-5ed6-4f51-9c6c-eb056ff6cb9f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:30.571178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28d28a-6d11-4a4e-93f5-87b08088c380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:30.571733 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28d28a-6d11-4a4e-93f5-87b08088c380 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:30.572015 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28d28a-6d11-4a4e-93f5-87b08088c380 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:30.572285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28d28a-6d11-4a4e-93f5-87b08088c380 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:30.573404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28d28a-6d11-4a4e-93f5-87b08088c380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:30.575165 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28d28a-6d11-4a4e-93f5-87b08088c380 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:30.581479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 508/1023] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:30.582703 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a5241-4fab-48a3-a976-ee5df2265fa5 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:30.666489 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:30.684563 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a5241-4fab-48a3-a976-ee5df2265fa5 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:30.719001 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa5798-c0ab-4d34-b1b8-80af4dbcfedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:30.719614 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa5798-c0ab-4d34-b1b8-80af4dbcfedf None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:30.719891 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa5798-c0ab-4d34-b1b8-80af4dbcfedf None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:30.720166 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa5798-c0ab-4d34-b1b8-80af4dbcfedf None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:30.720818 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa5798-c0ab-4d34-b1b8-80af4dbcfedf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:30.722360 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa5798-c0ab-4d34-b1b8-80af4dbcfedf None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:30.834879 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 516/1024] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Aug 11 10:44:30 2022] POST /identity/v3/users => generated 285 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:44:30.888947 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaac156-3339-4032-b897-7026b72bfd2e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:30.889281 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaac156-3339-4032-b897-7026b72bfd2e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:30.889513 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaac156-3339-4032-b897-7026b72bfd2e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:30.891082 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 509/1025] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:30.896572 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb5533-3775-4320-b617-38fa0b9687cf None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:30.896901 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb5533-3775-4320-b617-38fa0b9687cf None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:30.897137 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb5533-3775-4320-b617-38fa0b9687cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:30.917153 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-2feb5533-3775-4320-b617-38fa0b9687cf None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:30.918377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2feb5533-3775-4320-b617-38fa0b9687cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:30.996038 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 517/1026] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:31.018849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaac156-3339-4032-b897-7026b72bfd2e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:31.037788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f44210-4ed3-4d9d-a916-f26e925c58f6 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:31.038078 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f44210-4ed3-4d9d-a916-f26e925c58f6 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:31.038356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f44210-4ed3-4d9d-a916-f26e925c58f6 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:31.040418 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 518/1027] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:44:31.045396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432eafe-e30f-443d-8ec6-2064aeedbc82 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:31.045684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432eafe-e30f-443d-8ec6-2064aeedbc82 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:31.045960 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432eafe-e30f-443d-8ec6-2064aeedbc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:31.068215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-2432eafe-e30f-443d-8ec6-2064aeedbc82 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:31.069423 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2432eafe-e30f-443d-8ec6-2064aeedbc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:31.135811 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:31.137147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaac156-3339-4032-b897-7026b72bfd2e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:31.141994 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 519/1028] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 10:44:31.165035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432eafe-e30f-443d-8ec6-2064aeedbc82 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:31.173939 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaec7d-ad3b-4a8a-847a-328adec47344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:31.174603 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaec7d-ad3b-4a8a-847a-328adec47344 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:31.174885 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaec7d-ad3b-4a8a-847a-328adec47344 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:31.175158 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaec7d-ad3b-4a8a-847a-328adec47344 None admin] PATH_INFO: `/v3/services/image` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:31.175762 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eaec7d-ad3b-4a8a-847a-328adec47344 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:31.182740 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eaec7d-ad3b-4a8a-847a-328adec47344 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:31.182740 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:31.186777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b8eaec7d-ad3b-4a8a-847a-328adec47344 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 10:44:31.186777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:31.186777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:44:31.186777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:44:31.186777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:44:31.186777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:44:31.186777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:44:31.186777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:31.186777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 10:44:31.186777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:31.186777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:31.186777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:31.186777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:31.186777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:31.186777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:31.186777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:31.186777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:31.187697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:31.187697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:31.187697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:31.187697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:31.187697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:31.187697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:31.187697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:44:31.187697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:44:31.187697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:44:31.187697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:44:31.187697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:31.187697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:31.187697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:31.187697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:31.187697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:31.187697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:31.188510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:31.188510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:31.188510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:31.188510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:31.188510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:31.188510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:31.188510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:31.188510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:31.188510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:31.188510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:31.188510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:44:31.188510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:31.188510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 10:44:31.188510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:31.188510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 510/1029] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Aug 11 10:44:31 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:31.193827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaec7d-ad3b-4a8a-847a-328adec47344 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:31.274377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432eafe-e30f-443d-8ec6-2064aeedbc82 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:31.307417 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaec7d-ad3b-4a8a-847a-328adec47344 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:31.310750 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9958ea7-86ed-410e-8293-349c0eb4bbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:31.311407 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9958ea7-86ed-410e-8293-349c0eb4bbac None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:31.311901 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9958ea7-86ed-410e-8293-349c0eb4bbac None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:31.311978 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9958ea7-86ed-410e-8293-349c0eb4bbac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:31.322798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9958ea7-86ed-410e-8293-349c0eb4bbac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:44:31.327762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e9958ea7-86ed-410e-8293-349c0eb4bbac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 10:44:31.327762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:31.327762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:31.327762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:31.327762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:31.327762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:31.327762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:31.327762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:31.327762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:31.327762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:31.327762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:31.327762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:31.327762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:44:31.327762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:44:31.327762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:44:31.327762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:44:31.328784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:44:31.328784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:44:31.328784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:44:31.328784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:44:31.328784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:31.328784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:31.328784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:31.328784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:31.328784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:31.328784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:31.328784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:31.328784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:31.328784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:31.328784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:31.328784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:31.328784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:31.329589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:31.329589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:31.329589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:31.329589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:31.329589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:44:31.329589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:44:31.329589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:44:31.329589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:44:31.329589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:44:31.329589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:44:31.329589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 10:44:31.329589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:31.329589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 520/1030] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Aug 11 10:44:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:31.334949 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9958ea7-86ed-410e-8293-349c0eb4bbac None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:31.344824 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813aef8d-708d-4324-a034-8dd7b4ec6032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:31.345446 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813aef8d-708d-4324-a034-8dd7b4ec6032 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:31.345729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813aef8d-708d-4324-a034-8dd7b4ec6032 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:31.346006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813aef8d-708d-4324-a034-8dd7b4ec6032 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:31.346642 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813aef8d-708d-4324-a034-8dd7b4ec6032 None admin] RBAC: Adding query filter params (name=image) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:31.346986 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813aef8d-708d-4324-a034-8dd7b4ec6032 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:31.348355 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813aef8d-708d-4324-a034-8dd7b4ec6032 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:31.358214 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 511/1031] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:31.360283 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813aef8d-708d-4324-a034-8dd7b4ec6032 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:31.401768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:31.426786 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:31.447308 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9958ea7-86ed-410e-8293-349c0eb4bbac None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:31.467587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813aef8d-708d-4324-a034-8dd7b4ec6032 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:31.484663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c238097-1ec1-4f07-99fb-36bb2e2e2a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:31.485271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c238097-1ec1-4f07-99fb-36bb2e2e2a1e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:31.485553 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c238097-1ec1-4f07-99fb-36bb2e2e2a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:31.486017 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c238097-1ec1-4f07-99fb-36bb2e2e2a1e None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:31.486476 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c238097-1ec1-4f07-99fb-36bb2e2e2a1e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:31.486797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c238097-1ec1-4f07-99fb-36bb2e2e2a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:31.488189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c238097-1ec1-4f07-99fb-36bb2e2e2a1e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:31.497220 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 521/1032] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Aug 11 10:44:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:31.502594 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c238097-1ec1-4f07-99fb-36bb2e2e2a1e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:31.505350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff96fa8-9b6b-480b-90a5-d856614134be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:31.506518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff96fa8-9b6b-480b-90a5-d856614134be None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:31.506518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff96fa8-9b6b-480b-90a5-d856614134be None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:31.506518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff96fa8-9b6b-480b-90a5-d856614134be None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:31.507141 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff96fa8-9b6b-480b-90a5-d856614134be None admin] RBAC: Adding query filter params (type=image) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:31.507444 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff96fa8-9b6b-480b-90a5-d856614134be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:31.508874 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff96fa8-9b6b-480b-90a5-d856614134be None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:31.514063 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 512/1033] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:31.519729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff96fa8-9b6b-480b-90a5-d856614134be None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:31.608211 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c238097-1ec1-4f07-99fb-36bb2e2e2a1e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:31.627892 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff96fa8-9b6b-480b-90a5-d856614134be None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:31.629002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:31.643572 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43916cb9-e0d1-4990-836c-ec419cd36501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:31.644591 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43916cb9-e0d1-4990-836c-ec419cd36501 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:31.644591 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43916cb9-e0d1-4990-836c-ec419cd36501 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:31.644902 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43916cb9-e0d1-4990-836c-ec419cd36501 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:31.656718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43916cb9-e0d1-4990-836c-ec419cd36501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:31.656910 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:31.658208 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43916cb9-e0d1-4990-836c-ec419cd36501 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:31.665765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7761df-2acb-4db6-a7da-79b82d68b326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:31.666570 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7761df-2acb-4db6-a7da-79b82d68b326 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:31.666695 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7761df-2acb-4db6-a7da-79b82d68b326 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:31.666972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7761df-2acb-4db6-a7da-79b82d68b326 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:31.667679 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7761df-2acb-4db6-a7da-79b82d68b326 None admin] RBAC: Adding query filter params (interface=public, service_id=b7c258ffe10248799fd05017121df1c9, region_id=RegionOne) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:31.667987 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7761df-2acb-4db6-a7da-79b82d68b326 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:31.669352 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7761df-2acb-4db6-a7da-79b82d68b326 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:31.672688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-43916cb9-e0d1-4990-836c-ec419cd36501 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:31.672688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:31.672688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:31.672688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:31.672688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:31.672688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:31.672688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:31.672688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:31.672688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:31.672688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:31.672688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:31.672688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:31.672688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:31.672688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:31.672688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:31.672688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:31.673599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:31.673599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:31.673599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:31.673599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:31.673599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:31.673599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:31.673599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:31.673599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:31.673599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:31.673599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:31.673599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:31.673599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:31.673599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:31.673599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:31.673599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:31.673599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:31.673599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:31.674467 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:31.674467 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:31.674467 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:31.674631 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 513/1034] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Aug 11 10:44:31 2022] GET /identity/v3/endpoints?service_id=b7c258ffe10248799fd05017121df1c9&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:31.680128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7761df-2acb-4db6-a7da-79b82d68b326 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:31.681611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 522/1035] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:31.684833 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43916cb9-e0d1-4990-836c-ec419cd36501 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:31.789127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7761df-2acb-4db6-a7da-79b82d68b326 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:31.794107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43916cb9-e0d1-4990-836c-ec419cd36501 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:31.827988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a99c0-231b-4421-849e-d43a2991643c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:31.828711 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a99c0-231b-4421-849e-d43a2991643c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:31.828996 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a99c0-231b-4421-849e-d43a2991643c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:31.829274 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a99c0-231b-4421-849e-d43a2991643c None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:31.829486 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce11e0e-453f-40c1-b838-113fd420c6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:31.829878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a99c0-231b-4421-849e-d43a2991643c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:31.830086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce11e0e-453f-40c1-b838-113fd420c6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:31.830363 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce11e0e-453f-40c1-b838-113fd420c6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:31.830635 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce11e0e-453f-40c1-b838-113fd420c6d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:31.831277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a99c0-231b-4421-849e-d43a2991643c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:31.831388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce11e0e-453f-40c1-b838-113fd420c6d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:31.831586 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce11e0e-453f-40c1-b838-113fd420c6d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:31.832990 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce11e0e-453f-40c1-b838-113fd420c6d6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:31.838723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 514/1036] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Aug 11 10:44:31 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 10:44:31.853531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 523/1037] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:31.859723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a99c0-231b-4421-849e-d43a2991643c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:31.922436 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:31.972305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a99c0-231b-4421-849e-d43a2991643c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:32.011428 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e546452-e5c3-4ef4-9099-5cfbfaa14728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:32.012325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e546452-e5c3-4ef4-9099-5cfbfaa14728 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:32.012601 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e546452-e5c3-4ef4-9099-5cfbfaa14728 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:32.012876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e546452-e5c3-4ef4-9099-5cfbfaa14728 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:32.022684 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e546452-e5c3-4ef4-9099-5cfbfaa14728 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:32.024280 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e546452-e5c3-4ef4-9099-5cfbfaa14728 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:32.036888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-7e546452-e5c3-4ef4-9099-5cfbfaa14728 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 10:44:32.036888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:32.036888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:32.036888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:32.036888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:32.036888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:32.036888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:32.036888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:32.036888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:32.036888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:32.036888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:32.036888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:32.036888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:44:32.036888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:44:32.036888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:44:32.036888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:44:32.037806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:32.037806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:32.037806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:44:32.037806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:32.037806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:44:32.037806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:32.037806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:32.037806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:32.037806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:32.037806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:32.037806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:32.037806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:32.037806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:32.037806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:32.037806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:32.037806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:32.037806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:32.037806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:32.038818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:32.038818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:32.038818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:44:32.038818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:44:32.038818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:44:32.038818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:44:32.038818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:44:32.038818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:44:32.038818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 10:44:32.038818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:32.038818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 515/1038] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Aug 11 10:44:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:32.043986 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce11e0e-453f-40c1-b838-113fd420c6d6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:32.077742 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:32.147493 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce11e0e-453f-40c1-b838-113fd420c6d6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:32.181740 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea2917-e245-4586-8c8f-9592c1007aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:32.182273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea2917-e245-4586-8c8f-9592c1007aed None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:32.182549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea2917-e245-4586-8c8f-9592c1007aed None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:32.182845 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea2917-e245-4586-8c8f-9592c1007aed None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:32.183570 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea2917-e245-4586-8c8f-9592c1007aed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:32.183868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea2917-e245-4586-8c8f-9592c1007aed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:32.185277 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea2917-e245-4586-8c8f-9592c1007aed None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:32.207123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 524/1039] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Aug 11 10:44:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:32.208478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e546452-e5c3-4ef4-9099-5cfbfaa14728 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:32.308962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e546452-e5c3-4ef4-9099-5cfbfaa14728 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:32.322551 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:32.346191 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c711fd1-f185-41f2-b9c3-b37f5662c311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:32.347108 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c711fd1-f185-41f2-b9c3-b37f5662c311 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:32.347558 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c711fd1-f185-41f2-b9c3-b37f5662c311 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:32.347980 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c711fd1-f185-41f2-b9c3-b37f5662c311 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:32.418664 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c711fd1-f185-41f2-b9c3-b37f5662c311 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:32.420371 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c711fd1-f185-41f2-b9c3-b37f5662c311 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:32.526935 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 516/1040] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:44:32 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 11 10:44:32.528386 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea2917-e245-4586-8c8f-9592c1007aed None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:32.622468 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:32.632268 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea2917-e245-4586-8c8f-9592c1007aed None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:32.667320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267d5fa-c6dc-4868-b563-4838a0785c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:32.668218 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267d5fa-c6dc-4868-b563-4838a0785c6a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:32.668672 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267d5fa-c6dc-4868-b563-4838a0785c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:32.669089 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267d5fa-c6dc-4868-b563-4838a0785c6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:32.679353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267d5fa-c6dc-4868-b563-4838a0785c6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:32.681825 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267d5fa-c6dc-4868-b563-4838a0785c6a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:32.697630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-2267d5fa-c6dc-4868-b563-4838a0785c6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:32.697630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:32.697630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:32.697630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:32.697630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:32.697630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:32.697630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:32.697630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:32.697630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:32.697630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:32.697630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:32.697630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:32.697630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:32.697630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:32.697630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:32.697630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:32.698676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:32.698676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:32.698676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:32.698676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:32.698676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:32.698676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:32.698676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:32.698676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:32.698676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:32.698676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:32.698676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:32.698676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:32.698676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:32.698676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:32.698676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:32.698676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:32.698676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:32.699863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:32.699863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:32.699863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:32.702899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 525/1041] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:32.705011 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c711fd1-f185-41f2-b9c3-b37f5662c311 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:32.721120 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:32.814051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c711fd1-f185-41f2-b9c3-b37f5662c311 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:32.848557 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b8397-6679-487b-9b74-80944b9072a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:32.849175 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b8397-6679-487b-9b74-80944b9072a0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:32.849459 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b8397-6679-487b-9b74-80944b9072a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:32.849734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b8397-6679-487b-9b74-80944b9072a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:32.850377 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b8397-6679-487b-9b74-80944b9072a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:32.850680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b8397-6679-487b-9b74-80944b9072a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:32.852909 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b8397-6679-487b-9b74-80944b9072a0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:32.869189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 517/1042] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:32.870400 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267d5fa-c6dc-4868-b563-4838a0785c6a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:32.937532 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2d13c-5e5e-457e-ac73-937b7cfa569d None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:32.937818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2d13c-5e5e-457e-ac73-937b7cfa569d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:32.938095 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2d13c-5e5e-457e-ac73-937b7cfa569d None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:32.939521 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 518/1043] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:44:32.944543 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1703b1b-d647-4838-8cd1-e8e813148306 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:32.944830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1703b1b-d647-4838-8cd1-e8e813148306 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:32.945104 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1703b1b-d647-4838-8cd1-e8e813148306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:32.964371 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b1703b1b-d647-4838-8cd1-e8e813148306 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:32.965754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b1703b1b-d647-4838-8cd1-e8e813148306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:32.976672 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267d5fa-c6dc-4868-b563-4838a0785c6a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:33.015013 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18156b93-baca-41d1-acd4-bd5ac8071649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:33.015951 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18156b93-baca-41d1-acd4-bd5ac8071649 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:33.016384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18156b93-baca-41d1-acd4-bd5ac8071649 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:33.016662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18156b93-baca-41d1-acd4-bd5ac8071649 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:33.027859 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18156b93-baca-41d1-acd4-bd5ac8071649 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:33.029320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18156b93-baca-41d1-acd4-bd5ac8071649 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:33.041882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 519/1044] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 10:44:33.044889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-18156b93-baca-41d1-acd4-bd5ac8071649 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:33.044889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:33.044889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:33.044889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:33.044889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:33.044889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:33.044889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:33.044889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:33.044889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:33.044889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:33.044889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:33.044889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:33.044889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:44:33.044889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:44:33.044889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:44:33.045840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:44:33.045840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:33.045840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:33.045840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:33.045840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:33.045840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:33.045840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:33.045840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:33.045840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:33.045840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:33.045840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:33.045840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:33.045840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:33.045840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:33.045840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:33.045840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:33.045840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:33.046698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:44:33.046698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:44:33.046698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:44:33.046698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:44:33.046698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:44:33.046698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:44:33.046698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:33.046698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:33.046698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 526/1045] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:44:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:33.051707 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1703b1b-d647-4838-8cd1-e8e813148306 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:33.056169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:33.068155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18156b93-baca-41d1-acd4-bd5ac8071649 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:33.071834 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:33.161811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1703b1b-d647-4838-8cd1-e8e813148306 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:33.174949 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18156b93-baca-41d1-acd4-bd5ac8071649 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:33.201640 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013e876-6a31-41e2-98a4-7d72f5a2f961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:33.202263 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013e876-6a31-41e2-98a4-7d72f5a2f961 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:33.202547 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013e876-6a31-41e2-98a4-7d72f5a2f961 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:33.202852 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013e876-6a31-41e2-98a4-7d72f5a2f961 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:33.203545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013e876-6a31-41e2-98a4-7d72f5a2f961 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:33.203856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013e876-6a31-41e2-98a4-7d72f5a2f961 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:33.205276 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013e876-6a31-41e2-98a4-7d72f5a2f961 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:33.212644 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac331e2-baed-4bb5-8e35-e13d5733b012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:33.213441 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac331e2-baed-4bb5-8e35-e13d5733b012 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:33.213871 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac331e2-baed-4bb5-8e35-e13d5733b012 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:33.214291 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac331e2-baed-4bb5-8e35-e13d5733b012 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:33.217821 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 520/1046] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:44:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:33.223741 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013e876-6a31-41e2-98a4-7d72f5a2f961 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:33.228844 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac331e2-baed-4bb5-8e35-e13d5733b012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:44:33.234285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-8ac331e2-baed-4bb5-8e35-e13d5733b012 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:44:33.234285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:33.234285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:33.234285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:33.234285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:33.234285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:33.234285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:33.234285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:33.234285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:33.234285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:33.234285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:33.234285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:33.234285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:44:33.234285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:44:33.234285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:44:33.234285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:44:33.235307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:44:33.235307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:44:33.235307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:44:33.235307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:44:33.235307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:33.235307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:33.235307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:33.235307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:33.235307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:33.235307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:33.235307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:33.235307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:33.235307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:33.235307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:33.235307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:33.235307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:33.236143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:33.236143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:33.236143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:33.236143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:33.236143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:44:33.236143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:44:33.236143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:44:33.236143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:44:33.236143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:44:33.236143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:44:33.236143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:44:33.236143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:33.236143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 527/1047] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:44:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:33.241391 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac331e2-baed-4bb5-8e35-e13d5733b012 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:33.293896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:33.306602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:33.332851 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013e876-6a31-41e2-98a4-7d72f5a2f961 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:33.347466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac331e2-baed-4bb5-8e35-e13d5733b012 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:33.369483 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf6ad3-ba1e-4452-b54a-bf4e951539f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:33.370384 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf6ad3-ba1e-4452-b54a-bf4e951539f9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:33.370673 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf6ad3-ba1e-4452-b54a-bf4e951539f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:33.370981 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf6ad3-ba1e-4452-b54a-bf4e951539f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:33.372178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf6ad3-ba1e-4452-b54a-bf4e951539f9 None admin] RBAC: Adding query filter params (role.id=0abfe51f95874cceae89482cf378713c, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=9267752ac6724013bc1edcdecff48dd7) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:33.372511 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf6ad3-ba1e-4452-b54a-bf4e951539f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:33.374455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf6ad3-ba1e-4452-b54a-bf4e951539f9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:33.391022 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 521/1048] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:44:33 2022] GET /identity/v3/role_assignments?user.id=9267752ac6724013bc1edcdecff48dd7&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=0abfe51f95874cceae89482cf378713c => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:33.391250 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9b700-8d98-4272-b170-ffd0500f95bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:33.391250 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9b700-8d98-4272-b170-ffd0500f95bb None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:33.391250 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9b700-8d98-4272-b170-ffd0500f95bb None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:33.391250 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9b700-8d98-4272-b170-ffd0500f95bb None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:33.391587 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9b700-8d98-4272-b170-ffd0500f95bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:33.391587 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9b700-8d98-4272-b170-ffd0500f95bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:33.391587 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9b700-8d98-4272-b170-ffd0500f95bb None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:33.401770 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 528/1049] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:44:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:33.403243 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf6ad3-ba1e-4452-b54a-bf4e951539f9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:33.513487 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf6ad3-ba1e-4452-b54a-bf4e951539f9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:33.542050 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:33.551587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b56d1-aa98-4d1c-a08d-7310b32f66a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:33.552235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b56d1-aa98-4d1c-a08d-7310b32f66a1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:33.553343 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b56d1-aa98-4d1c-a08d-7310b32f66a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:33.553343 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b56d1-aa98-4d1c-a08d-7310b32f66a1 None admin] PATH_INFO: `/v3/users/752d4ac7c34b40eca53180c50a41087d` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:33.568863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b56d1-aa98-4d1c-a08d-7310b32f66a1 None admin] RBAC: Authorizing `identity:get_user(user_id=752d4ac7c34b40eca53180c50a41087d)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:33.570317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b56d1-aa98-4d1c-a08d-7310b32f66a1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:33.572774 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 522/1050] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:44:33 2022] GET /identity/v3/users/752d4ac7c34b40eca53180c50a41087d => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:33.578567 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9b700-8d98-4272-b170-ffd0500f95bb None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:33.682035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9b700-8d98-4272-b170-ffd0500f95bb None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:33.706246 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:33.717563 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb302cb7-eeed-40de-9979-9f958bc3476d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:33.719732 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb302cb7-eeed-40de-9979-9f958bc3476d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:33.719732 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb302cb7-eeed-40de-9979-9f958bc3476d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:33.719732 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb302cb7-eeed-40de-9979-9f958bc3476d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:33.786971 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb302cb7-eeed-40de-9979-9f958bc3476d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:33.788472 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb302cb7-eeed-40de-9979-9f958bc3476d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:33.885689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab48f6-faf2-48ca-a075-628edd53a3b5 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:33.885987 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab48f6-faf2-48ca-a075-628edd53a3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:33.886373 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab48f6-faf2-48ca-a075-628edd53a3b5 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:33.887780 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 523/1051] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:44:33.890815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 529/1052] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:44:33 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 11 10:44:33.894888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe99a67-d31d-4528-8940-ed9280e46050 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:33.894888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe99a67-d31d-4528-8940-ed9280e46050 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:33.894888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe99a67-d31d-4528-8940-ed9280e46050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:33.897106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb302cb7-eeed-40de-9979-9f958bc3476d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:33.912782 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6fe99a67-d31d-4528-8940-ed9280e46050 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:33.913976 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6fe99a67-d31d-4528-8940-ed9280e46050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:33.922838 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:33.990850 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 524/1053] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:34.009962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb302cb7-eeed-40de-9979-9f958bc3476d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:34.010138 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe99a67-d31d-4528-8940-ed9280e46050 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:34.048599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d872aa5-c6fd-458d-aaf8-31b4bae60993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:34.049243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d872aa5-c6fd-458d-aaf8-31b4bae60993 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:34.049505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d872aa5-c6fd-458d-aaf8-31b4bae60993 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:34.049776 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d872aa5-c6fd-458d-aaf8-31b4bae60993 None admin] PATH_INFO: `/v3/projects/0614569dfdcf4a308e77e17b9a9145d4` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:34.051017 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d872aa5-c6fd-458d-aaf8-31b4bae60993 None admin] RBAC: Authorizing `identity:get_project(project_id=0614569dfdcf4a308e77e17b9a9145d4)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:34.052450 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d872aa5-c6fd-458d-aaf8-31b4bae60993 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:34.054220 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 530/1054] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:44:33 2022] GET /identity/v3/projects/0614569dfdcf4a308e77e17b9a9145d4 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:34.060723 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d872aa5-c6fd-458d-aaf8-31b4bae60993 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:34.131918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe99a67-d31d-4528-8940-ed9280e46050 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:34.151673 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:34.157106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:34.166454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d872aa5-c6fd-458d-aaf8-31b4bae60993 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:34.178652 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088e7cc-91cb-48e3-b85a-e3def4efa0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:34.178652 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088e7cc-91cb-48e3-b85a-e3def4efa0ca None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:34.178652 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088e7cc-91cb-48e3-b85a-e3def4efa0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:34.178652 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088e7cc-91cb-48e3-b85a-e3def4efa0ca None admin] PATH_INFO: `/v3/services/image` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:34.178993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088e7cc-91cb-48e3-b85a-e3def4efa0ca None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:34.178993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088e7cc-91cb-48e3-b85a-e3def4efa0ca None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:34.183254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c088e7cc-91cb-48e3-b85a-e3def4efa0ca None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 10:44:34.183254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:34.183254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:44:34.183254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:44:34.183254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:44:34.183254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:44:34.183254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:44:34.183254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:34.183254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 10:44:34.183254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:34.183254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:44:34.183254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:34.183254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:34.183254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:34.183254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:34.183254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:34.183254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:34.184201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:34.184201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:34.184201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:34.184201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:34.184201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:34.184201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:34.184201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:44:34.184201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:44:34.184201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:44:34.184201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:44:34.184201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:34.184201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:34.184201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:34.184201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:34.184201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:34.184201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:34.185206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:34.185206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:34.185206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:34.185206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:34.185206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:34.185206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:34.185206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:34.185206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:34.185206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:34.185206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:34.185206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:44:34.185206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:44:34.185206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 11 10:44:34.185206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:34.185206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 525/1055] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Aug 11 10:44:34 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:34.190233 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088e7cc-91cb-48e3-b85a-e3def4efa0ca None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:34.208667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fcc7a-f307-4aea-ba0c-d4de1be19fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:34.209436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fcc7a-f307-4aea-ba0c-d4de1be19fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:34.218466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fcc7a-f307-4aea-ba0c-d4de1be19fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:34.218466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fcc7a-f307-4aea-ba0c-d4de1be19fe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:34.218466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fcc7a-f307-4aea-ba0c-d4de1be19fe1 None admin] RBAC: Adding query filter params (role.id=00c6de5dd6cd4267ba05941ddb91e6ad, scope.project.id=0614569dfdcf4a308e77e17b9a9145d4, user.id=752d4ac7c34b40eca53180c50a41087d) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:34.218466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fcc7a-f307-4aea-ba0c-d4de1be19fe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:34.218466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fcc7a-f307-4aea-ba0c-d4de1be19fe1 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:34.225131 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 531/1056] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:44:34 2022] GET /identity/v3/role_assignments?user.id=752d4ac7c34b40eca53180c50a41087d&scope.project.id=0614569dfdcf4a308e77e17b9a9145d4&role.id=00c6de5dd6cd4267ba05941ddb91e6ad => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:34.313909 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088e7cc-91cb-48e3-b85a-e3def4efa0ca None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:34.351276 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a319bb-dbe9-4f59-bd1b-615dba63b042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:34.351925 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a319bb-dbe9-4f59-bd1b-615dba63b042 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:34.352284 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a319bb-dbe9-4f59-bd1b-615dba63b042 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:34.352789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a319bb-dbe9-4f59-bd1b-615dba63b042 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:34.353508 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a319bb-dbe9-4f59-bd1b-615dba63b042 None admin] RBAC: Adding query filter params (name=image) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:34.353817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a319bb-dbe9-4f59-bd1b-615dba63b042 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:34.355252 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a319bb-dbe9-4f59-bd1b-615dba63b042 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:34.365842 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 526/1057] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:34.367241 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fcc7a-f307-4aea-ba0c-d4de1be19fe1 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:34.469155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fcc7a-f307-4aea-ba0c-d4de1be19fe1 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:34.505253 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a60a6-6aef-4105-a798-8011f745ecd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:34.505860 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a60a6-6aef-4105-a798-8011f745ecd9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:34.506138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a60a6-6aef-4105-a798-8011f745ecd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:34.506406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a60a6-6aef-4105-a798-8011f745ecd9 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:34.507063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a60a6-6aef-4105-a798-8011f745ecd9 None admin] RBAC: Adding query filter params (type=image) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:34.507364 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a60a6-6aef-4105-a798-8011f745ecd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:34.509552 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a60a6-6aef-4105-a798-8011f745ecd9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:34.519400 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 532/1058] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:34.520675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a319bb-dbe9-4f59-bd1b-615dba63b042 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:34.569540 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:34.625934 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a319bb-dbe9-4f59-bd1b-615dba63b042 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:34.659704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03c3e5-28da-4910-b321-a672a81c485d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:34.660317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03c3e5-28da-4910-b321-a672a81c485d None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:34.660623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03c3e5-28da-4910-b321-a672a81c485d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:34.660901 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03c3e5-28da-4910-b321-a672a81c485d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:34.661572 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03c3e5-28da-4910-b321-a672a81c485d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:34.663025 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03c3e5-28da-4910-b321-a672a81c485d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:34.743072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 527/1059] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 10:44:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:44:35.388291 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa0d8e-c9fc-4cca-996d-796d67a4fa70 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:35.388838 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa0d8e-c9fc-4cca-996d-796d67a4fa70 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:35.388838 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa0d8e-c9fc-4cca-996d-796d67a4fa70 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:35.390303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 533/1060] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:35.395320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfed15-4305-4096-bcbf-3c50a473bf57 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:35.395724 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfed15-4305-4096-bcbf-3c50a473bf57 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:35.395894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cfed15-4305-4096-bcbf-3c50a473bf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:35.413500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-47cfed15-4305-4096-bcbf-3c50a473bf57 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:35.415392 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-47cfed15-4305-4096-bcbf-3c50a473bf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:35.489845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 528/1061] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:35.511906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa0d8e-c9fc-4cca-996d-796d67a4fa70 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:35.533018 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:35.611612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa0d8e-c9fc-4cca-996d-796d67a4fa70 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:35.645682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe6545-0080-43fa-b81c-639f3b4058b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:35.646232 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe6545-0080-43fa-b81c-639f3b4058b5 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:35.646508 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe6545-0080-43fa-b81c-639f3b4058b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:35.646790 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe6545-0080-43fa-b81c-639f3b4058b5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:35.656859 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe6545-0080-43fa-b81c-639f3b4058b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:44:35.661369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-b6fe6545-0080-43fa-b81c-639f3b4058b5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 10:44:35.661369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:35.661369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:35.661369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:35.661369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:35.661369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:35.661369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:35.661369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:35.661369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:35.661369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:35.661369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:35.661369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:35.661369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:44:35.661369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:44:35.661369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:44:35.661369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:44:35.662282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:44:35.662282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:44:35.662282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:44:35.662282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:44:35.662282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:35.662282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:35.662282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:35.662282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:35.662282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:35.662282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:35.662282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:35.662282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:35.662282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:35.662282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:35.662282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:35.662282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:35.663134 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:35.663134 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:35.663134 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:35.663134 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:35.663134 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:44:35.663134 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:44:35.663134 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:44:35.663134 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:44:35.663134 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:44:35.663134 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:44:35.663134 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 10:44:35.663134 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:35.663134 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 534/1062] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Aug 11 10:44:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:35.670369 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cfed15-4305-4096-bcbf-3c50a473bf57 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:35.697042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:35.770450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cfed15-4305-4096-bcbf-3c50a473bf57 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:35.807039 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc5c6e-9cdd-4607-92b5-63eb8c805ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:35.807674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc5c6e-9cdd-4607-92b5-63eb8c805ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:35.807934 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc5c6e-9cdd-4607-92b5-63eb8c805ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:35.808272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc5c6e-9cdd-4607-92b5-63eb8c805ce8 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:35.809017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc5c6e-9cdd-4607-92b5-63eb8c805ce8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:35.809325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc5c6e-9cdd-4607-92b5-63eb8c805ce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:35.810688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc5c6e-9cdd-4607-92b5-63eb8c805ce8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:35.819204 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 529/1063] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Aug 11 10:44:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:35.825099 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe6545-0080-43fa-b81c-639f3b4058b5 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:35.909807 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:35.929759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe6545-0080-43fa-b81c-639f3b4058b5 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:35.963713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397df11-d4c5-49fd-97d3-ab57c17cd83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:35.964336 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397df11-d4c5-49fd-97d3-ab57c17cd83c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:35.964616 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397df11-d4c5-49fd-97d3-ab57c17cd83c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:35.964886 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397df11-d4c5-49fd-97d3-ab57c17cd83c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:35.975266 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397df11-d4c5-49fd-97d3-ab57c17cd83c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:35.976915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397df11-d4c5-49fd-97d3-ab57c17cd83c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:35.991483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e397df11-d4c5-49fd-97d3-ab57c17cd83c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:35.991483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:35.991483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:35.991483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:35.991483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:35.991483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:35.991483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:35.991483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:35.991483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:35.991483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:35.991483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:35.991483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:35.991483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:35.991483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:35.991483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:35.991483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:35.992511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:35.992511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:35.992511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:35.992511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:35.992511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:35.992511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:35.992511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:35.992511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:35.992511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:35.992511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:35.992511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:35.992511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:35.992511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:35.992511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:35.992511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:35.992511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:35.992511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:35.999698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:35.999698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:35.999698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:35.999698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 535/1064] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:36.000201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc5c6e-9cdd-4607-92b5-63eb8c805ce8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:36.098646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:36.111813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc5c6e-9cdd-4607-92b5-63eb8c805ce8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:36.148391 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9617c1-5997-4219-87df-9d00f94483fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:36.149281 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9617c1-5997-4219-87df-9d00f94483fd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:36.149687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9617c1-5997-4219-87df-9d00f94483fd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:36.149972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9617c1-5997-4219-87df-9d00f94483fd None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:36.150623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9617c1-5997-4219-87df-9d00f94483fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:36.150967 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9617c1-5997-4219-87df-9d00f94483fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:36.152347 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9617c1-5997-4219-87df-9d00f94483fd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:36.168624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 530/1065] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:36.170210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397df11-d4c5-49fd-97d3-ab57c17cd83c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:36.234787 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65045346-b8a7-4192-987f-7722cdf62f91 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:36.235077 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65045346-b8a7-4192-987f-7722cdf62f91 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:36.235361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65045346-b8a7-4192-987f-7722cdf62f91 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:36.237177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 531/1066] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:36.242218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9869c5-6b68-4d03-8183-c7a7f069e204 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:36.243092 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9869c5-6b68-4d03-8183-c7a7f069e204 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:36.243370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9869c5-6b68-4d03-8183-c7a7f069e204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:36.261237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7a9869c5-6b68-4d03-8183-c7a7f069e204 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:36.262425 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7a9869c5-6b68-4d03-8183-c7a7f069e204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:36.279222 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397df11-d4c5-49fd-97d3-ab57c17cd83c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:36.311126 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:36.316673 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd782ed-f1da-4ea1-b079-4b1bf621df56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:36.317254 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd782ed-f1da-4ea1-b079-4b1bf621df56 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:36.317552 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd782ed-f1da-4ea1-b079-4b1bf621df56 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:36.323344 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd782ed-f1da-4ea1-b079-4b1bf621df56 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:36.325816 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd782ed-f1da-4ea1-b079-4b1bf621df56 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:36.327303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd782ed-f1da-4ea1-b079-4b1bf621df56 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:36.336167 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 532/1067] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 10:44:36.338249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-ecd782ed-f1da-4ea1-b079-4b1bf621df56 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 10:44:36.338249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:36.338249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:36.338249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:36.338249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:36.338249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:36.338249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:36.338249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:36.338249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:36.338249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:36.338249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:36.338249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:36.338249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:44:36.338249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:44:36.338249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:44:36.338249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:44:36.339392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:36.339392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:36.339392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:44:36.339392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:36.339392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:44:36.339392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:36.339392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:36.339392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:36.339392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:36.339392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:36.339392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:36.339392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:36.339392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:36.339392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:36.339392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:36.339392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:36.339392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:36.339392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:36.340353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:36.340353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:36.340353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:44:36.340353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:44:36.340353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:44:36.340353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:44:36.340353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:44:36.340353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:44:36.340353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 10:44:36.340353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:36.344114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 536/1068] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Aug 11 10:44:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:36.345051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9869c5-6b68-4d03-8183-c7a7f069e204 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:36.360367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd782ed-f1da-4ea1-b079-4b1bf621df56 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:36.433146 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:36.454624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9869c5-6b68-4d03-8183-c7a7f069e204 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:36.470592 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd782ed-f1da-4ea1-b079-4b1bf621df56 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:36.493471 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c276d-8cbe-48d7-a26e-5d2289009763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:36.494376 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c276d-8cbe-48d7-a26e-5d2289009763 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:36.494661 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c276d-8cbe-48d7-a26e-5d2289009763 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:36.494966 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c276d-8cbe-48d7-a26e-5d2289009763 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:36.495699 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c276d-8cbe-48d7-a26e-5d2289009763 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:36.496008 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c276d-8cbe-48d7-a26e-5d2289009763 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:36.497876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c276d-8cbe-48d7-a26e-5d2289009763 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:36.511472 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf292b4c-4d53-43df-9116-2e863ebea42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:36.512116 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf292b4c-4d53-43df-9116-2e863ebea42e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:36.512396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf292b4c-4d53-43df-9116-2e863ebea42e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:36.512668 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf292b4c-4d53-43df-9116-2e863ebea42e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:36.521979 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 533/1069] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Aug 11 10:44:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:36.523354 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c276d-8cbe-48d7-a26e-5d2289009763 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:36.531829 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf292b4c-4d53-43df-9116-2e863ebea42e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:44:36.536535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-bf292b4c-4d53-43df-9116-2e863ebea42e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:44:36.536535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:36.536535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:36.536535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:36.536535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:36.536535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:36.536535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:36.536535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:36.536535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:36.536535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:36.536535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:36.536535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:36.536535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:44:36.536535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:44:36.536535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:44:36.536535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:44:36.537611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:44:36.537611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:44:36.537611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:44:36.537611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:44:36.537611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:36.537611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:36.537611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:36.537611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:36.537611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:36.537611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:36.537611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:36.537611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:36.537611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:36.537611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:36.537611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:36.537611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:36.538707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:36.538707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:36.538707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:36.538707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:36.538707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:44:36.538707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:44:36.538707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:44:36.538707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:44:36.538707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:44:36.538707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:44:36.538707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:44:36.538707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:36.539618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 537/1070] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:44:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:36.545426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf292b4c-4d53-43df-9116-2e863ebea42e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:36.599492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:36.634643 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c276d-8cbe-48d7-a26e-5d2289009763 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:36.648167 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf292b4c-4d53-43df-9116-2e863ebea42e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:36.674452 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac3fef-414b-45aa-8d17-5ec7f8a57eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:36.675121 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac3fef-414b-45aa-8d17-5ec7f8a57eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:36.675405 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac3fef-414b-45aa-8d17-5ec7f8a57eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:36.675683 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac3fef-414b-45aa-8d17-5ec7f8a57eb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:36.678412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:36.686470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac3fef-414b-45aa-8d17-5ec7f8a57eb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:36.687896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac3fef-414b-45aa-8d17-5ec7f8a57eb1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:36.688322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862df88-ec1d-4bfb-9c63-4d181bd14133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:36.689081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862df88-ec1d-4bfb-9c63-4d181bd14133 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:36.689357 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862df88-ec1d-4bfb-9c63-4d181bd14133 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:36.689798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862df88-ec1d-4bfb-9c63-4d181bd14133 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:36.690791 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862df88-ec1d-4bfb-9c63-4d181bd14133 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:36.691094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862df88-ec1d-4bfb-9c63-4d181bd14133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:36.692450 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862df88-ec1d-4bfb-9c63-4d181bd14133 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:36.703536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-75ac3fef-414b-45aa-8d17-5ec7f8a57eb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:36.703536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:36.703536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:36.703536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:36.703536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:36.703536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:36.703536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:36.703536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:36.703536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:36.703536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:36.703536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:36.703536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:36.703536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:36.703536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:36.703536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:36.703536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:36.709759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:36.709759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:36.709759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:36.709759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:36.709759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:36.709759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:36.709759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:36.709759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:36.709759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:36.709759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:36.709759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:36.709759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:36.709759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:36.709759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:36.709759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:36.709759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:36.709759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:36.710656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:36.710656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:36.710656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:36.710656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 534/1071] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:36.710902 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 538/1072] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:44:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:36.710986 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac3fef-414b-45aa-8d17-5ec7f8a57eb1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:36.711145 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862df88-ec1d-4bfb-9c63-4d181bd14133 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:36.813352 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862df88-ec1d-4bfb-9c63-4d181bd14133 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:36.821830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac3fef-414b-45aa-8d17-5ec7f8a57eb1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:36.827716 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:36.847551 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201cc21-9b4c-4eb0-a116-2ffb69a36e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:36.848162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201cc21-9b4c-4eb0-a116-2ffb69a36e29 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:36.848509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201cc21-9b4c-4eb0-a116-2ffb69a36e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:36.848741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201cc21-9b4c-4eb0-a116-2ffb69a36e29 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:36.849381 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201cc21-9b4c-4eb0-a116-2ffb69a36e29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:36.849686 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201cc21-9b4c-4eb0-a116-2ffb69a36e29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:36.851090 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1201cc21-9b4c-4eb0-a116-2ffb69a36e29 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:36.855724 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20565e74-b9ed-4605-a49f-09a6e7b67725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:36.856348 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20565e74-b9ed-4605-a49f-09a6e7b67725 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:36.856628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20565e74-b9ed-4605-a49f-09a6e7b67725 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:36.856897 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20565e74-b9ed-4605-a49f-09a6e7b67725 None admin] PATH_INFO: `/v3/users/752d4ac7c34b40eca53180c50a41087d` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:36.857999 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20565e74-b9ed-4605-a49f-09a6e7b67725 None admin] RBAC: Authorizing `identity:get_user(user_id=752d4ac7c34b40eca53180c50a41087d)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:36.859721 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20565e74-b9ed-4605-a49f-09a6e7b67725 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:36.861286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 535/1073] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:44:36 2022] GET /identity/v3/users/752d4ac7c34b40eca53180c50a41087d => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:36.862461 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6797141-1b82-4856-8407-ed9e45be1432 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:36.862986 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6797141-1b82-4856-8407-ed9e45be1432 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:36.863112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 539/1074] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:36.863202 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6797141-1b82-4856-8407-ed9e45be1432 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:36.864195 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 536/1075] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:36.870009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6797141-1b82-4856-8407-ed9e45be1432 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:36.870282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea9bb2-94a7-4255-a0ef-9e683a4a9b1a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:36.877562 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea9bb2-94a7-4255-a0ef-9e683a4a9b1a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:36.877562 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea9bb2-94a7-4255-a0ef-9e683a4a9b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:36.888950 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-faea9bb2-94a7-4255-a0ef-9e683a4a9b1a None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:36.890130 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-faea9bb2-94a7-4255-a0ef-9e683a4a9b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:36.952220 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:36.962565 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 540/1076] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 10:44:36.963647 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea9bb2-94a7-4255-a0ef-9e683a4a9b1a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:36.998000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6797141-1b82-4856-8407-ed9e45be1432 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:37.033078 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2904f3-cab9-49af-b60a-23c646b64ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:37.033721 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2904f3-cab9-49af-b60a-23c646b64ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:37.034004 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2904f3-cab9-49af-b60a-23c646b64ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:37.034278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2904f3-cab9-49af-b60a-23c646b64ee6 None admin] PATH_INFO: `/v3/projects/0614569dfdcf4a308e77e17b9a9145d4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:37.035441 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2904f3-cab9-49af-b60a-23c646b64ee6 None admin] RBAC: Authorizing `identity:get_project(project_id=0614569dfdcf4a308e77e17b9a9145d4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:37.036876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2904f3-cab9-49af-b60a-23c646b64ee6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:37.038507 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 537/1077] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:44:36 2022] GET /identity/v3/projects/0614569dfdcf4a308e77e17b9a9145d4 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:37.043150 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2904f3-cab9-49af-b60a-23c646b64ee6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:37.068796 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea9bb2-94a7-4255-a0ef-9e683a4a9b1a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:37.071297 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:37.103007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d4fc3-89ce-454d-b39f-4f2e9a575318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:37.103638 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d4fc3-89ce-454d-b39f-4f2e9a575318 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:37.103920 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d4fc3-89ce-454d-b39f-4f2e9a575318 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:37.104193 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d4fc3-89ce-454d-b39f-4f2e9a575318 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:37.111434 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d4fc3-89ce-454d-b39f-4f2e9a575318 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:37.112885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d4fc3-89ce-454d-b39f-4f2e9a575318 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:37.124578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-e81d4fc3-89ce-454d-b39f-4f2e9a575318 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:37.124578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:37.124578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:37.124578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:37.124578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:37.124578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:37.124578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:37.124578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:37.124578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:37.124578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:37.124578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:37.124578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:37.124578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:44:37.124578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:44:37.124578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:44:37.125470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:44:37.125470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:37.125470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:37.125470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:37.125470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:37.125470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:37.125470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:37.125470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:37.125470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:37.125470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:37.125470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:37.125470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:37.125470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:37.125470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:37.125470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:37.125470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:37.125470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:37.126786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:44:37.126786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:44:37.126786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:44:37.126786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:44:37.126786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:44:37.126786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:44:37.126786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:37.126786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:37.126786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 541/1078] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:44:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:37.126786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d4fc3-89ce-454d-b39f-4f2e9a575318 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:37.147701 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2904f3-cab9-49af-b60a-23c646b64ee6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:37.170618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:37.182197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c540081-ba80-4cde-9167-8dfc40d6e725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:37.182829 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c540081-ba80-4cde-9167-8dfc40d6e725 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:37.186475 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c540081-ba80-4cde-9167-8dfc40d6e725 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:37.186475 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c540081-ba80-4cde-9167-8dfc40d6e725 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:37.223821 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d4fc3-89ce-454d-b39f-4f2e9a575318 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:37.251403 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c540081-ba80-4cde-9167-8dfc40d6e725 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:37.252843 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c540081-ba80-4cde-9167-8dfc40d6e725 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:37.259406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d01ab-45f2-476a-a072-4fb8dc3c0dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:37.260068 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d01ab-45f2-476a-a072-4fb8dc3c0dfd None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:37.260352 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d01ab-45f2-476a-a072-4fb8dc3c0dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:37.260629 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d01ab-45f2-476a-a072-4fb8dc3c0dfd None admin] PATH_INFO: `/v3/projects/0614569dfdcf4a308e77e17b9a9145d4/users/752d4ac7c34b40eca53180c50a41087d/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:37.262571 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d01ab-45f2-476a-a072-4fb8dc3c0dfd None admin] RBAC: Authorizing `identity:create_grant(project_id=0614569dfdcf4a308e77e17b9a9145d4, user_id=752d4ac7c34b40eca53180c50a41087d, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:37.264034 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d01ab-45f2-476a-a072-4fb8dc3c0dfd None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:37.341355 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 542/1079] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:44:37 2022] PUT /identity/v3/projects/0614569dfdcf4a308e77e17b9a9145d4/users/752d4ac7c34b40eca53180c50a41087d/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:44:37.342214 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d01ab-45f2-476a-a072-4fb8dc3c0dfd None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:37.349350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 538/1080] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:44:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 10:44:37.356395 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c540081-ba80-4cde-9167-8dfc40d6e725 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:37.372188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:37.386966 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:37.454411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d01ab-45f2-476a-a072-4fb8dc3c0dfd None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:37.477923 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c540081-ba80-4cde-9167-8dfc40d6e725 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:37.505195 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8da35-6f7b-459c-8cb8-8fbe4eae4f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:37.505836 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8da35-6f7b-459c-8cb8-8fbe4eae4f35 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:37.506089 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8da35-6f7b-459c-8cb8-8fbe4eae4f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:37.506367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8da35-6f7b-459c-8cb8-8fbe4eae4f35 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:37.507088 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8da35-6f7b-459c-8cb8-8fbe4eae4f35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:37.507392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8da35-6f7b-459c-8cb8-8fbe4eae4f35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:37.508946 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8da35-6f7b-459c-8cb8-8fbe4eae4f35 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:37.519398 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2281a-54f6-456e-a4b6-26dad4ba28dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:37.520035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2281a-54f6-456e-a4b6-26dad4ba28dc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:37.520307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2281a-54f6-456e-a4b6-26dad4ba28dc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:37.520579 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2281a-54f6-456e-a4b6-26dad4ba28dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:37.521675 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 543/1081] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:44:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:37.528559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8da35-6f7b-459c-8cb8-8fbe4eae4f35 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:37.532210 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2281a-54f6-456e-a4b6-26dad4ba28dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:37.533670 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2281a-54f6-456e-a4b6-26dad4ba28dc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:37.548961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-aba2281a-54f6-456e-a4b6-26dad4ba28dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:37.548961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:37.548961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:37.548961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:37.548961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:37.548961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:37.548961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:37.548961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:37.548961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:37.548961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:37.548961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:37.548961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:37.548961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:37.548961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:37.548961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:37.548961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:37.550026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:37.550026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:37.550026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:37.550026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:37.550026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:37.550026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:37.550026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:37.550026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:37.550026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:37.550026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:37.550026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:37.550026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:37.550026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:37.550026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:37.550026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:37.550026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:37.550026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:37.550915 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:37.550915 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:37.550915 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:37.552488 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 539/1082] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:37.557991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2281a-54f6-456e-a4b6-26dad4ba28dc None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:37.620502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:37.637386 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8da35-6f7b-459c-8cb8-8fbe4eae4f35 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:37.638171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:37.662434 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2281a-54f6-456e-a4b6-26dad4ba28dc None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:37.671849 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2ff53-c376-49ff-836e-2d2faba1ca2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:37.672508 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2ff53-c376-49ff-836e-2d2faba1ca2e None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:37.672795 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2ff53-c376-49ff-836e-2d2faba1ca2e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:37.673069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2ff53-c376-49ff-836e-2d2faba1ca2e None admin] PATH_INFO: `/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/9267752ac6724013bc1edcdecff48dd7/roles/0abfe51f95874cceae89482cf378713c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:37.678509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2ff53-c376-49ff-836e-2d2faba1ca2e None admin] RBAC: Authorizing `identity:create_grant(project_id=bb12c96bf3a84df0b86967fbe93d1c17, user_id=9267752ac6724013bc1edcdecff48dd7, role_id=0abfe51f95874cceae89482cf378713c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:37.678509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2ff53-c376-49ff-836e-2d2faba1ca2e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:37.697933 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d4653-2d87-4e04-b48b-c9b13d5ad07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:37.698550 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d4653-2d87-4e04-b48b-c9b13d5ad07b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:37.699068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d4653-2d87-4e04-b48b-c9b13d5ad07b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:37.699198 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d4653-2d87-4e04-b48b-c9b13d5ad07b None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:37.699824 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d4653-2d87-4e04-b48b-c9b13d5ad07b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:37.700128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d4653-2d87-4e04-b48b-c9b13d5ad07b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:37.701506 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d4653-2d87-4e04-b48b-c9b13d5ad07b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:37.714125 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 540/1083] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:37.801168 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 544/1084] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:44:37 2022] PUT /identity/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/9267752ac6724013bc1edcdecff48dd7/roles/0abfe51f95874cceae89482cf378713c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 10:44:39.364692 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4482d-cac8-47a4-8557-7ffe9686fee0 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:39.365212 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4482d-cac8-47a4-8557-7ffe9686fee0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:39.365324 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4482d-cac8-47a4-8557-7ffe9686fee0 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:39.366752 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 541/1085] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:39.372352 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc09e9-083b-45ad-bad5-d364175c253e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:39.372757 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc09e9-083b-45ad-bad5-d364175c253e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:39.373034 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc09e9-083b-45ad-bad5-d364175c253e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:39.391030 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-68bc09e9-083b-45ad-bad5-d364175c253e None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:39.392201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-68bc09e9-083b-45ad-bad5-d364175c253e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:39.456822 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 545/1086] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:39.481537 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4482d-cac8-47a4-8557-7ffe9686fee0 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:39.579891 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4482d-cac8-47a4-8557-7ffe9686fee0 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:39.613389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f9752-38ec-4fac-88d4-a5ee89d3cb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:39.614008 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f9752-38ec-4fac-88d4-a5ee89d3cb84 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:39.614286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f9752-38ec-4fac-88d4-a5ee89d3cb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:39.614552 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f9752-38ec-4fac-88d4-a5ee89d3cb84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:39.617241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:39.624936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f9752-38ec-4fac-88d4-a5ee89d3cb84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:44:39.629501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-833f9752-38ec-4fac-88d4-a5ee89d3cb84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:44:39.629501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:39.629501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:39.629501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:39.629501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:39.629501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:39.629501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:39.629501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:39.629501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:39.629501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:39.629501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:39.629501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:39.629501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:44:39.629501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:44:39.629501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:44:39.629501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:44:39.644665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:44:39.644665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:44:39.644665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:44:39.644665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:44:39.644665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:39.644665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:39.644665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:39.644665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:39.644665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:39.644665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:39.644665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:39.644665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:39.644665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:39.644665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:39.644665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:39.644665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:39.645518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:39.645518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:39.645518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:39.645518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:39.645518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:44:39.645518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:44:39.645518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:44:39.645518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:44:39.645518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:44:39.645518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:44:39.645518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:44:39.645518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:39.645518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 542/1087] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:44:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:39.646195 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc09e9-083b-45ad-bad5-d364175c253e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:39.709679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:39.734458 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc09e9-083b-45ad-bad5-d364175c253e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:39.769378 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed44f91-11c7-4c1c-8ffa-aba3d5c236a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:39.769985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed44f91-11c7-4c1c-8ffa-aba3d5c236a4 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:39.770264 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed44f91-11c7-4c1c-8ffa-aba3d5c236a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:39.770535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed44f91-11c7-4c1c-8ffa-aba3d5c236a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:39.771246 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed44f91-11c7-4c1c-8ffa-aba3d5c236a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:39.771546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed44f91-11c7-4c1c-8ffa-aba3d5c236a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:39.772920 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed44f91-11c7-4c1c-8ffa-aba3d5c236a4 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:39.781147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 546/1088] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:44:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:39.792710 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f9752-38ec-4fac-88d4-a5ee89d3cb84 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:39.825288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a7519-effa-48d1-bb80-fce118a9f187 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:39.825576 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a7519-effa-48d1-bb80-fce118a9f187 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:39.825854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a7519-effa-48d1-bb80-fce118a9f187 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:39.827216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 547/1089] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:44:39.832282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d4fed-7172-4ac2-8091-a8a5637fc7f1 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:39.832573 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d4fed-7172-4ac2-8091-a8a5637fc7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:39.832853 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d4fed-7172-4ac2-8091-a8a5637fc7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:39.850334 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ba1d4fed-7172-4ac2-8091-a8a5637fc7f1 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:39.852052 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ba1d4fed-7172-4ac2-8091-a8a5637fc7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:39.888586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f9752-38ec-4fac-88d4-a5ee89d3cb84 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:39.918030 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 548/1090] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 10:44:39.922348 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c4bcd-ba74-49d6-bac7-8d4e340dd36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:39.923013 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c4bcd-ba74-49d6-bac7-8d4e340dd36d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:39.923294 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c4bcd-ba74-49d6-bac7-8d4e340dd36d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:39.923565 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c4bcd-ba74-49d6-bac7-8d4e340dd36d None admin] PATH_INFO: `/v3/users/752d4ac7c34b40eca53180c50a41087d` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:39.924669 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c4bcd-ba74-49d6-bac7-8d4e340dd36d None admin] RBAC: Authorizing `identity:get_user(user_id=752d4ac7c34b40eca53180c50a41087d)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:39.926087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c4bcd-ba74-49d6-bac7-8d4e340dd36d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:39.932824 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 543/1091] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:44:39 2022] GET /identity/v3/users/752d4ac7c34b40eca53180c50a41087d => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:39.933891 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d4fed-7172-4ac2-8091-a8a5637fc7f1 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:39.941720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c4bcd-ba74-49d6-bac7-8d4e340dd36d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:39.996638 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:40.003066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:40.028783 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d4fed-7172-4ac2-8091-a8a5637fc7f1 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:40.040351 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c4bcd-ba74-49d6-bac7-8d4e340dd36d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:40.063608 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19edad-dcd8-4730-844b-b75fd2354b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:40.064210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19edad-dcd8-4730-844b-b75fd2354b9a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:40.064483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19edad-dcd8-4730-844b-b75fd2354b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:40.064749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19edad-dcd8-4730-844b-b75fd2354b9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:40.074224 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b3ba4-d9a4-4eca-8859-61392c12a184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:40.074886 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b3ba4-d9a4-4eca-8859-61392c12a184 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:40.075172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b3ba4-d9a4-4eca-8859-61392c12a184 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:40.075442 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b3ba4-d9a4-4eca-8859-61392c12a184 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:40.086118 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b3ba4-d9a4-4eca-8859-61392c12a184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:44:40.091288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-464b3ba4-d9a4-4eca-8859-61392c12a184 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 10:44:40.091288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:40.091288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:40.091288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:40.091288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:40.091288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:40.091288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:40.091288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:40.091288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:40.091288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:40.091288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:40.091288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:40.091288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:44:40.091288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:44:40.091288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:44:40.091288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:44:40.092389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:44:40.092389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:44:40.092389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:44:40.092389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:44:40.092389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:40.092389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:40.092389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:40.092389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:40.092389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:40.092389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:40.092389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:40.092389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:40.092389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:40.092389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:40.092389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:40.092389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:40.093286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:40.093286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:40.093286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:40.093286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:40.093286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:44:40.093286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:44:40.093286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:44:40.093286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:44:40.093286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:44:40.093286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:44:40.093286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 11 10:44:40.093286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:40.093286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 544/1092] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Aug 11 10:44:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:40.098317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b3ba4-d9a4-4eca-8859-61392c12a184 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:40.133305 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19edad-dcd8-4730-844b-b75fd2354b9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:40.135485 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19edad-dcd8-4730-844b-b75fd2354b9a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:40.198120 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b3ba4-d9a4-4eca-8859-61392c12a184 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:40.199057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:40.221588 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:40.232996 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1f844-ecbe-4dc0-9fcf-35f0100c997b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:40.233862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1f844-ecbe-4dc0-9fcf-35f0100c997b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:40.234147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1f844-ecbe-4dc0-9fcf-35f0100c997b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:40.234421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1f844-ecbe-4dc0-9fcf-35f0100c997b None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:40.235107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1f844-ecbe-4dc0-9fcf-35f0100c997b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:40.235408 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1f844-ecbe-4dc0-9fcf-35f0100c997b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:40.236775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1f844-ecbe-4dc0-9fcf-35f0100c997b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:40.237501 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 549/1093] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:44:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 10:44:40.243489 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19edad-dcd8-4730-844b-b75fd2354b9a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:40.245328 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 545/1094] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Aug 11 10:44:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:40.250985 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1f844-ecbe-4dc0-9fcf-35f0100c997b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:40.343162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19edad-dcd8-4730-844b-b75fd2354b9a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:40.349126 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1f844-ecbe-4dc0-9fcf-35f0100c997b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:40.377057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2be2a2-4ab6-4716-b5f8-cb74786819c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:40.377710 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2be2a2-4ab6-4716-b5f8-cb74786819c0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:40.377986 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2be2a2-4ab6-4716-b5f8-cb74786819c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:40.378259 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2be2a2-4ab6-4716-b5f8-cb74786819c0 None admin] PATH_INFO: `/v3/projects/0614569dfdcf4a308e77e17b9a9145d4` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:40.379378 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2be2a2-4ab6-4716-b5f8-cb74786819c0 None admin] RBAC: Authorizing `identity:get_project(project_id=0614569dfdcf4a308e77e17b9a9145d4)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:40.380812 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2be2a2-4ab6-4716-b5f8-cb74786819c0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:40.382408 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 550/1095] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:44:40 2022] GET /identity/v3/projects/0614569dfdcf4a308e77e17b9a9145d4 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:40.383241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f4915-a171-4e5f-b32d-3cbd765a58bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:40.383936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f4915-a171-4e5f-b32d-3cbd765a58bd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:40.384215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f4915-a171-4e5f-b32d-3cbd765a58bd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:40.384484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f4915-a171-4e5f-b32d-3cbd765a58bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:40.388461 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2be2a2-4ab6-4716-b5f8-cb74786819c0 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:40.394437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f4915-a171-4e5f-b32d-3cbd765a58bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:40.395900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f4915-a171-4e5f-b32d-3cbd765a58bd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:40.411241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-1f2f4915-a171-4e5f-b32d-3cbd765a58bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:40.411241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:40.411241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:40.411241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:40.411241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:40.411241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:40.411241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:40.411241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:40.411241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:40.411241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:40.411241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:40.411241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:40.411241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:40.411241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:40.411241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:40.411241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:40.412218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:40.412218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:40.412218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:40.412218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:40.412218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:40.412218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:40.412218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:40.412218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:40.412218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:40.412218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:40.412218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:40.412218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:40.412218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:40.412218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:40.412218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:40.412218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:40.412218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:40.413450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:40.413450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:40.413450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:40.413450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 546/1096] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:44:40.418619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f4915-a171-4e5f-b32d-3cbd765a58bd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:40.423517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:40.457579 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:40.489012 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2be2a2-4ab6-4716-b5f8-cb74786819c0 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:40.519477 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f4915-a171-4e5f-b32d-3cbd765a58bd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:40.521866 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783b8ba-7fc8-4893-9e9a-1679046d756b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:40.522465 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783b8ba-7fc8-4893-9e9a-1679046d756b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:40.522745 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783b8ba-7fc8-4893-9e9a-1679046d756b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:40.523043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783b8ba-7fc8-4893-9e9a-1679046d756b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:40.524439 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783b8ba-7fc8-4893-9e9a-1679046d756b None admin] RBAC: Adding query filter params (role.id=00c6de5dd6cd4267ba05941ddb91e6ad, scope.project.id=0614569dfdcf4a308e77e17b9a9145d4, user.id=752d4ac7c34b40eca53180c50a41087d) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:40.524766 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783b8ba-7fc8-4893-9e9a-1679046d756b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:40.526196 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783b8ba-7fc8-4893-9e9a-1679046d756b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:40.532028 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 551/1097] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:44:40 2022] GET /identity/v3/role_assignments?user.id=752d4ac7c34b40eca53180c50a41087d&scope.project.id=0614569dfdcf4a308e77e17b9a9145d4&role.id=00c6de5dd6cd4267ba05941ddb91e6ad => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:40.554646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cb06a-d5a0-4c93-9d4a-7527e8058cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:40.555483 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cb06a-d5a0-4c93-9d4a-7527e8058cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:40.555765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cb06a-d5a0-4c93-9d4a-7527e8058cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:40.556043 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cb06a-d5a0-4c93-9d4a-7527e8058cc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:40.556723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2cb06a-d5a0-4c93-9d4a-7527e8058cc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:40.557031 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2cb06a-d5a0-4c93-9d4a-7527e8058cc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:40.558471 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2cb06a-d5a0-4c93-9d4a-7527e8058cc3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:40.571398 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 547/1098] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:40.576999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783b8ba-7fc8-4893-9e9a-1679046d756b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:40.678516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:40.682236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783b8ba-7fc8-4893-9e9a-1679046d756b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:40.716248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c214e6-a8de-4ffb-a3d0-e71160a33e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:40.716804 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c214e6-a8de-4ffb-a3d0-e71160a33e3a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:40.717081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c214e6-a8de-4ffb-a3d0-e71160a33e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:40.717352 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c214e6-a8de-4ffb-a3d0-e71160a33e3a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:40.724952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c214e6-a8de-4ffb-a3d0-e71160a33e3a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:40.726510 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c214e6-a8de-4ffb-a3d0-e71160a33e3a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:40.737919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-44c214e6-a8de-4ffb-a3d0-e71160a33e3a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 11 10:44:40.737919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:40.737919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:40.737919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:40.737919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:40.737919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:40.737919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:40.737919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:40.737919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:40.737919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:40.737919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:40.737919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:40.737919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:44:40.737919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:44:40.737919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:44:40.737919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:44:40.739002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:40.739002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:40.739002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:44:40.739002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:40.739002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:44:40.739002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:44:40.739002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:40.739002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:40.739002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:40.739002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:40.739002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:40.739002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:40.739002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:40.739002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:40.739002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:40.739002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:40.739002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:40.739002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:40.740398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:40.740398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:40.740398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:44:40.740398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:44:40.740398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:44:40.740398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:44:40.740398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:44:40.740398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:44:40.740398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 11 10:44:40.740398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:40.740398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 552/1099] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Aug 11 10:44:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:40.745083 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cb06a-d5a0-4c93-9d4a-7527e8058cc3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:40.843493 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:40.847239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cb06a-d5a0-4c93-9d4a-7527e8058cc3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:40.881948 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381efee3-460d-48f6-9682-da660ac5d465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:40.882560 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381efee3-460d-48f6-9682-da660ac5d465 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:40.882899 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381efee3-460d-48f6-9682-da660ac5d465 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:40.883174 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381efee3-460d-48f6-9682-da660ac5d465 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:40.883923 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381efee3-460d-48f6-9682-da660ac5d465 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:40.884227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381efee3-460d-48f6-9682-da660ac5d465 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:40.885635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381efee3-460d-48f6-9682-da660ac5d465 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:40.903227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 548/1100] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Aug 11 10:44:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:40.909036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c214e6-a8de-4ffb-a3d0-e71160a33e3a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:41.006837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c214e6-a8de-4ffb-a3d0-e71160a33e3a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:41.044049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0b417-15e1-430c-970f-524a475f202a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:41.044657 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0b417-15e1-430c-970f-524a475f202a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:41.044933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0b417-15e1-430c-970f-524a475f202a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:41.045200 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0b417-15e1-430c-970f-524a475f202a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:41.070746 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:41.110860 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0b417-15e1-430c-970f-524a475f202a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:41.112320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0b417-15e1-430c-970f-524a475f202a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:41.210610 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 553/1101] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:44:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 10:44:41.217004 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381efee3-460d-48f6-9682-da660ac5d465 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:41.318320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381efee3-460d-48f6-9682-da660ac5d465 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:41.351780 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c0c7f-4f18-4c8a-8312-47b3298c5647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:41.352406 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c0c7f-4f18-4c8a-8312-47b3298c5647 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:41.352689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c0c7f-4f18-4c8a-8312-47b3298c5647 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:41.352966 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c0c7f-4f18-4c8a-8312-47b3298c5647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:41.363212 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c0c7f-4f18-4c8a-8312-47b3298c5647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:41.364665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c0c7f-4f18-4c8a-8312-47b3298c5647 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:41.378716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e21c0c7f-4f18-4c8a-8312-47b3298c5647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:41.378716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:41.378716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:41.378716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:41.378716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:41.378716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:41.378716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:41.378716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:41.378716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:41.378716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:41.378716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:41.378716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:41.378716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:44:41.378716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:44:41.378716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:44:41.378716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:44:41.379633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:41.379633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:41.379633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:41.379633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:41.379633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:41.379633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:41.379633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:41.379633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:41.379633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:41.379633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:41.379633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:41.379633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:41.379633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:41.379633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:41.379633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:41.379633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:41.379633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:44:41.380470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:44:41.380470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:44:41.380470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:41.380470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 549/1102] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:41.386218 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0b417-15e1-430c-970f-524a475f202a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:41.442466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:41.483892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0b417-15e1-430c-970f-524a475f202a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:41.516913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaeaec-f7e3-4de8-872a-bead6f9aeed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:41.517510 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaeaec-f7e3-4de8-872a-bead6f9aeed3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:41.517791 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaeaec-f7e3-4de8-872a-bead6f9aeed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:41.518066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaeaec-f7e3-4de8-872a-bead6f9aeed3 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:41.518708 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaeaec-f7e3-4de8-872a-bead6f9aeed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:41.519041 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaeaec-f7e3-4de8-872a-bead6f9aeed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:41.520399 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaeaec-f7e3-4de8-872a-bead6f9aeed3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:41.531553 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 554/1103] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:41.537127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c0c7f-4f18-4c8a-8312-47b3298c5647 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:41.548754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:41.636990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c0c7f-4f18-4c8a-8312-47b3298c5647 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:41.670052 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc6c9a-d259-4b98-aa0a-b3f12dea65c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:41.670708 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc6c9a-d259-4b98-aa0a-b3f12dea65c4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:41.671022 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc6c9a-d259-4b98-aa0a-b3f12dea65c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:41.671301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc6c9a-d259-4b98-aa0a-b3f12dea65c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:41.678901 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc6c9a-d259-4b98-aa0a-b3f12dea65c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:41.681010 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc6c9a-d259-4b98-aa0a-b3f12dea65c4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:41.692781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-74cc6c9a-d259-4b98-aa0a-b3f12dea65c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:41.692781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:41.692781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:41.692781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:41.692781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:41.692781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:41.692781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:41.692781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:41.692781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:41.692781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:41.692781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:41.692781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:41.692781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:44:41.692781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:44:41.692781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:44:41.693831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:44:41.693831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:41.693831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:41.693831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:41.693831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:41.693831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:41.693831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:41.693831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:41.693831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:41.693831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:41.693831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:41.693831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:41.693831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:41.693831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:41.693831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:41.693831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:41.693831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:41.694972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:44:41.694972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:44:41.694972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:44:41.694972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:44:41.694972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:44:41.694972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:44:41.694972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:44:41.694972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:44:41.694972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 550/1104] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:44:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:41.699715 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaeaec-f7e3-4de8-872a-bead6f9aeed3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:41.797114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaeaec-f7e3-4de8-872a-bead6f9aeed3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:41.813872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:41.830378 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0c270-452c-42f2-9f40-be4881d2f594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:41.831015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0c270-452c-42f2-9f40-be4881d2f594 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:41.831300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0c270-452c-42f2-9f40-be4881d2f594 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:41.831575 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0c270-452c-42f2-9f40-be4881d2f594 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:41.832300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0c270-452c-42f2-9f40-be4881d2f594 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:41.832607 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0c270-452c-42f2-9f40-be4881d2f594 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:41.834057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0c270-452c-42f2-9f40-be4881d2f594 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:41.846207 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 555/1105] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:44:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:44:41.853134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc6c9a-d259-4b98-aa0a-b3f12dea65c4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:41.919706 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:41.951943 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc6c9a-d259-4b98-aa0a-b3f12dea65c4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:41.985992 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ada9ea-7bc6-4a6f-a9d5-9fbe8891798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:41.986595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ada9ea-7bc6-4a6f-a9d5-9fbe8891798d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:41.986912 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ada9ea-7bc6-4a6f-a9d5-9fbe8891798d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:41.987191 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ada9ea-7bc6-4a6f-a9d5-9fbe8891798d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:41.987920 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ada9ea-7bc6-4a6f-a9d5-9fbe8891798d None admin] RBAC: Adding query filter params (role.id=0abfe51f95874cceae89482cf378713c, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=9267752ac6724013bc1edcdecff48dd7) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:41.988232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ada9ea-7bc6-4a6f-a9d5-9fbe8891798d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:41.989659 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ada9ea-7bc6-4a6f-a9d5-9fbe8891798d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:41.996001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 551/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:44:41 2022] GET /identity/v3/role_assignments?user.id=9267752ac6724013bc1edcdecff48dd7&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=0abfe51f95874cceae89482cf378713c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:42.587637 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b21a4-535e-428c-8c32-dfef3c8efe6a None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:42.588193 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b21a4-535e-428c-8c32-dfef3c8efe6a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:42.588193 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b21a4-535e-428c-8c32-dfef3c8efe6a None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:42.589488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 556/1107] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:42.594822 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51a880-faef-4726-9004-8a92ff163ad5 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:42.595237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51a880-faef-4726-9004-8a92ff163ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:42.595344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51a880-faef-4726-9004-8a92ff163ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:42.613907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-fa51a880-faef-4726-9004-8a92ff163ad5 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:42.615104 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fa51a880-faef-4726-9004-8a92ff163ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:42.682156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 552/1108] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:42.706924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b21a4-535e-428c-8c32-dfef3c8efe6a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:42.822599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b21a4-535e-428c-8c32-dfef3c8efe6a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:42.857833 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c240519-3c2d-4bcf-a208-cc5bdfa82143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:42.858721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c240519-3c2d-4bcf-a208-cc5bdfa82143 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:42.859064 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c240519-3c2d-4bcf-a208-cc5bdfa82143 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:42.859338 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c240519-3c2d-4bcf-a208-cc5bdfa82143 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:42.860443 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c240519-3c2d-4bcf-a208-cc5bdfa82143 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:42.861911 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c240519-3c2d-4bcf-a208-cc5bdfa82143 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:42.863579 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 557/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:42.869434 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51a880-faef-4726-9004-8a92ff163ad5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:42.928649 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:42.966359 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51a880-faef-4726-9004-8a92ff163ad5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:42.998138 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f97411-2026-47bf-a813-b6abfd397c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:42.998737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f97411-2026-47bf-a813-b6abfd397c36 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:42.999045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f97411-2026-47bf-a813-b6abfd397c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:42.999314 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f97411-2026-47bf-a813-b6abfd397c36 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:42.999945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f97411-2026-47bf-a813-b6abfd397c36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:43.001363 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f97411-2026-47bf-a813-b6abfd397c36 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:43.090077 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 553/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Aug 11 10:44:42 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:44:45.099163 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdda50d-4fe9-454e-9f9b-d5b97d9b103b None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:45.099681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdda50d-4fe9-454e-9f9b-d5b97d9b103b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:45.099779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdda50d-4fe9-454e-9f9b-d5b97d9b103b None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:45.101032 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 558/1111] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:45.106905 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aeb980-2c23-47a0-8638-c6a274b9518e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:45.107301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aeb980-2c23-47a0-8638-c6a274b9518e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:45.107460 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aeb980-2c23-47a0-8638-c6a274b9518e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:45.125836 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-76aeb980-2c23-47a0-8638-c6a274b9518e None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:45.127038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-76aeb980-2c23-47a0-8638-c6a274b9518e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:45.190327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 554/1112] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:45.214575 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdda50d-4fe9-454e-9f9b-d5b97d9b103b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:45.260936 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:45.312307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdda50d-4fe9-454e-9f9b-d5b97d9b103b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:45.344967 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbe74c-e6fd-4b9c-af88-f0ce4a62c62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:45.345584 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbe74c-e6fd-4b9c-af88-f0ce4a62c62d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:45.345865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbe74c-e6fd-4b9c-af88-f0ce4a62c62d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:45.346139 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbe74c-e6fd-4b9c-af88-f0ce4a62c62d None admin] PATH_INFO: `/v3/roles/e9cc929c9958498d8ce27ca88f685549` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:45.347536 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbe74c-e6fd-4b9c-af88-f0ce4a62c62d None admin] RBAC: Authorizing `identity:get_role(role_id=e9cc929c9958498d8ce27ca88f685549)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:45.348900 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbe74c-e6fd-4b9c-af88-f0ce4a62c62d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:45.350173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 559/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:44:45 2022] GET /identity/v3/roles/e9cc929c9958498d8ce27ca88f685549 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:45.355945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aeb980-2c23-47a0-8638-c6a274b9518e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:45.403636 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:45.452841 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aeb980-2c23-47a0-8638-c6a274b9518e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:45.487204 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8b0f7-c7df-4a88-9afe-0ee695db1b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:45.487827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8b0f7-c7df-4a88-9afe-0ee695db1b81 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:45.488108 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8b0f7-c7df-4a88-9afe-0ee695db1b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:45.488381 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8b0f7-c7df-4a88-9afe-0ee695db1b81 None admin] PATH_INFO: `/v3/users/fd191bf904394394a19d27d8a226c40e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:45.501714 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8b0f7-c7df-4a88-9afe-0ee695db1b81 None admin] RBAC: Authorizing `identity:get_user(user_id=fd191bf904394394a19d27d8a226c40e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:45.503192 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8b0f7-c7df-4a88-9afe-0ee695db1b81 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:45.504778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 555/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:44:45 2022] GET /identity/v3/users/fd191bf904394394a19d27d8a226c40e => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:45.511209 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbe74c-e6fd-4b9c-af88-f0ce4a62c62d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:45.607543 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbe74c-e6fd-4b9c-af88-f0ce4a62c62d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:45.621797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:45.641457 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbeb0f-16a2-4329-b73e-d5e107169f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:45.642058 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbeb0f-16a2-4329-b73e-d5e107169f26 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:45.642337 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbeb0f-16a2-4329-b73e-d5e107169f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:45.642610 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbeb0f-16a2-4329-b73e-d5e107169f26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:45.717591 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbeb0f-16a2-4329-b73e-d5e107169f26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:45.719061 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbeb0f-16a2-4329-b73e-d5e107169f26 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:45.815259 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 560/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:44:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 10:44:45.821925 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8b0f7-c7df-4a88-9afe-0ee695db1b81 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:45.919668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8b0f7-c7df-4a88-9afe-0ee695db1b81 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:45.926705 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:45.952661 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f6ef8-dbc7-4eb0-bde7-f9591cc389e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:45.953284 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f6ef8-dbc7-4eb0-bde7-f9591cc389e3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:45.953565 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f6ef8-dbc7-4eb0-bde7-f9591cc389e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:45.953836 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f6ef8-dbc7-4eb0-bde7-f9591cc389e3 None admin] PATH_INFO: `/v3/projects/0614569dfdcf4a308e77e17b9a9145d4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:45.954968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f6ef8-dbc7-4eb0-bde7-f9591cc389e3 None admin] RBAC: Authorizing `identity:get_project(project_id=0614569dfdcf4a308e77e17b9a9145d4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:45.956438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f6ef8-dbc7-4eb0-bde7-f9591cc389e3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:45.958282 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 556/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:44:45 2022] GET /identity/v3/projects/0614569dfdcf4a308e77e17b9a9145d4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:45.964423 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbeb0f-16a2-4329-b73e-d5e107169f26 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:45.979479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:46.118176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbeb0f-16a2-4329-b73e-d5e107169f26 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:46.150847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137da4c-5937-4ddc-80c1-41beb7eb5ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:46.151414 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137da4c-5937-4ddc-80c1-41beb7eb5ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:46.151695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137da4c-5937-4ddc-80c1-41beb7eb5ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:46.151967 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137da4c-5937-4ddc-80c1-41beb7eb5ab3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:46.152683 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137da4c-5937-4ddc-80c1-41beb7eb5ab3 None admin] RBAC: Adding query filter params (role.id=e9cc929c9958498d8ce27ca88f685549, scope.project.id=0614569dfdcf4a308e77e17b9a9145d4, user.id=fd191bf904394394a19d27d8a226c40e) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:46.152989 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137da4c-5937-4ddc-80c1-41beb7eb5ab3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:46.154411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137da4c-5937-4ddc-80c1-41beb7eb5ab3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:46.159589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 561/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:44:45 2022] GET /identity/v3/role_assignments?user.id=fd191bf904394394a19d27d8a226c40e&scope.project.id=0614569dfdcf4a308e77e17b9a9145d4&role.id=e9cc929c9958498d8ce27ca88f685549 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:48.119134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbf535-c449-4b8f-8862-d59c87dcd731 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:48.119646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbf535-c449-4b8f-8862-d59c87dcd731 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:48.119761 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbf535-c449-4b8f-8862-d59c87dcd731 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:48.121029 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 557/1118] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:48.126064 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aedea2-c067-4e8b-bed4-cc9a3e954581 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:48.126498 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aedea2-c067-4e8b-bed4-cc9a3e954581 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:48.126597 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aedea2-c067-4e8b-bed4-cc9a3e954581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:48.144411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-62aedea2-c067-4e8b-bed4-cc9a3e954581 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:48.145570 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-62aedea2-c067-4e8b-bed4-cc9a3e954581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:48.209520 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 562/1119] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:48.232723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbf535-c449-4b8f-8862-d59c87dcd731 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:48.331621 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbf535-c449-4b8f-8862-d59c87dcd731 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:48.364608 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56baa0cc-baaf-4411-852c-dc6f31b22604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:48.365221 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56baa0cc-baaf-4411-852c-dc6f31b22604 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:48.365502 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56baa0cc-baaf-4411-852c-dc6f31b22604 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:48.365776 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56baa0cc-baaf-4411-852c-dc6f31b22604 None admin] PATH_INFO: `/v3/roles/e9cc929c9958498d8ce27ca88f685549` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:48.367267 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56baa0cc-baaf-4411-852c-dc6f31b22604 None admin] RBAC: Authorizing `identity:get_role(role_id=e9cc929c9958498d8ce27ca88f685549)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:48.368621 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56baa0cc-baaf-4411-852c-dc6f31b22604 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:48.369903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 558/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:44:48 2022] GET /identity/v3/roles/e9cc929c9958498d8ce27ca88f685549 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:48.375655 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aedea2-c067-4e8b-bed4-cc9a3e954581 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:48.386267 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:48.472309 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aedea2-c067-4e8b-bed4-cc9a3e954581 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:48.505457 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6da91-5471-4999-a88e-9e1cc958ebf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:48.506071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6da91-5471-4999-a88e-9e1cc958ebf2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:48.506354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6da91-5471-4999-a88e-9e1cc958ebf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:48.506628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6da91-5471-4999-a88e-9e1cc958ebf2 None admin] PATH_INFO: `/v3/users/fd191bf904394394a19d27d8a226c40e` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:48.508633 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6da91-5471-4999-a88e-9e1cc958ebf2 None admin] RBAC: Authorizing `identity:get_user(user_id=fd191bf904394394a19d27d8a226c40e)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:48.510059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6da91-5471-4999-a88e-9e1cc958ebf2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:48.511642 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 563/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:44:48 2022] GET /identity/v3/users/fd191bf904394394a19d27d8a226c40e => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:48.517262 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56baa0cc-baaf-4411-852c-dc6f31b22604 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:48.559561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:48.614384 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56baa0cc-baaf-4411-852c-dc6f31b22604 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:48.654268 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71674d2d-da85-4a67-a669-17e211958639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:48.654919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71674d2d-da85-4a67-a669-17e211958639 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:48.655207 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71674d2d-da85-4a67-a669-17e211958639 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:48.655482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71674d2d-da85-4a67-a669-17e211958639 None admin] PATH_INFO: `/v3/projects/0614569dfdcf4a308e77e17b9a9145d4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:48.656580 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71674d2d-da85-4a67-a669-17e211958639 None admin] RBAC: Authorizing `identity:get_project(project_id=0614569dfdcf4a308e77e17b9a9145d4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:48.658001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71674d2d-da85-4a67-a669-17e211958639 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:48.659658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 559/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:44:48 2022] GET /identity/v3/projects/0614569dfdcf4a308e77e17b9a9145d4 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:48.665751 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6da91-5471-4999-a88e-9e1cc958ebf2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:48.740556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:48.763163 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6da91-5471-4999-a88e-9e1cc958ebf2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:48.795337 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6513153-a107-4b58-b7ef-e94f02f6b81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:48.795984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6513153-a107-4b58-b7ef-e94f02f6b81b None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:48.796266 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6513153-a107-4b58-b7ef-e94f02f6b81b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:48.796542 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6513153-a107-4b58-b7ef-e94f02f6b81b None admin] PATH_INFO: `/v3/projects/0614569dfdcf4a308e77e17b9a9145d4/users/fd191bf904394394a19d27d8a226c40e/roles/e9cc929c9958498d8ce27ca88f685549` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:48.798676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6513153-a107-4b58-b7ef-e94f02f6b81b None admin] RBAC: Authorizing `identity:create_grant(project_id=0614569dfdcf4a308e77e17b9a9145d4, user_id=fd191bf904394394a19d27d8a226c40e, role_id=e9cc929c9958498d8ce27ca88f685549)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:48.800139 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6513153-a107-4b58-b7ef-e94f02f6b81b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:48.871934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 564/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:44:48 2022] PUT /identity/v3/projects/0614569dfdcf4a308e77e17b9a9145d4/users/fd191bf904394394a19d27d8a226c40e/roles/e9cc929c9958498d8ce27ca88f685549 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:44:50.843347 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15803e3-75eb-45c7-bf2c-e94962ba430d None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:50.843901 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15803e3-75eb-45c7-bf2c-e94962ba430d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:50.843901 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15803e3-75eb-45c7-bf2c-e94962ba430d None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:50.845218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 560/1124] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:50.850495 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbce99a-243a-4d62-819d-4c7cb6b91b34 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:50.851088 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbce99a-243a-4d62-819d-4c7cb6b91b34 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:50.851088 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbce99a-243a-4d62-819d-4c7cb6b91b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:50.869568 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-8fbce99a-243a-4d62-819d-4c7cb6b91b34 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:50.870739 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8fbce99a-243a-4d62-819d-4c7cb6b91b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:50.935593 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 565/1125] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:50.958989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15803e3-75eb-45c7-bf2c-e94962ba430d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:51.058965 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15803e3-75eb-45c7-bf2c-e94962ba430d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:51.069108 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:51.091856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b0812-ced3-4baa-a099-f212cfd44c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:51.092470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b0812-ced3-4baa-a099-f212cfd44c7a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:51.092749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b0812-ced3-4baa-a099-f212cfd44c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:51.093021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b0812-ced3-4baa-a099-f212cfd44c7a None admin] PATH_INFO: `/v3/roles/e9cc929c9958498d8ce27ca88f685549` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:51.094484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b0812-ced3-4baa-a099-f212cfd44c7a None admin] RBAC: Authorizing `identity:get_role(role_id=e9cc929c9958498d8ce27ca88f685549)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:51.095899 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b0812-ced3-4baa-a099-f212cfd44c7a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:51.097197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 561/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:44:50 2022] GET /identity/v3/roles/e9cc929c9958498d8ce27ca88f685549 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:51.103709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbce99a-243a-4d62-819d-4c7cb6b91b34 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:51.166421 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:51.199640 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbce99a-243a-4d62-819d-4c7cb6b91b34 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:51.232765 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552874a-8fe4-4695-b26c-2ae3fe53c4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:51.233635 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552874a-8fe4-4695-b26c-2ae3fe53c4ec None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:51.233914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552874a-8fe4-4695-b26c-2ae3fe53c4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:51.234185 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552874a-8fe4-4695-b26c-2ae3fe53c4ec None admin] PATH_INFO: `/v3/users/fd191bf904394394a19d27d8a226c40e` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:51.235314 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552874a-8fe4-4695-b26c-2ae3fe53c4ec None admin] RBAC: Authorizing `identity:get_user(user_id=fd191bf904394394a19d27d8a226c40e)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:51.236731 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552874a-8fe4-4695-b26c-2ae3fe53c4ec None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:51.238268 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 566/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:44:51 2022] GET /identity/v3/users/fd191bf904394394a19d27d8a226c40e => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:51.244901 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b0812-ced3-4baa-a099-f212cfd44c7a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:51.339661 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b0812-ced3-4baa-a099-f212cfd44c7a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:51.372671 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9807760-a41b-4bc8-85ea-2217d0d473e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:51.373210 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9807760-a41b-4bc8-85ea-2217d0d473e7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:51.373492 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9807760-a41b-4bc8-85ea-2217d0d473e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:51.373764 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9807760-a41b-4bc8-85ea-2217d0d473e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:51.418528 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:51.439351 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9807760-a41b-4bc8-85ea-2217d0d473e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:51.440779 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9807760-a41b-4bc8-85ea-2217d0d473e7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:51.537049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 562/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:44:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 10:44:51.542850 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552874a-8fe4-4695-b26c-2ae3fe53c4ec None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:51.639120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552874a-8fe4-4695-b26c-2ae3fe53c4ec None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:51.671855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753f570-80ee-40f3-877c-2c5cdc110918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:51.672479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753f570-80ee-40f3-877c-2c5cdc110918 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:51.672759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753f570-80ee-40f3-877c-2c5cdc110918 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:51.673033 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753f570-80ee-40f3-877c-2c5cdc110918 None admin] PATH_INFO: `/v3/projects/0614569dfdcf4a308e77e17b9a9145d4` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:51.674146 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753f570-80ee-40f3-877c-2c5cdc110918 None admin] RBAC: Authorizing `identity:get_project(project_id=0614569dfdcf4a308e77e17b9a9145d4)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:51.675596 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753f570-80ee-40f3-877c-2c5cdc110918 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:51.677182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 567/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:44:51 2022] GET /identity/v3/projects/0614569dfdcf4a308e77e17b9a9145d4 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:51.683674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9807760-a41b-4bc8-85ea-2217d0d473e7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:51.759911 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:51.780961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9807760-a41b-4bc8-85ea-2217d0d473e7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:51.814581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ba351-6f27-45b2-a8a5-34a5c57471db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:51.815204 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ba351-6f27-45b2-a8a5-34a5c57471db None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:51.815487 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ba351-6f27-45b2-a8a5-34a5c57471db None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:51.815760 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ba351-6f27-45b2-a8a5-34a5c57471db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:51.816482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ba351-6f27-45b2-a8a5-34a5c57471db None admin] RBAC: Adding query filter params (role.id=e9cc929c9958498d8ce27ca88f685549, scope.project.id=0614569dfdcf4a308e77e17b9a9145d4, user.id=fd191bf904394394a19d27d8a226c40e) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:51.816790 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ba351-6f27-45b2-a8a5-34a5c57471db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:51.818210 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ba351-6f27-45b2-a8a5-34a5c57471db None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:51.824064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 563/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:44:51 2022] GET /identity/v3/role_assignments?user.id=fd191bf904394394a19d27d8a226c40e&scope.project.id=0614569dfdcf4a308e77e17b9a9145d4&role.id=e9cc929c9958498d8ce27ca88f685549 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:53.860754 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c94a1-bc6c-4743-82ec-06ca086f2e18 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:53.861309 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c94a1-bc6c-4743-82ec-06ca086f2e18 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:53.861309 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c94a1-bc6c-4743-82ec-06ca086f2e18 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:53.862616 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 568/1131] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:53.867742 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0a776-f893-40e9-b0af-7e82f376246b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:53.868178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0a776-f893-40e9-b0af-7e82f376246b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:53.868283 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0a776-f893-40e9-b0af-7e82f376246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:53.885943 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6dc0a776-f893-40e9-b0af-7e82f376246b None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:53.887149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6dc0a776-f893-40e9-b0af-7e82f376246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:53.951284 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 564/1132] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 11 10:44:53.974326 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c94a1-bc6c-4743-82ec-06ca086f2e18 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:53.977852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:54.074613 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c94a1-bc6c-4743-82ec-06ca086f2e18 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:54.107981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f26cdef-ac63-4f08-abb3-f8bdc515b577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:54.108865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26cdef-ac63-4f08-abb3-f8bdc515b577 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:54.109145 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26cdef-ac63-4f08-abb3-f8bdc515b577 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:54.109417 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26cdef-ac63-4f08-abb3-f8bdc515b577 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:54.110524 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26cdef-ac63-4f08-abb3-f8bdc515b577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:54.112038 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f26cdef-ac63-4f08-abb3-f8bdc515b577 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:54.113523 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 569/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:54.119503 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0a776-f893-40e9-b0af-7e82f376246b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:54.187334 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:54.218033 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0a776-f893-40e9-b0af-7e82f376246b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:54.250604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1a276-d274-454f-8bca-e95ca4550998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:54.251234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1a276-d274-454f-8bca-e95ca4550998 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:54.251519 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1a276-d274-454f-8bca-e95ca4550998 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:54.251793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1a276-d274-454f-8bca-e95ca4550998 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:54.252440 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1a276-d274-454f-8bca-e95ca4550998 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:54.253849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1a276-d274-454f-8bca-e95ca4550998 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:54.364609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 565/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Aug 11 10:44:54 2022] POST /identity/v3/projects => generated 311 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:44:56.404954 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23615262-d4a0-4ce3-a278-51066d7db3cb None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:56.405492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23615262-d4a0-4ce3-a278-51066d7db3cb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:56.405492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23615262-d4a0-4ce3-a278-51066d7db3cb None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:56.407003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 570/1135] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:56.412051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d6772-3641-4bd0-8bce-8ed89f48440b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:56.412472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d6772-3641-4bd0-8bce-8ed89f48440b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:56.412608 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d6772-3641-4bd0-8bce-8ed89f48440b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:56.431061 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-469d6772-3641-4bd0-8bce-8ed89f48440b None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:56.432237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-469d6772-3641-4bd0-8bce-8ed89f48440b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:56.496548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 566/1136] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:56.520541 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23615262-d4a0-4ce3-a278-51066d7db3cb None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:56.588808 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:56.621093 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23615262-d4a0-4ce3-a278-51066d7db3cb None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:56.654731 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa695b-d269-4672-a468-b386b8d910a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:56.655423 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa695b-d269-4672-a468-b386b8d910a2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:56.655657 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa695b-d269-4672-a468-b386b8d910a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:56.655931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa695b-d269-4672-a468-b386b8d910a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:56.657041 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa695b-d269-4672-a468-b386b8d910a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:56.658477 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa695b-d269-4672-a468-b386b8d910a2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:56.660040 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 571/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:44:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:56.666314 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d6772-3641-4bd0-8bce-8ed89f48440b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:56.719829 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:56.763145 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d6772-3641-4bd0-8bce-8ed89f48440b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:56.797356 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b13c8-0e7c-468b-ab13-791ad7d63f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:56.797954 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b13c8-0e7c-468b-ab13-791ad7d63f13 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:56.798234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b13c8-0e7c-468b-ab13-791ad7d63f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:56.798506 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b13c8-0e7c-468b-ab13-791ad7d63f13 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:56.799168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b13c8-0e7c-468b-ab13-791ad7d63f13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:56.800578 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b13c8-0e7c-468b-ab13-791ad7d63f13 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:56.871703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 567/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Aug 11 10:44:56 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:44:58.885103 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f7942-2910-401f-b3bf-2ceb9118d35e None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:58.885661 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f7942-2910-401f-b3bf-2ceb9118d35e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:58.885661 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f7942-2910-401f-b3bf-2ceb9118d35e None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:58.887000 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 572/1139] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:44:58.892285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424711c6-bbdb-4334-b70a-c522937dbc9f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:58.892651 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424711c6-bbdb-4334-b70a-c522937dbc9f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:58.892851 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424711c6-bbdb-4334-b70a-c522937dbc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:58.911597 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-424711c6-bbdb-4334-b70a-c522937dbc9f None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:44:58.912786 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-424711c6-bbdb-4334-b70a-c522937dbc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:44:58.978274 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 568/1140] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:44:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:44:59.002500 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f7942-2910-401f-b3bf-2ceb9118d35e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:59.101052 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f7942-2910-401f-b3bf-2ceb9118d35e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:59.134563 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1796fe-594a-46be-8010-56044e3095d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:59.135263 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1796fe-594a-46be-8010-56044e3095d6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:59.135490 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1796fe-594a-46be-8010-56044e3095d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:59.135760 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1796fe-594a-46be-8010-56044e3095d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:59.142213 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:59.145865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1796fe-594a-46be-8010-56044e3095d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:44:59.150504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-7b1796fe-594a-46be-8010-56044e3095d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:44:59.150504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:44:59.150504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:44:59.150504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:44:59.150504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:44:59.150504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:44:59.150504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:44:59.150504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:44:59.150504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:44:59.150504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:44:59.150504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:44:59.150504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:44:59.150504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:44:59.150504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:44:59.150504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:44:59.150504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:44:59.151768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:44:59.151768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:44:59.151768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:44:59.151768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:44:59.151768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:44:59.151768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:44:59.151768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:44:59.151768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:44:59.151768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:44:59.151768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:44:59.151768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:44:59.151768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:44:59.151768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:44:59.151768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:44:59.151768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:44:59.151768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:44:59.152904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:44:59.152904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:44:59.152904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:44:59.152904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:44:59.152904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:44:59.152904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:44:59.152904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:44:59.152904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:44:59.152904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:44:59.152904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:44:59.152904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:44:59.152904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:44:59.152904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 573/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:44:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:44:59.157778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424711c6-bbdb-4334-b70a-c522937dbc9f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:59.199026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:59.256537 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424711c6-bbdb-4334-b70a-c522937dbc9f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:59.290308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280472b1-1b36-4d5e-853a-2402e7066c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:59.290937 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280472b1-1b36-4d5e-853a-2402e7066c17 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:59.291222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280472b1-1b36-4d5e-853a-2402e7066c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:59.291496 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280472b1-1b36-4d5e-853a-2402e7066c17 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:59.292155 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280472b1-1b36-4d5e-853a-2402e7066c17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:44:59.292462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280472b1-1b36-4d5e-853a-2402e7066c17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:59.293823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280472b1-1b36-4d5e-853a-2402e7066c17 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:59.301616 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 569/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:44:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:59.307923 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1796fe-594a-46be-8010-56044e3095d6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:59.404411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1796fe-594a-46be-8010-56044e3095d6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:59.437190 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9d9f1-8f88-469a-863f-e1c4d1593971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:59.437797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9d9f1-8f88-469a-863f-e1c4d1593971 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:59.438076 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9d9f1-8f88-469a-863f-e1c4d1593971 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:59.438343 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9d9f1-8f88-469a-863f-e1c4d1593971 None admin] PATH_INFO: `/v3/users/b874942ec8944754abc3a678b14280f0` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:59.450704 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9d9f1-8f88-469a-863f-e1c4d1593971 None admin] RBAC: Authorizing `identity:get_user(user_id=b874942ec8944754abc3a678b14280f0)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:59.452158 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9d9f1-8f88-469a-863f-e1c4d1593971 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:59.453695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 574/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:44:59 2022] GET /identity/v3/users/b874942ec8944754abc3a678b14280f0 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:59.459434 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280472b1-1b36-4d5e-853a-2402e7066c17 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:59.557630 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280472b1-1b36-4d5e-853a-2402e7066c17 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:59.559155 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:59.589982 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa2d19-7670-417c-9c76-0563ce79281d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:59.590581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa2d19-7670-417c-9c76-0563ce79281d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:59.590889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa2d19-7670-417c-9c76-0563ce79281d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:59.591163 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa2d19-7670-417c-9c76-0563ce79281d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:59.656641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa2d19-7670-417c-9c76-0563ce79281d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:59.658016 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa2d19-7670-417c-9c76-0563ce79281d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:59.752600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 570/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:44:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 10:44:59.758621 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9d9f1-8f88-469a-863f-e1c4d1593971 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:59.813045 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:59.855347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9d9f1-8f88-469a-863f-e1c4d1593971 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:44:59.887623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507b0454-acf4-499a-a651-0bab1f9896b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:44:59.888237 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b0454-acf4-499a-a651-0bab1f9896b7 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:44:59.888516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b0454-acf4-499a-a651-0bab1f9896b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:44:59.888788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507b0454-acf4-499a-a651-0bab1f9896b7 None admin] PATH_INFO: `/v3/projects/2f7737a4ef4f4704ada13def48fc26dc` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:44:59.889887 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b0454-acf4-499a-a651-0bab1f9896b7 None admin] RBAC: Authorizing `identity:get_project(project_id=2f7737a4ef4f4704ada13def48fc26dc)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:44:59.891363 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507b0454-acf4-499a-a651-0bab1f9896b7 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:44:59.893094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 575/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:44:59 2022] GET /identity/v3/projects/2f7737a4ef4f4704ada13def48fc26dc => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:44:59.899860 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa2d19-7670-417c-9c76-0563ce79281d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:44:59.901982 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:44:59.995639 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa2d19-7670-417c-9c76-0563ce79281d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:00.028660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c03fb29-ad46-470d-85da-7da0581d7a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:00.029257 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03fb29-ad46-470d-85da-7da0581d7a54 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:00.029539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03fb29-ad46-470d-85da-7da0581d7a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:00.029813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c03fb29-ad46-470d-85da-7da0581d7a54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:00.030536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03fb29-ad46-470d-85da-7da0581d7a54 None admin] RBAC: Adding query filter params (role.id=00c6de5dd6cd4267ba05941ddb91e6ad, scope.project.id=2f7737a4ef4f4704ada13def48fc26dc, user.id=b874942ec8944754abc3a678b14280f0) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:45:00.030874 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03fb29-ad46-470d-85da-7da0581d7a54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:00.032296 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c03fb29-ad46-470d-85da-7da0581d7a54 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:00.037663 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 571/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:44:59 2022] GET /identity/v3/role_assignments?user.id=b874942ec8944754abc3a678b14280f0&scope.project.id=2f7737a4ef4f4704ada13def48fc26dc&role.id=00c6de5dd6cd4267ba05941ddb91e6ad => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:45:02.008440 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c9018-cb97-46ac-8089-295222bf38f0 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:02.009006 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c9018-cb97-46ac-8089-295222bf38f0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:02.009006 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c9018-cb97-46ac-8089-295222bf38f0 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:02.010311 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 576/1147] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:45:02.015556 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44bbce-2998-409e-b40d-4dd2ca4c1623 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:02.015980 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44bbce-2998-409e-b40d-4dd2ca4c1623 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:02.016117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44bbce-2998-409e-b40d-4dd2ca4c1623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:02.034501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1e44bbce-2998-409e-b40d-4dd2ca4c1623 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:45:02.035281 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1e44bbce-2998-409e-b40d-4dd2ca4c1623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:45:02.094185 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:02.101612 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 572/1148] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:45:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:45:02.125424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c9018-cb97-46ac-8089-295222bf38f0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:02.227740 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c9018-cb97-46ac-8089-295222bf38f0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:02.250933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:02.265691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e41f4b-7aa3-48ad-8b78-b993d6c3de2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:02.265691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e41f4b-7aa3-48ad-8b78-b993d6c3de2c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:02.265691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e41f4b-7aa3-48ad-8b78-b993d6c3de2c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:02.265691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e41f4b-7aa3-48ad-8b78-b993d6c3de2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:02.272652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e41f4b-7aa3-48ad-8b78-b993d6c3de2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:45:02.277429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-27e41f4b-7aa3-48ad-8b78-b993d6c3de2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:45:02.277429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:45:02.277429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:45:02.277429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:45:02.277429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:45:02.277429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:45:02.277429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:45:02.277429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:45:02.277429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:45:02.277429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:45:02.277429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:45:02.277429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:45:02.277429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:45:02.277429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:45:02.277429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:45:02.277429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:45:02.278505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:45:02.278505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:45:02.278505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:45:02.278505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:45:02.278505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:45:02.278505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:45:02.278505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:45:02.278505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:45:02.278505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:45:02.278505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:45:02.278505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:45:02.278505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:45:02.278505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:45:02.278505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:45:02.278505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:45:02.278505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:45:02.279559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:45:02.279559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:45:02.279559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:45:02.279559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:45:02.279559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:45:02.279559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:45:02.279559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:45:02.279559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:45:02.279559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:45:02.279559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:45:02.279559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:45:02.279559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:45:02.279559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 577/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:45:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:45:02.284573 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44bbce-2998-409e-b40d-4dd2ca4c1623 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:02.382791 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44bbce-2998-409e-b40d-4dd2ca4c1623 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:02.416402 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ba111-ac83-4378-972f-928af11bcad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:02.417002 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ba111-ac83-4378-972f-928af11bcad1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:02.417284 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ba111-ac83-4378-972f-928af11bcad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:02.417557 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ba111-ac83-4378-972f-928af11bcad1 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:02.418216 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ba111-ac83-4378-972f-928af11bcad1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:45:02.418522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ba111-ac83-4378-972f-928af11bcad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:02.419916 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ba111-ac83-4378-972f-928af11bcad1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:02.427690 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 573/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:45:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:45:02.433653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e41f4b-7aa3-48ad-8b78-b993d6c3de2c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:02.530814 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e41f4b-7aa3-48ad-8b78-b993d6c3de2c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:02.562752 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc631101-5070-4573-b41a-f5920f78fc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:02.563394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc631101-5070-4573-b41a-f5920f78fc60 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:02.563677 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc631101-5070-4573-b41a-f5920f78fc60 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:02.563952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc631101-5070-4573-b41a-f5920f78fc60 None admin] PATH_INFO: `/v3/users/b874942ec8944754abc3a678b14280f0` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:02.565059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc631101-5070-4573-b41a-f5920f78fc60 None admin] RBAC: Authorizing `identity:get_user(user_id=b874942ec8944754abc3a678b14280f0)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:02.566484 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc631101-5070-4573-b41a-f5920f78fc60 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:02.568051 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 578/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:45:02 2022] GET /identity/v3/users/b874942ec8944754abc3a678b14280f0 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:45:02.574419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ba111-ac83-4378-972f-928af11bcad1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:02.631812 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:02.674214 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ba111-ac83-4378-972f-928af11bcad1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:02.707273 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac6ae3-818c-402f-be80-a5caadeaa1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:02.707897 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac6ae3-818c-402f-be80-a5caadeaa1dd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:02.708182 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac6ae3-818c-402f-be80-a5caadeaa1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:02.708461 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac6ae3-818c-402f-be80-a5caadeaa1dd None admin] PATH_INFO: `/v3/projects/2f7737a4ef4f4704ada13def48fc26dc` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:02.709561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac6ae3-818c-402f-be80-a5caadeaa1dd None admin] RBAC: Authorizing `identity:get_project(project_id=2f7737a4ef4f4704ada13def48fc26dc)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:02.711990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac6ae3-818c-402f-be80-a5caadeaa1dd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:02.713587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 574/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:45:02 2022] GET /identity/v3/projects/2f7737a4ef4f4704ada13def48fc26dc => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:45:02.719532 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc631101-5070-4573-b41a-f5920f78fc60 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:02.771138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:02.817912 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc631101-5070-4573-b41a-f5920f78fc60 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:02.850823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e308f4d-4c27-4d90-a5c6-f57191dcf4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:02.851748 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e308f4d-4c27-4d90-a5c6-f57191dcf4fe None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:02.852032 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e308f4d-4c27-4d90-a5c6-f57191dcf4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:02.852308 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e308f4d-4c27-4d90-a5c6-f57191dcf4fe None admin] PATH_INFO: `/v3/projects/2f7737a4ef4f4704ada13def48fc26dc/users/b874942ec8944754abc3a678b14280f0/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:02.854192 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e308f4d-4c27-4d90-a5c6-f57191dcf4fe None admin] RBAC: Authorizing `identity:create_grant(project_id=2f7737a4ef4f4704ada13def48fc26dc, user_id=b874942ec8944754abc3a678b14280f0, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:02.855653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e308f4d-4c27-4d90-a5c6-f57191dcf4fe None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:02.962196 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 579/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:45:02 2022] PUT /identity/v3/projects/2f7737a4ef4f4704ada13def48fc26dc/users/b874942ec8944754abc3a678b14280f0/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:45:04.957057 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64edd1-7a18-47ff-8bc4-51b73993a1d8 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:04.957587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64edd1-7a18-47ff-8bc4-51b73993a1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:04.957587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64edd1-7a18-47ff-8bc4-51b73993a1d8 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:04.958975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 575/1154] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:45:04.964836 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33caf0-e66e-4dca-b8a1-22737aaec629 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:04.965219 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33caf0-e66e-4dca-b8a1-22737aaec629 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:04.965375 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33caf0-e66e-4dca-b8a1-22737aaec629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:04.984369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0f33caf0-e66e-4dca-b8a1-22737aaec629 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:45:04.985564 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0f33caf0-e66e-4dca-b8a1-22737aaec629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:45:05.048566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 580/1155] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:45:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:45:05.072751 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64edd1-7a18-47ff-8bc4-51b73993a1d8 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:05.173353 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64edd1-7a18-47ff-8bc4-51b73993a1d8 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:05.198546 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:05.206899 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c326110-e6a5-431d-9b63-6817371d081b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:05.218024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c326110-e6a5-431d-9b63-6817371d081b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:05.218024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c326110-e6a5-431d-9b63-6817371d081b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:05.218024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c326110-e6a5-431d-9b63-6817371d081b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:05.218690 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c326110-e6a5-431d-9b63-6817371d081b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:45:05.223668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-8c326110-e6a5-431d-9b63-6817371d081b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:45:05.223668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:45:05.223668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:45:05.223668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:45:05.223668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:45:05.223668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:45:05.223668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:45:05.223668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:45:05.223668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:45:05.223668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:45:05.223668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:45:05.223668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:45:05.223668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:45:05.223668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:45:05.223668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:45:05.223668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:45:05.224665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:45:05.224665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:45:05.224665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:45:05.224665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:45:05.224665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:45:05.224665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:45:05.224665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:45:05.224665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:45:05.224665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:45:05.224665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:45:05.224665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:45:05.224665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:45:05.224665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:45:05.224665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:45:05.224665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:45:05.224665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:45:05.225482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:45:05.225482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:45:05.225482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:45:05.225482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:45:05.225482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:45:05.225482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:45:05.225482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:45:05.225482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:45:05.225482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:45:05.225482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:45:05.225482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:45:05.225482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:45:05.225482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 576/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:45:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:45:05.231727 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33caf0-e66e-4dca-b8a1-22737aaec629 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:05.272426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:05.326986 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33caf0-e66e-4dca-b8a1-22737aaec629 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:05.362704 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459100e-9cdc-4687-9d27-c8331adb450c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:05.363325 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459100e-9cdc-4687-9d27-c8331adb450c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:05.363602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459100e-9cdc-4687-9d27-c8331adb450c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:05.363869 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8459100e-9cdc-4687-9d27-c8331adb450c None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:05.364516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459100e-9cdc-4687-9d27-c8331adb450c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:45:05.364812 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459100e-9cdc-4687-9d27-c8331adb450c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:05.366162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8459100e-9cdc-4687-9d27-c8331adb450c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:05.374556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 581/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:45:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:45:05.380310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c326110-e6a5-431d-9b63-6817371d081b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:05.474587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c326110-e6a5-431d-9b63-6817371d081b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:05.507570 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015012f-3b3f-4333-9be4-34bccee1e66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:05.508174 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015012f-3b3f-4333-9be4-34bccee1e66c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:05.508453 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015012f-3b3f-4333-9be4-34bccee1e66c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:05.508724 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015012f-3b3f-4333-9be4-34bccee1e66c None admin] PATH_INFO: `/v3/users/b874942ec8944754abc3a678b14280f0` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:05.509814 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4015012f-3b3f-4333-9be4-34bccee1e66c None admin] RBAC: Authorizing `identity:get_user(user_id=b874942ec8944754abc3a678b14280f0)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:05.511258 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4015012f-3b3f-4333-9be4-34bccee1e66c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:05.512790 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 577/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:45:05 2022] GET /identity/v3/users/b874942ec8944754abc3a678b14280f0 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:45:05.518656 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459100e-9cdc-4687-9d27-c8331adb450c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:05.613611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8459100e-9cdc-4687-9d27-c8331adb450c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:05.615843 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:05.645209 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d4c86-03ff-43d4-a600-356619be6a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:05.645792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d4c86-03ff-43d4-a600-356619be6a9a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:05.646075 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d4c86-03ff-43d4-a600-356619be6a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:05.646342 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d4c86-03ff-43d4-a600-356619be6a9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:05.709574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d4c86-03ff-43d4-a600-356619be6a9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:05.711877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d4c86-03ff-43d4-a600-356619be6a9a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:05.806395 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 582/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:45:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 10:45:05.812306 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015012f-3b3f-4333-9be4-34bccee1e66c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:05.865830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:05.909482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015012f-3b3f-4333-9be4-34bccee1e66c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:05.941295 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d39c6-71f9-4408-8291-e8a5ddbe29f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:05.941906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d39c6-71f9-4408-8291-e8a5ddbe29f8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:05.942181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d39c6-71f9-4408-8291-e8a5ddbe29f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:05.942450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d39c6-71f9-4408-8291-e8a5ddbe29f8 None admin] PATH_INFO: `/v3/projects/2f7737a4ef4f4704ada13def48fc26dc` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:05.943553 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d39c6-71f9-4408-8291-e8a5ddbe29f8 None admin] RBAC: Authorizing `identity:get_project(project_id=2f7737a4ef4f4704ada13def48fc26dc)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:05.945549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d39c6-71f9-4408-8291-e8a5ddbe29f8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:05.947171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 578/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:45:05 2022] GET /identity/v3/projects/2f7737a4ef4f4704ada13def48fc26dc => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:45:05.953218 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d4c86-03ff-43d4-a600-356619be6a9a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:05.956236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:06.047541 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d4c86-03ff-43d4-a600-356619be6a9a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:06.080289 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4242e-0319-4948-bb5d-18b3669d3053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:06.080817 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4242e-0319-4948-bb5d-18b3669d3053 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:06.081092 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4242e-0319-4948-bb5d-18b3669d3053 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:06.081359 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4242e-0319-4948-bb5d-18b3669d3053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:06.082069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4242e-0319-4948-bb5d-18b3669d3053 None admin] RBAC: Adding query filter params (role.id=00c6de5dd6cd4267ba05941ddb91e6ad, scope.project.id=2f7737a4ef4f4704ada13def48fc26dc, user.id=b874942ec8944754abc3a678b14280f0) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:45:06.082374 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4242e-0319-4948-bb5d-18b3669d3053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:06.083814 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4242e-0319-4948-bb5d-18b3669d3053 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:06.089358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 583/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:45:05 2022] GET /identity/v3/role_assignments?user.id=b874942ec8944754abc3a678b14280f0&scope.project.id=2f7737a4ef4f4704ada13def48fc26dc&role.id=00c6de5dd6cd4267ba05941ddb91e6ad => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:45:08.077625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d1d59-078a-452c-b7c5-d1090d821933 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:08.078070 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d1d59-078a-452c-b7c5-d1090d821933 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:08.078189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d1d59-078a-452c-b7c5-d1090d821933 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:08.079591 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 579/1162] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:45:08.084576 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d7efe-1e39-4779-9f82-f6e845a4640d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:08.085448 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d7efe-1e39-4779-9f82-f6e845a4640d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:08.085664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d7efe-1e39-4779-9f82-f6e845a4640d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:08.103981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3d2d7efe-1e39-4779-9f82-f6e845a4640d None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:45:08.105143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3d2d7efe-1e39-4779-9f82-f6e845a4640d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:45:08.164459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:08.169435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 584/1163] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:45:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:45:08.191118 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d1d59-078a-452c-b7c5-d1090d821933 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:08.292008 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d1d59-078a-452c-b7c5-d1090d821933 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:08.313503 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:08.325082 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f9681-0ff2-46b2-be1e-0e7e900df966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:08.326203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f9681-0ff2-46b2-be1e-0e7e900df966 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:08.326203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f9681-0ff2-46b2-be1e-0e7e900df966 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:08.326203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f9681-0ff2-46b2-be1e-0e7e900df966 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:08.392267 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f9681-0ff2-46b2-be1e-0e7e900df966 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:08.393719 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f9681-0ff2-46b2-be1e-0e7e900df966 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:08.498404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 580/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:45:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 10:45:08.504374 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d7efe-1e39-4779-9f82-f6e845a4640d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:08.598412 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d7efe-1e39-4779-9f82-f6e845a4640d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:08.630050 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca180c10-caca-4ea3-8dc9-8ac3f546b354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:08.630662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca180c10-caca-4ea3-8dc9-8ac3f546b354 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:08.630963 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca180c10-caca-4ea3-8dc9-8ac3f546b354 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:08.631233 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca180c10-caca-4ea3-8dc9-8ac3f546b354 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:08.638013 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca180c10-caca-4ea3-8dc9-8ac3f546b354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:08.639487 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca180c10-caca-4ea3-8dc9-8ac3f546b354 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:08.651059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-ca180c10-caca-4ea3-8dc9-8ac3f546b354 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 11 10:45:08.651059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:45:08.651059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 11 10:45:08.651059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 11 10:45:08.651059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:45:08.651059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:45:08.651059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:45:08.651059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:45:08.651059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 11 10:45:08.651059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:45:08.651059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:45:08.651059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:45:08.651059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:45:08.651059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:45:08.651059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:45:08.651059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:45:08.651059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:45:08.652178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:45:08.652178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:45:08.652178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:45:08.652178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:45:08.652178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:45:08.652178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:45:08.652178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:45:08.652178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:45:08.652178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:45:08.652178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:45:08.652178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:45:08.652178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:45:08.652178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:45:08.652178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:45:08.652178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:45:08.652178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:45:08.653036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:45:08.653036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:45:08.653036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:45:08.653036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:45:08.653036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:45:08.653036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:45:08.653036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:45:08.653036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:45:08.653036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:45:08.653036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:45:08.653036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 11 10:45:08.653036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:45:08.653036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 11 10:45:08.653036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:45:08.653036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 585/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Aug 11 10:45:08 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:45:08.658055 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f9681-0ff2-46b2-be1e-0e7e900df966 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:08.682845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:08.756090 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f9681-0ff2-46b2-be1e-0e7e900df966 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:08.790986 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010010e-5815-4647-a8b5-3820af7e5e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:08.791586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010010e-5815-4647-a8b5-3820af7e5e69 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:08.791870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010010e-5815-4647-a8b5-3820af7e5e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:08.792145 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010010e-5815-4647-a8b5-3820af7e5e69 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:08.792778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010010e-5815-4647-a8b5-3820af7e5e69 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:45:08.793085 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010010e-5815-4647-a8b5-3820af7e5e69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:08.794449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010010e-5815-4647-a8b5-3820af7e5e69 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:08.801447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 581/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Aug 11 10:45:08 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:45:10.849228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5a08c-4db2-4659-8408-03eafd5495da None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:10.849764 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5a08c-4db2-4659-8408-03eafd5495da None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:10.849764 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5a08c-4db2-4659-8408-03eafd5495da None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:10.852112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 586/1167] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:45:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:45:10.857373 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37ef07-5d2d-4402-a38c-d34aaab63525 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:10.857744 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37ef07-5d2d-4402-a38c-d34aaab63525 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:10.857933 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37ef07-5d2d-4402-a38c-d34aaab63525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:10.876262 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3e37ef07-5d2d-4402-a38c-d34aaab63525 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:45:10.877443 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3e37ef07-5d2d-4402-a38c-d34aaab63525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:45:10.941516 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 582/1168] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:45:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:45:10.964304 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5a08c-4db2-4659-8408-03eafd5495da None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:11.021589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:11.064485 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5a08c-4db2-4659-8408-03eafd5495da None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:11.096833 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1fa51-d6c8-4dd2-ada4-048f3ff7025f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:11.097432 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1fa51-d6c8-4dd2-ada4-048f3ff7025f None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:11.097710 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1fa51-d6c8-4dd2-ada4-048f3ff7025f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:11.097978 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1fa51-d6c8-4dd2-ada4-048f3ff7025f None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:11.098638 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1fa51-d6c8-4dd2-ada4-048f3ff7025f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:11.100077 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1fa51-d6c8-4dd2-ada4-048f3ff7025f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:11.169820 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 587/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Thu Aug 11 10:45:10 2022] POST /identity/v3/domains => generated 267 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:45:13.235287 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa99499-d0e4-4941-8fac-cbbf9a1b21d7 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:13.235835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa99499-d0e4-4941-8fac-cbbf9a1b21d7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:13.235835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa99499-d0e4-4941-8fac-cbbf9a1b21d7 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:13.237175 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 583/1170] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:45:13.242313 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af33a13-8145-4bfb-a4fe-cdb0b3b8b49e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:13.242716 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af33a13-8145-4bfb-a4fe-cdb0b3b8b49e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:13.242907 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af33a13-8145-4bfb-a4fe-cdb0b3b8b49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:13.261139 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-8af33a13-8145-4bfb-a4fe-cdb0b3b8b49e None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:45:13.262322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8af33a13-8145-4bfb-a4fe-cdb0b3b8b49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:45:13.329555 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 588/1171] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:45:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:45:13.353332 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa99499-d0e4-4941-8fac-cbbf9a1b21d7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:13.371237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:13.450726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa99499-d0e4-4941-8fac-cbbf9a1b21d7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:13.484801 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc2b77-6593-4db4-9c09-67447112100c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:13.485418 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc2b77-6593-4db4-9c09-67447112100c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:13.485694 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc2b77-6593-4db4-9c09-67447112100c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:13.485966 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc2b77-6593-4db4-9c09-67447112100c None admin] PATH_INFO: `/v3/domains/e29fe205dc29482bb4a82956a1405581` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:13.496059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc2b77-6593-4db4-9c09-67447112100c None admin] RBAC: Authorizing `identity:get_domain(domain_id=e29fe205dc29482bb4a82956a1405581)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:13.497498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc2b77-6593-4db4-9c09-67447112100c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:13.499088 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 584/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Thu Aug 11 10:45:13 2022] GET /identity/v3/domains/e29fe205dc29482bb4a82956a1405581 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:45:13.504926 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af33a13-8145-4bfb-a4fe-cdb0b3b8b49e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:13.551859 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:13.599674 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af33a13-8145-4bfb-a4fe-cdb0b3b8b49e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:13.632773 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaa8f2-4dae-4939-959f-4abc7dcb8ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:13.633373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaa8f2-4dae-4939-959f-4abc7dcb8ea9 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:13.633652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaa8f2-4dae-4939-959f-4abc7dcb8ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:13.633922 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaa8f2-4dae-4939-959f-4abc7dcb8ea9 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:13.634555 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaa8f2-4dae-4939-959f-4abc7dcb8ea9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:13.636022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaa8f2-4dae-4939-959f-4abc7dcb8ea9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:13.746157 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 589/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Aug 11 10:45:13 2022] POST /identity/v3/projects => generated 361 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:45:15.797681 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c329b7-e1e0-4837-ae87-d87392b56669 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:15.798249 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c329b7-e1e0-4837-ae87-d87392b56669 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:15.798249 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c329b7-e1e0-4837-ae87-d87392b56669 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:15.799609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 585/1174] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:45:15.805228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b20741-7676-46c5-b2df-274ef7423520 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:15.805655 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b20741-7676-46c5-b2df-274ef7423520 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:15.805785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b20741-7676-46c5-b2df-274ef7423520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:15.824702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d0b20741-7676-46c5-b2df-274ef7423520 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:45:15.825886 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d0b20741-7676-46c5-b2df-274ef7423520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:45:15.891557 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 590/1175] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:45:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:45:15.915864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c329b7-e1e0-4837-ae87-d87392b56669 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:15.995479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:16.018332 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c329b7-e1e0-4837-ae87-d87392b56669 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:16.052241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171dc97-792f-430d-8774-2bd7f555a91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:16.052814 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171dc97-792f-430d-8774-2bd7f555a91c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:16.053102 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171dc97-792f-430d-8774-2bd7f555a91c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:16.053946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171dc97-792f-430d-8774-2bd7f555a91c None admin] PATH_INFO: `/v3/domains/e29fe205dc29482bb4a82956a1405581` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:16.055273 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171dc97-792f-430d-8774-2bd7f555a91c None admin] RBAC: Authorizing `identity:get_domain(domain_id=e29fe205dc29482bb4a82956a1405581)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:16.056714 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171dc97-792f-430d-8774-2bd7f555a91c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:16.058278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 586/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Thu Aug 11 10:45:15 2022] GET /identity/v3/domains/e29fe205dc29482bb4a82956a1405581 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:45:16.064118 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b20741-7676-46c5-b2df-274ef7423520 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:16.092812 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:16.160880 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b20741-7676-46c5-b2df-274ef7423520 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:16.194857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbabd2-beab-42b1-b4a0-bec7bbb7e476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:16.195481 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbabd2-beab-42b1-b4a0-bec7bbb7e476 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:16.195765 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbabd2-beab-42b1-b4a0-bec7bbb7e476 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:16.196043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbabd2-beab-42b1-b4a0-bec7bbb7e476 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:16.196676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbabd2-beab-42b1-b4a0-bec7bbb7e476 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:16.198106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbabd2-beab-42b1-b4a0-bec7bbb7e476 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:16.295273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 591/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Aug 11 10:45:16 2022] POST /identity/v3/users => generated 311 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:45:18.419841 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d9f6a-cede-4886-b34f-bac677beb023 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:18.420401 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d9f6a-cede-4886-b34f-bac677beb023 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:18.420401 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d9f6a-cede-4886-b34f-bac677beb023 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:18.421775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 587/1178] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:45:18.427182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5117d-0b22-434e-85d9-86f7482ead19 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:18.427584 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5117d-0b22-434e-85d9-86f7482ead19 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:18.427734 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5117d-0b22-434e-85d9-86f7482ead19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:18.446621 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-32a5117d-0b22-434e-85d9-86f7482ead19 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:45:18.447849 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-32a5117d-0b22-434e-85d9-86f7482ead19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:45:18.517058 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 592/1179] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:45:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:45:18.542936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d9f6a-cede-4886-b34f-bac677beb023 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:18.645963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d9f6a-cede-4886-b34f-bac677beb023 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:18.679852 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5c4fe-d72e-4ca1-9291-6751d24c5873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:18.680392 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5c4fe-d72e-4ca1-9291-6751d24c5873 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:18.680671 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5c4fe-d72e-4ca1-9291-6751d24c5873 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:18.680940 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5c4fe-d72e-4ca1-9291-6751d24c5873 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:18.690649 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5c4fe-d72e-4ca1-9291-6751d24c5873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:45:18.696087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-5cf5c4fe-d72e-4ca1-9291-6751d24c5873 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:45:18.696087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:45:18.696087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:45:18.696087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:45:18.696087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:45:18.696087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:45:18.696087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:45:18.696087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:45:18.696087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:45:18.696087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:45:18.696087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:45:18.696087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:45:18.696087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:45:18.696087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:45:18.696087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:45:18.696087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:45:18.697239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:45:18.697239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:45:18.697239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:45:18.697239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:45:18.697239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:45:18.697239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:45:18.697239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:45:18.697239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:45:18.697239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:45:18.697239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:45:18.697239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:45:18.697239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:45:18.697239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:45:18.697239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:45:18.697239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:45:18.697239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:45:18.698169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:45:18.698169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:45:18.698169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:45:18.698169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:45:18.698169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:45:18.698169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:45:18.698169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:45:18.698169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:45:18.698169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:45:18.698169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:45:18.698169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:45:18.698169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:45:18.698169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 588/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:45:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:45:18.703267 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5117d-0b22-434e-85d9-86f7482ead19 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:18.719828 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:18.798145 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5117d-0b22-434e-85d9-86f7482ead19 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:18.830925 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2afd7-8a3c-43ba-ba99-abd8fe87ec16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:18.831523 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2afd7-8a3c-43ba-ba99-abd8fe87ec16 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:18.831797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2afd7-8a3c-43ba-ba99-abd8fe87ec16 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:18.832063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2afd7-8a3c-43ba-ba99-abd8fe87ec16 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:18.832715 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2afd7-8a3c-43ba-ba99-abd8fe87ec16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:45:18.833015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2afd7-8a3c-43ba-ba99-abd8fe87ec16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:18.834437 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2afd7-8a3c-43ba-ba99-abd8fe87ec16 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:18.842434 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 593/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:45:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:45:18.848294 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5c4fe-d72e-4ca1-9291-6751d24c5873 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:18.853544 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:18.953499 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5c4fe-d72e-4ca1-9291-6751d24c5873 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:18.986560 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4153dc-9c7a-4c88-8f94-9f9afcce205a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:18.987262 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4153dc-9c7a-4c88-8f94-9f9afcce205a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:18.987543 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4153dc-9c7a-4c88-8f94-9f9afcce205a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:18.987815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4153dc-9c7a-4c88-8f94-9f9afcce205a None admin] PATH_INFO: `/v3/users/e08f291fa399479f9a7d951b55fbcbdc` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:19.001080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4153dc-9c7a-4c88-8f94-9f9afcce205a None admin] RBAC: Authorizing `identity:get_user(user_id=e08f291fa399479f9a7d951b55fbcbdc)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:19.002514 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4153dc-9c7a-4c88-8f94-9f9afcce205a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:19.004140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 589/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:45:18 2022] GET /identity/v3/users/e08f291fa399479f9a7d951b55fbcbdc => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:45:19.010324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2afd7-8a3c-43ba-ba99-abd8fe87ec16 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:19.090876 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:19.111497 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2afd7-8a3c-43ba-ba99-abd8fe87ec16 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:19.143744 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602bd8e-3fef-4d58-82c0-89730804cebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:19.144336 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602bd8e-3fef-4d58-82c0-89730804cebe None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:19.144611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602bd8e-3fef-4d58-82c0-89730804cebe None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:19.144877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602bd8e-3fef-4d58-82c0-89730804cebe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:19.208693 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602bd8e-3fef-4d58-82c0-89730804cebe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:19.210602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602bd8e-3fef-4d58-82c0-89730804cebe None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:19.282600 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:19.303404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 594/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:45:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 10:45:19.309368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4153dc-9c7a-4c88-8f94-9f9afcce205a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:19.368554 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:19.406075 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4153dc-9c7a-4c88-8f94-9f9afcce205a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:19.438217 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b89dab-70bb-4e0b-ad48-d7886a4c0c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:19.438853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b89dab-70bb-4e0b-ad48-d7886a4c0c3a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:19.439125 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b89dab-70bb-4e0b-ad48-d7886a4c0c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:19.439393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b89dab-70bb-4e0b-ad48-d7886a4c0c3a None admin] PATH_INFO: `/v3/projects/a328ad5eab284738931e252325781c84` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:19.440485 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b89dab-70bb-4e0b-ad48-d7886a4c0c3a None admin] RBAC: Authorizing `identity:get_project(project_id=a328ad5eab284738931e252325781c84)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:19.441887 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b89dab-70bb-4e0b-ad48-d7886a4c0c3a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:19.443506 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 590/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:45:19 2022] GET /identity/v3/projects/a328ad5eab284738931e252325781c84 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:45:19.450015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602bd8e-3fef-4d58-82c0-89730804cebe None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:19.546225 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602bd8e-3fef-4d58-82c0-89730804cebe None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:19.580752 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc8817-d5da-4b20-8f17-bba4c093ae75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:19.581342 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc8817-d5da-4b20-8f17-bba4c093ae75 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:19.581617 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc8817-d5da-4b20-8f17-bba4c093ae75 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:19.581884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc8817-d5da-4b20-8f17-bba4c093ae75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:19.582599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc8817-d5da-4b20-8f17-bba4c093ae75 None admin] RBAC: Adding query filter params (role.id=00c6de5dd6cd4267ba05941ddb91e6ad, scope.project.id=a328ad5eab284738931e252325781c84, user.id=e08f291fa399479f9a7d951b55fbcbdc) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:45:19.582937 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc8817-d5da-4b20-8f17-bba4c093ae75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:19.585081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc8817-d5da-4b20-8f17-bba4c093ae75 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:19.590229 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 595/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:45:19 2022] GET /identity/v3/role_assignments?user.id=e08f291fa399479f9a7d951b55fbcbdc&scope.project.id=a328ad5eab284738931e252325781c84&role.id=00c6de5dd6cd4267ba05941ddb91e6ad => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:45:21.582887 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401159f6-0f48-44fb-bce0-c6a760a07463 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:21.583437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401159f6-0f48-44fb-bce0-c6a760a07463 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:21.583437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401159f6-0f48-44fb-bce0-c6a760a07463 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:21.585332 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 591/1186] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:45:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:45:21.590597 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2cc29-f450-408e-b542-590c8fe6702e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:21.591053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2cc29-f450-408e-b542-590c8fe6702e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:21.591190 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2cc29-f450-408e-b542-590c8fe6702e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:21.609737 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-31a2cc29-f450-408e-b542-590c8fe6702e None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:45:21.610947 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-31a2cc29-f450-408e-b542-590c8fe6702e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:45:21.644119 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:21.675218 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 596/1187] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:45:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:45:21.698282 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401159f6-0f48-44fb-bce0-c6a760a07463 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:21.795468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401159f6-0f48-44fb-bce0-c6a760a07463 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:21.824753 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:21.830298 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2fed1-204a-4056-91e9-e0a32039281a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:21.836951 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2fed1-204a-4056-91e9-e0a32039281a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:21.836951 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2fed1-204a-4056-91e9-e0a32039281a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:21.836951 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2fed1-204a-4056-91e9-e0a32039281a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:21.841908 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2fed1-204a-4056-91e9-e0a32039281a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:45:21.846858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f4e2fed1-204a-4056-91e9-e0a32039281a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:45:21.846858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:45:21.846858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:45:21.846858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:45:21.846858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:45:21.846858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:45:21.846858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:45:21.846858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:45:21.846858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:45:21.846858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:45:21.846858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:45:21.846858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:45:21.846858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:45:21.846858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:45:21.846858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:45:21.846858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:45:21.847931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:45:21.847931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:45:21.847931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:45:21.847931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:45:21.847931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:45:21.847931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:45:21.847931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:45:21.847931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:45:21.847931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:45:21.847931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:45:21.847931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:45:21.847931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:45:21.847931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:45:21.847931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:45:21.847931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:45:21.847931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:45:21.848758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:45:21.848758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:45:21.848758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:45:21.848758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:45:21.848758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:45:21.848758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:45:21.848758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:45:21.848758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:45:21.848758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:45:21.848758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:45:21.848758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:45:21.848758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:45:21.848758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 592/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:45:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:45:21.854704 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2cc29-f450-408e-b542-590c8fe6702e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:21.951557 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2cc29-f450-408e-b542-590c8fe6702e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:21.984879 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50b5b5-2559-4536-a946-debfb300199b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:21.985477 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50b5b5-2559-4536-a946-debfb300199b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:21.985762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50b5b5-2559-4536-a946-debfb300199b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:21.986038 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50b5b5-2559-4536-a946-debfb300199b None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:21.986699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50b5b5-2559-4536-a946-debfb300199b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:45:21.987031 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50b5b5-2559-4536-a946-debfb300199b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:21.988425 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50b5b5-2559-4536-a946-debfb300199b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:21.996855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 597/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:45:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:45:22.002749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2fed1-204a-4056-91e9-e0a32039281a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:22.103290 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2fed1-204a-4056-91e9-e0a32039281a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:22.136515 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153006f-9ee2-4600-8854-591ca15cb467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:22.137127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153006f-9ee2-4600-8854-591ca15cb467 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:22.137406 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153006f-9ee2-4600-8854-591ca15cb467 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:22.137677 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153006f-9ee2-4600-8854-591ca15cb467 None admin] PATH_INFO: `/v3/users/e08f291fa399479f9a7d951b55fbcbdc` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:22.138803 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153006f-9ee2-4600-8854-591ca15cb467 None admin] RBAC: Authorizing `identity:get_user(user_id=e08f291fa399479f9a7d951b55fbcbdc)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:22.140243 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153006f-9ee2-4600-8854-591ca15cb467 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:22.141808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 593/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:45:22 2022] GET /identity/v3/users/e08f291fa399479f9a7d951b55fbcbdc => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:45:22.147689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50b5b5-2559-4536-a946-debfb300199b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:22.181994 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:22.245093 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50b5b5-2559-4536-a946-debfb300199b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:22.277696 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6e2f0-4fa5-44d6-9e0f-763903ff7982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:22.278311 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6e2f0-4fa5-44d6-9e0f-763903ff7982 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:22.278593 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6e2f0-4fa5-44d6-9e0f-763903ff7982 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:22.278900 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6e2f0-4fa5-44d6-9e0f-763903ff7982 None admin] PATH_INFO: `/v3/projects/a328ad5eab284738931e252325781c84` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:22.280007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6e2f0-4fa5-44d6-9e0f-763903ff7982 None admin] RBAC: Authorizing `identity:get_project(project_id=a328ad5eab284738931e252325781c84)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:22.281441 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6e2f0-4fa5-44d6-9e0f-763903ff7982 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:22.283069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 598/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:45:22 2022] GET /identity/v3/projects/a328ad5eab284738931e252325781c84 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:45:22.289656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153006f-9ee2-4600-8854-591ca15cb467 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:22.346140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:22.387181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153006f-9ee2-4600-8854-591ca15cb467 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:22.420247 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c88b0a-d663-4ec3-9355-8d1519f12fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:22.420886 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c88b0a-d663-4ec3-9355-8d1519f12fda None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:22.421167 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c88b0a-d663-4ec3-9355-8d1519f12fda None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:22.421440 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c88b0a-d663-4ec3-9355-8d1519f12fda None admin] PATH_INFO: `/v3/projects/a328ad5eab284738931e252325781c84/users/e08f291fa399479f9a7d951b55fbcbdc/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:22.423338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c88b0a-d663-4ec3-9355-8d1519f12fda None admin] RBAC: Authorizing `identity:create_grant(project_id=a328ad5eab284738931e252325781c84, user_id=e08f291fa399479f9a7d951b55fbcbdc, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:22.424789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c88b0a-d663-4ec3-9355-8d1519f12fda None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:22.511998 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 594/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:45:22 2022] PUT /identity/v3/projects/a328ad5eab284738931e252325781c84/users/e08f291fa399479f9a7d951b55fbcbdc/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:45:24.475849 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6dddd-e739-4785-9c80-d0abb7c803c7 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:24.476386 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6dddd-e739-4785-9c80-d0abb7c803c7 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:24.476386 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6dddd-e739-4785-9c80-d0abb7c803c7 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:24.477723 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 599/1193] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:45:24.483380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855307e-9ead-452e-91e9-fe5e204388d7 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:24.483796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855307e-9ead-452e-91e9-fe5e204388d7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:24.483931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855307e-9ead-452e-91e9-fe5e204388d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:24.502121 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c855307e-9ead-452e-91e9-fe5e204388d7 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:45:24.503335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c855307e-9ead-452e-91e9-fe5e204388d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:45:24.568039 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 595/1194] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:45:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:45:24.591024 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6dddd-e739-4785-9c80-d0abb7c803c7 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:24.686814 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6dddd-e739-4785-9c80-d0abb7c803c7 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:24.688272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:24.718993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10056a6-3894-4531-8464-c0567d3bd32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:24.719602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10056a6-3894-4531-8464-c0567d3bd32d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:24.719877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10056a6-3894-4531-8464-c0567d3bd32d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:24.720143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10056a6-3894-4531-8464-c0567d3bd32d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:24.729852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10056a6-3894-4531-8464-c0567d3bd32d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:45:24.734653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-d10056a6-3894-4531-8464-c0567d3bd32d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:45:24.734653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:45:24.734653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:45:24.734653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:45:24.734653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:45:24.734653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:45:24.734653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:45:24.734653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:45:24.734653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:45:24.734653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:45:24.734653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:45:24.734653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:45:24.734653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:45:24.734653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:45:24.734653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:45:24.734653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:45:24.735566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:45:24.735566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:45:24.735566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:45:24.735566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:45:24.735566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:45:24.735566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:45:24.735566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:45:24.735566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:45:24.735566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:45:24.735566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:45:24.735566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:45:24.735566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:45:24.735566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:45:24.735566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:45:24.735566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:45:24.735566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:45:24.736413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:45:24.736413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:45:24.736413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:45:24.736413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:45:24.736413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:45:24.736413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:45:24.736413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:45:24.736413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:45:24.736413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:45:24.736413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:45:24.736413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:45:24.736413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:45:24.736413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 600/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:45:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:45:24.742946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855307e-9ead-452e-91e9-fe5e204388d7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:24.789513 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:24.837703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855307e-9ead-452e-91e9-fe5e204388d7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:24.871222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa0c30-5ed4-4f28-bcf0-37a879329154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:24.871813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa0c30-5ed4-4f28-bcf0-37a879329154 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:24.872095 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa0c30-5ed4-4f28-bcf0-37a879329154 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:24.872370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa0c30-5ed4-4f28-bcf0-37a879329154 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:24.873021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa0c30-5ed4-4f28-bcf0-37a879329154 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:45:24.873322 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa0c30-5ed4-4f28-bcf0-37a879329154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:24.874678 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa0c30-5ed4-4f28-bcf0-37a879329154 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:24.882366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 596/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:45:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:45:24.888175 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10056a6-3894-4531-8464-c0567d3bd32d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:24.985318 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10056a6-3894-4531-8464-c0567d3bd32d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:25.017541 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0bef9-92e8-4feb-a1f5-576a0acfed8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:25.018152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0bef9-92e8-4feb-a1f5-576a0acfed8d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:25.018429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0bef9-92e8-4feb-a1f5-576a0acfed8d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:25.018697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0bef9-92e8-4feb-a1f5-576a0acfed8d None admin] PATH_INFO: `/v3/users/e08f291fa399479f9a7d951b55fbcbdc` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:25.019847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0bef9-92e8-4feb-a1f5-576a0acfed8d None admin] RBAC: Authorizing `identity:get_user(user_id=e08f291fa399479f9a7d951b55fbcbdc)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:25.021279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0bef9-92e8-4feb-a1f5-576a0acfed8d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:25.022901 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 601/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Aug 11 10:45:24 2022] GET /identity/v3/users/e08f291fa399479f9a7d951b55fbcbdc => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:45:25.028541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa0c30-5ed4-4f28-bcf0-37a879329154 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:25.126191 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa0c30-5ed4-4f28-bcf0-37a879329154 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:25.136038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:25.157953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb66b1-3061-4a4b-8b47-b17cf169287f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:25.158552 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb66b1-3061-4a4b-8b47-b17cf169287f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:25.158859 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb66b1-3061-4a4b-8b47-b17cf169287f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:25.159134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb66b1-3061-4a4b-8b47-b17cf169287f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:25.223784 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb66b1-3061-4a4b-8b47-b17cf169287f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:25.225804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb66b1-3061-4a4b-8b47-b17cf169287f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:25.320268 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 597/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:45:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 10:45:25.326180 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0bef9-92e8-4feb-a1f5-576a0acfed8d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:25.357678 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:25.424855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0bef9-92e8-4feb-a1f5-576a0acfed8d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:25.457095 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397b8f1-3d9d-4335-b00c-0ff15eb94d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:25.457707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397b8f1-3d9d-4335-b00c-0ff15eb94d3a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:25.457987 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397b8f1-3d9d-4335-b00c-0ff15eb94d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:25.458261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397b8f1-3d9d-4335-b00c-0ff15eb94d3a None admin] PATH_INFO: `/v3/projects/a328ad5eab284738931e252325781c84` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:25.460163 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397b8f1-3d9d-4335-b00c-0ff15eb94d3a None admin] RBAC: Authorizing `identity:get_project(project_id=a328ad5eab284738931e252325781c84)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:25.461587 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397b8f1-3d9d-4335-b00c-0ff15eb94d3a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:25.463207 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 602/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Aug 11 10:45:25 2022] GET /identity/v3/projects/a328ad5eab284738931e252325781c84 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:45:25.469209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb66b1-3061-4a4b-8b47-b17cf169287f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:45:25.480988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:25.566557 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb66b1-3061-4a4b-8b47-b17cf169287f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:45:25.600444 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eda2d2-a151-46e1-8d3d-564efbf9ae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:45:25.601075 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eda2d2-a151-46e1-8d3d-564efbf9ae31 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:45:25.601361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eda2d2-a151-46e1-8d3d-564efbf9ae31 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:45:25.601635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eda2d2-a151-46e1-8d3d-564efbf9ae31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:45:25.602349 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eda2d2-a151-46e1-8d3d-564efbf9ae31 None admin] RBAC: Adding query filter params (role.id=00c6de5dd6cd4267ba05941ddb91e6ad, scope.project.id=a328ad5eab284738931e252325781c84, user.id=e08f291fa399479f9a7d951b55fbcbdc) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:45:25.602659 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eda2d2-a151-46e1-8d3d-564efbf9ae31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:45:25.604120 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eda2d2-a151-46e1-8d3d-564efbf9ae31 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:45:25.609993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 598/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:45:25 2022] GET /identity/v3/role_assignments?user.id=e08f291fa399479f9a7d951b55fbcbdc&scope.project.id=a328ad5eab284738931e252325781c84&role.id=00c6de5dd6cd4267ba05941ddb91e6ad => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:45:35.453049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=51 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:45:35.607194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=63 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:42.821801 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cabde-ac86-4845-ad91-9d20e8a9b7da None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:42.822394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cabde-ac86-4845-ad91-9d20e8a9b7da None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:42.822394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9cabde-ac86-4845-ad91-9d20e8a9b7da None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:42.823890 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 603/1201] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:46:42.829584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910d400-d81e-44a0-bff5-a27d24d82ba4 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:42.837137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910d400-d81e-44a0-bff5-a27d24d82ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:42.837137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910d400-d81e-44a0-bff5-a27d24d82ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:42.848541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c910d400-d81e-44a0-bff5-a27d24d82ba4 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:46:42.849827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c910d400-d81e-44a0-bff5-a27d24d82ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:46:42.921023 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 599/1202] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:46:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:46:42.944566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cabde-ac86-4845-ad91-9d20e8a9b7da None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:43.047046 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9cabde-ac86-4845-ad91-9d20e8a9b7da None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:43.080416 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8585b-4a1c-4488-b2bd-f06c761f5cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:43.080980 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8585b-4a1c-4488-b2bd-f06c761f5cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:43.081263 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8585b-4a1c-4488-b2bd-f06c761f5cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:43.081538 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8585b-4a1c-4488-b2bd-f06c761f5cb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:43.092396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8585b-4a1c-4488-b2bd-f06c761f5cb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:43.093923 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8585b-4a1c-4488-b2bd-f06c761f5cb6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:43.109010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-54f8585b-4a1c-4488-b2bd-f06c761f5cb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:46:43.109010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:46:43.109010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:46:43.109010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:46:43.109010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:46:43.109010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:46:43.109010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:46:43.109010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:46:43.109010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:46:43.109010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:46:43.109010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:46:43.109010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:46:43.109010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:46:43.109010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:46:43.109010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:46:43.109010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:46:43.110236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:46:43.110236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:46:43.110236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:46:43.110236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:46:43.110236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:46:43.110236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:46:43.110236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:46:43.110236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:46:43.110236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:46:43.110236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:46:43.110236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:46:43.110236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:46:43.110236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:46:43.110236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:46:43.110236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:46:43.110236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:46:43.110236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:46:43.111249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:46:43.111249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:46:43.111249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:46:43.111249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 604/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:46:43.116273 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910d400-d81e-44a0-bff5-a27d24d82ba4 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:43.216291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910d400-d81e-44a0-bff5-a27d24d82ba4 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:43.244753 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:43.250410 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a95be-e627-4c20-9a09-0431dfbd56e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:43.251041 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a95be-e627-4c20-9a09-0431dfbd56e0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:43.251329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a95be-e627-4c20-9a09-0431dfbd56e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:43.251603 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a95be-e627-4c20-9a09-0431dfbd56e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:43.252240 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a95be-e627-4c20-9a09-0431dfbd56e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:43.252541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a95be-e627-4c20-9a09-0431dfbd56e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:43.253901 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a95be-e627-4c20-9a09-0431dfbd56e0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:43.264979 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 600/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:46:43.270734 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8585b-4a1c-4488-b2bd-f06c761f5cb6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:43.323886 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:43.369150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8585b-4a1c-4488-b2bd-f06c761f5cb6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:43.400980 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26b19e-32ed-496e-84e5-2083930e5528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:43.401578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26b19e-32ed-496e-84e5-2083930e5528 None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:43.401858 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26b19e-32ed-496e-84e5-2083930e5528 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:43.402130 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26b19e-32ed-496e-84e5-2083930e5528 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:43.402781 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26b19e-32ed-496e-84e5-2083930e5528 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:43.404207 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26b19e-32ed-496e-84e5-2083930e5528 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:43.507677 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 605/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Aug 11 10:46:43 2022] POST /identity/v3/users => generated 251 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:46:45.557241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdc5b4-5d07-40f8-89f1-b1e7a7540363 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:45.557804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdc5b4-5d07-40f8-89f1-b1e7a7540363 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:45.557804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdc5b4-5d07-40f8-89f1-b1e7a7540363 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:45.559245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 601/1206] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:46:45.564591 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632f471-fa24-408b-abb4-0fdf8bc71c57 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:45.564984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632f471-fa24-408b-abb4-0fdf8bc71c57 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:45.569130 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632f471-fa24-408b-abb4-0fdf8bc71c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:45.582829 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c632f471-fa24-408b-abb4-0fdf8bc71c57 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:46:45.584005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c632f471-fa24-408b-abb4-0fdf8bc71c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:46:45.650121 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 606/1207] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:46:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:46:45.673152 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdc5b4-5d07-40f8-89f1-b1e7a7540363 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:45.776656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdc5b4-5d07-40f8-89f1-b1e7a7540363 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:45.812984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6683f-ed25-4352-b23a-43bea7327693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:45.813552 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6683f-ed25-4352-b23a-43bea7327693 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:45.813837 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6683f-ed25-4352-b23a-43bea7327693 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:45.814137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6683f-ed25-4352-b23a-43bea7327693 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:45.824208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6683f-ed25-4352-b23a-43bea7327693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:46:45.828963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-d5d6683f-ed25-4352-b23a-43bea7327693 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:46:45.828963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:46:45.828963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:46:45.828963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:46:45.828963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:46:45.828963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:46:45.828963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:46:45.828963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:46:45.828963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:46:45.828963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:46:45.828963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:46:45.828963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:46:45.828963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:46:45.828963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:46:45.828963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:46:45.828963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:46:45.830674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:46:45.830674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:46:45.830674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:46:45.830674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:46:45.830674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:46:45.830674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:46:45.830674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:46:45.830674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:46:45.830674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:46:45.830674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:46:45.830674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:46:45.830674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:46:45.830674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:46:45.830674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:46:45.830674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:46:45.830674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:46:45.831775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:46:45.831775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:46:45.831775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:46:45.831775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:46:45.831775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:46:45.831775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:46:45.831775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:46:45.831775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:46:45.831775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:46:45.831775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:46:45.831775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:46:45.831775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:46:45.831775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 602/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:46:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:46:45.836422 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632f471-fa24-408b-abb4-0fdf8bc71c57 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:45.876177 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:45.934337 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632f471-fa24-408b-abb4-0fdf8bc71c57 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:45.967230 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb19f84-3537-4b9a-8c4d-9627d2fb79bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:45.967829 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb19f84-3537-4b9a-8c4d-9627d2fb79bd None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:45.968115 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb19f84-3537-4b9a-8c4d-9627d2fb79bd None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:45.968386 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb19f84-3537-4b9a-8c4d-9627d2fb79bd None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:45.969107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb19f84-3537-4b9a-8c4d-9627d2fb79bd None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:45.969409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb19f84-3537-4b9a-8c4d-9627d2fb79bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:45.970800 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb19f84-3537-4b9a-8c4d-9627d2fb79bd None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:45.979261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 607/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Aug 11 10:46:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:46:45.988889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6683f-ed25-4352-b23a-43bea7327693 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:46.047731 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:46.096386 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6683f-ed25-4352-b23a-43bea7327693 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:46.130076 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011253e-8b0c-49c9-a7a8-de8f2f2be43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:46.130698 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011253e-8b0c-49c9-a7a8-de8f2f2be43a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:46.131008 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011253e-8b0c-49c9-a7a8-de8f2f2be43a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:46.131283 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011253e-8b0c-49c9-a7a8-de8f2f2be43a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:46.141567 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011253e-8b0c-49c9-a7a8-de8f2f2be43a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:46.143073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011253e-8b0c-49c9-a7a8-de8f2f2be43a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:46.157749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-6011253e-8b0c-49c9-a7a8-de8f2f2be43a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:46:46.157749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:46:46.157749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:46:46.157749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:46:46.157749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:46:46.157749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:46:46.157749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:46:46.157749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:46:46.157749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:46:46.157749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:46:46.157749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:46:46.157749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:46:46.157749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:46:46.157749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:46:46.157749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:46:46.157749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:46:46.158942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:46:46.158942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:46:46.158942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:46:46.158942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:46:46.158942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:46:46.158942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:46:46.158942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:46:46.158942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:46:46.158942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:46:46.158942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:46:46.158942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:46:46.158942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:46:46.158942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:46:46.158942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:46:46.158942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:46:46.158942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:46:46.158942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:46:46.160035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:46:46.160035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:46:46.160035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:46:46.160035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 603/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:46:46.166064 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb19f84-3537-4b9a-8c4d-9627d2fb79bd None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:46.263885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:46.266905 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb19f84-3537-4b9a-8c4d-9627d2fb79bd None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:46.300895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dfa19-2597-42b5-b122-8fb7abb95c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:46.301495 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dfa19-2597-42b5-b122-8fb7abb95c91 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:46.301776 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dfa19-2597-42b5-b122-8fb7abb95c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:46.302049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dfa19-2597-42b5-b122-8fb7abb95c91 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:46.302738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dfa19-2597-42b5-b122-8fb7abb95c91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:46.308239 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dfa19-2597-42b5-b122-8fb7abb95c91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:46.308239 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dfa19-2597-42b5-b122-8fb7abb95c91 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:46.316614 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 608/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:46:46.322436 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011253e-8b0c-49c9-a7a8-de8f2f2be43a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:46.421069 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011253e-8b0c-49c9-a7a8-de8f2f2be43a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:46.422571 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:46.455081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d98ac-ac20-4d73-951f-dd47c772cbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:46.455698 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d98ac-ac20-4d73-951f-dd47c772cbc1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:46.455974 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d98ac-ac20-4d73-951f-dd47c772cbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:46.456244 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d98ac-ac20-4d73-951f-dd47c772cbc1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:46.463706 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d98ac-ac20-4d73-951f-dd47c772cbc1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:46.465129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d98ac-ac20-4d73-951f-dd47c772cbc1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:46.477301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-9c9d98ac-ac20-4d73-951f-dd47c772cbc1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 10:46:46.477301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:46:46.477301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:46:46.477301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:46:46.477301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:46:46.477301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:46:46.477301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:46:46.477301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:46:46.477301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:46:46.477301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:46:46.477301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:46:46.477301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:46:46.477301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:46:46.477301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:46:46.477301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:46:46.477301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:46:46.478260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:46:46.478260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:46:46.478260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:46:46.478260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:46:46.478260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:46:46.478260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:46:46.478260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:46:46.478260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:46:46.478260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:46:46.478260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:46:46.478260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:46:46.478260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:46:46.478260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:46:46.478260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:46:46.478260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:46:46.478260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:46:46.478260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:46:46.478260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:46:46.483522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:46:46.483522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:46:46.483522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:46:46.483522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:46:46.483522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:46:46.483522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:46:46.483522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:46:46.483522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:46:46.483522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 10:46:46.483522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:46:46.483522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 604/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:46:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:46:46.485087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dfa19-2597-42b5-b122-8fb7abb95c91 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:46.584942 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dfa19-2597-42b5-b122-8fb7abb95c91 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:46.619547 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280221f-4f33-4fa9-8be7-d6d07b8f7264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:46.620183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280221f-4f33-4fa9-8be7-d6d07b8f7264 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:46.620464 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280221f-4f33-4fa9-8be7-d6d07b8f7264 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:46.620735 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280221f-4f33-4fa9-8be7-d6d07b8f7264 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:46.621464 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280221f-4f33-4fa9-8be7-d6d07b8f7264 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:46.621766 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280221f-4f33-4fa9-8be7-d6d07b8f7264 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:46.623226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280221f-4f33-4fa9-8be7-d6d07b8f7264 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:46.640387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 609/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Aug 11 10:46:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:46:46.646256 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d98ac-ac20-4d73-951f-dd47c772cbc1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:46.746330 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d98ac-ac20-4d73-951f-dd47c772cbc1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:46.779974 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dec573-1ea4-4ed4-8d17-5a30e9a77431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:46.783205 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dec573-1ea4-4ed4-8d17-5a30e9a77431 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:46.783205 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dec573-1ea4-4ed4-8d17-5a30e9a77431 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:46.783205 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dec573-1ea4-4ed4-8d17-5a30e9a77431 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:46.810931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:46.848734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dec573-1ea4-4ed4-8d17-5a30e9a77431 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:46.850194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dec573-1ea4-4ed4-8d17-5a30e9a77431 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:46.944598 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 605/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:46:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 10:46:46.951172 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280221f-4f33-4fa9-8be7-d6d07b8f7264 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:46.969714 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:47.048313 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280221f-4f33-4fa9-8be7-d6d07b8f7264 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:47.084870 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5c3c9-5f2c-4576-8707-f75df4116c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:47.085498 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5c3c9-5f2c-4576-8707-f75df4116c1e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:47.085776 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5c3c9-5f2c-4576-8707-f75df4116c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:47.086102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5c3c9-5f2c-4576-8707-f75df4116c1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:47.095804 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5c3c9-5f2c-4576-8707-f75df4116c1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:47.097244 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5c3c9-5f2c-4576-8707-f75df4116c1e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:47.111373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-2ca5c3c9-5f2c-4576-8707-f75df4116c1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:46:47.111373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:46:47.111373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:46:47.111373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:46:47.111373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:46:47.111373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:46:47.111373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:46:47.111373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:46:47.111373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:46:47.111373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:46:47.111373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:46:47.111373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:46:47.111373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:46:47.111373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:46:47.111373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:46:47.111373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:46:47.112367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:46:47.112367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:46:47.112367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:46:47.112367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:46:47.112367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:46:47.112367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:46:47.112367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:46:47.112367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:46:47.112367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:46:47.112367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:46:47.112367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:46:47.112367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:46:47.112367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:46:47.112367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:46:47.112367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:46:47.112367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:46:47.112367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:46:47.113623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:46:47.113623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:46:47.113623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:46:47.113623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 610/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:46:47.118838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dec573-1ea4-4ed4-8d17-5a30e9a77431 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:47.178511 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:47.217724 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dec573-1ea4-4ed4-8d17-5a30e9a77431 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:47.250804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e8d5c-48b3-4739-abe0-10cc04ed4bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:47.251406 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e8d5c-48b3-4739-abe0-10cc04ed4bfb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:47.251684 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e8d5c-48b3-4739-abe0-10cc04ed4bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:47.251954 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e8d5c-48b3-4739-abe0-10cc04ed4bfb None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:47.252610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e8d5c-48b3-4739-abe0-10cc04ed4bfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:47.252909 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e8d5c-48b3-4739-abe0-10cc04ed4bfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:47.254267 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e8d5c-48b3-4739-abe0-10cc04ed4bfb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:47.265920 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 606/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:46:47.271490 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5c3c9-5f2c-4576-8707-f75df4116c1e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:47.340883 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:47.372830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5c3c9-5f2c-4576-8707-f75df4116c1e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:47.406359 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78081e-9add-4078-84da-cee66f647f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:47.407005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78081e-9add-4078-84da-cee66f647f9f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:47.407284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78081e-9add-4078-84da-cee66f647f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:47.407551 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78081e-9add-4078-84da-cee66f647f9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:47.413802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78081e-9add-4078-84da-cee66f647f9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:47.415314 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78081e-9add-4078-84da-cee66f647f9f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:47.425917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-aa78081e-9add-4078-84da-cee66f647f9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:46:47.425917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:46:47.425917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:46:47.425917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:46:47.425917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:46:47.425917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:46:47.425917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:46:47.425917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:46:47.425917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:46:47.425917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:46:47.425917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:46:47.425917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:46:47.425917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:46:47.425917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:46:47.425917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:46:47.428792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:46:47.428792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:46:47.428792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:46:47.428792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:46:47.428792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:46:47.428792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:46:47.428792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:46:47.428792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:46:47.428792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:46:47.428792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:46:47.428792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:46:47.428792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:46:47.428792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:46:47.428792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:46:47.428792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:46:47.428792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:46:47.428792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:46:47.429676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:46:47.429676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:46:47.429676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:46:47.429676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:46:47.429676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:46:47.429676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:46:47.429676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:46:47.429676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:46:47.429676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 611/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:46:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:46:47.433247 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e8d5c-48b3-4739-abe0-10cc04ed4bfb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:47.533946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e8d5c-48b3-4739-abe0-10cc04ed4bfb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:47.556717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:47.568171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d6f1d-4ca6-4f8a-945f-8cbaa86eaa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:47.568795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d6f1d-4ca6-4f8a-945f-8cbaa86eaa25 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:47.569094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d6f1d-4ca6-4f8a-945f-8cbaa86eaa25 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:47.569368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d6f1d-4ca6-4f8a-945f-8cbaa86eaa25 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:47.570048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d6f1d-4ca6-4f8a-945f-8cbaa86eaa25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:47.570425 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d6f1d-4ca6-4f8a-945f-8cbaa86eaa25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:47.572059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d6f1d-4ca6-4f8a-945f-8cbaa86eaa25 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:47.583203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 607/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:46:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:46:47.589955 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78081e-9add-4078-84da-cee66f647f9f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:47.687843 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78081e-9add-4078-84da-cee66f647f9f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:47.714855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:47.720440 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad34f57e-d4ee-4a9d-8214-be9a3b8cce1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:47.721035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34f57e-d4ee-4a9d-8214-be9a3b8cce1b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:47.721310 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34f57e-d4ee-4a9d-8214-be9a3b8cce1b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:47.721574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad34f57e-d4ee-4a9d-8214-be9a3b8cce1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:47.722281 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34f57e-d4ee-4a9d-8214-be9a3b8cce1b None admin] RBAC: Adding query filter params (role.id=6de833fef4c9456cb5d8ad66caf96586, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=4db99589bb504e8fa4068925badf3942) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:47.722586 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34f57e-d4ee-4a9d-8214-be9a3b8cce1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:47.724095 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad34f57e-d4ee-4a9d-8214-be9a3b8cce1b None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:47.729791 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 612/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:46:47 2022] GET /identity/v3/role_assignments?user.id=4db99589bb504e8fa4068925badf3942&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=6de833fef4c9456cb5d8ad66caf96586 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:46:49.686429 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3256948-bb85-4de2-b94a-792adacea1f9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:49.687009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3256948-bb85-4de2-b94a-792adacea1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:49.687009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3256948-bb85-4de2-b94a-792adacea1f9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:49.688332 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 608/1220] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:46:49.693362 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645809e-72a4-4009-b37a-8cf7a6e0cb03 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:49.693798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645809e-72a4-4009-b37a-8cf7a6e0cb03 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:49.693921 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645809e-72a4-4009-b37a-8cf7a6e0cb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:49.711588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5645809e-72a4-4009-b37a-8cf7a6e0cb03 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:46:49.712760 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5645809e-72a4-4009-b37a-8cf7a6e0cb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:46:49.777540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 613/1221] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:46:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:46:49.801102 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3256948-bb85-4de2-b94a-792adacea1f9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:49.905347 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3256948-bb85-4de2-b94a-792adacea1f9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:49.939656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178aee9-5b82-4cdb-b940-6ace439cad82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:49.940249 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178aee9-5b82-4cdb-b940-6ace439cad82 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:49.940503 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178aee9-5b82-4cdb-b940-6ace439cad82 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:49.940776 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178aee9-5b82-4cdb-b940-6ace439cad82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:49.951062 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178aee9-5b82-4cdb-b940-6ace439cad82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:46:49.955700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-8178aee9-5b82-4cdb-b940-6ace439cad82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:46:49.955700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:46:49.955700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:46:49.955700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:46:49.955700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:46:49.955700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:46:49.955700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:46:49.955700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:46:49.955700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:46:49.955700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:46:49.955700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:46:49.955700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:46:49.955700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:46:49.955700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:46:49.955700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:46:49.955700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:46:49.956614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:46:49.956614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:46:49.956614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:46:49.956614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:46:49.956614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:46:49.956614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:46:49.956614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:46:49.956614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:46:49.956614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:46:49.956614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:46:49.956614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:46:49.956614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:46:49.956614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:46:49.956614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:46:49.956614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:46:49.956614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:46:49.957472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:46:49.957472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:46:49.957472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:46:49.957472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:46:49.957472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:46:49.957472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:46:49.957472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:46:49.957472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:46:49.957472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:46:49.957472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:46:49.957472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:46:49.957472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:46:49.957472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 609/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:46:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:46:49.964046 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645809e-72a4-4009-b37a-8cf7a6e0cb03 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:50.064354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645809e-72a4-4009-b37a-8cf7a6e0cb03 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:50.087283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:50.097347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25565c0c-3a1e-4c4c-a565-5153b7bbc9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:50.097948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25565c0c-3a1e-4c4c-a565-5153b7bbc9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:50.098226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25565c0c-3a1e-4c4c-a565-5153b7bbc9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:50.098496 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25565c0c-3a1e-4c4c-a565-5153b7bbc9b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:50.099187 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25565c0c-3a1e-4c4c-a565-5153b7bbc9b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:50.099487 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25565c0c-3a1e-4c4c-a565-5153b7bbc9b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:50.100855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25565c0c-3a1e-4c4c-a565-5153b7bbc9b2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:50.109325 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 614/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Aug 11 10:46:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:46:50.115082 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178aee9-5b82-4cdb-b940-6ace439cad82 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:50.157784 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:50.212087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178aee9-5b82-4cdb-b940-6ace439cad82 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:50.244679 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dc85a-52c0-4d0c-9bcc-cc3c8476b122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:50.245302 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dc85a-52c0-4d0c-9bcc-cc3c8476b122 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:50.245584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dc85a-52c0-4d0c-9bcc-cc3c8476b122 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:50.245860 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dc85a-52c0-4d0c-9bcc-cc3c8476b122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:50.255450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71dc85a-52c0-4d0c-9bcc-cc3c8476b122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:50.256892 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71dc85a-52c0-4d0c-9bcc-cc3c8476b122 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:50.271208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-a71dc85a-52c0-4d0c-9bcc-cc3c8476b122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:46:50.271208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:46:50.271208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:46:50.271208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:46:50.271208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:46:50.271208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:46:50.271208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:46:50.271208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:46:50.271208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:46:50.271208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:46:50.271208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:46:50.271208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:46:50.271208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:46:50.271208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:46:50.271208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:46:50.271208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:46:50.276797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:46:50.276797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:46:50.276797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:46:50.276797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:46:50.276797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:46:50.276797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:46:50.276797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:46:50.276797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:46:50.276797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:46:50.276797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:46:50.276797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:46:50.276797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:46:50.276797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:46:50.276797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:46:50.276797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:46:50.276797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:46:50.276797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:46:50.277712 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:46:50.277712 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:46:50.277712 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:46:50.277712 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 610/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:46:50.279197 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25565c0c-3a1e-4c4c-a565-5153b7bbc9b2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:50.378170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25565c0c-3a1e-4c4c-a565-5153b7bbc9b2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:50.412465 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82621a74-6072-44d5-bf3d-559518edb680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:50.413132 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82621a74-6072-44d5-bf3d-559518edb680 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:50.414927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82621a74-6072-44d5-bf3d-559518edb680 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:50.414927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82621a74-6072-44d5-bf3d-559518edb680 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:50.414927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82621a74-6072-44d5-bf3d-559518edb680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:50.414927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82621a74-6072-44d5-bf3d-559518edb680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:50.416431 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82621a74-6072-44d5-bf3d-559518edb680 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:50.427957 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 615/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 10:46:50.433600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dc85a-52c0-4d0c-9bcc-cc3c8476b122 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:50.528220 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:50.534721 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dc85a-52c0-4d0c-9bcc-cc3c8476b122 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:50.567383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ee10c-efc6-4ae9-bd49-752a29e3ee50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:50.568015 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ee10c-efc6-4ae9-bd49-752a29e3ee50 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:50.568299 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ee10c-efc6-4ae9-bd49-752a29e3ee50 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:50.568571 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ee10c-efc6-4ae9-bd49-752a29e3ee50 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:50.575942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ee10c-efc6-4ae9-bd49-752a29e3ee50 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:50.577373 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ee10c-efc6-4ae9-bd49-752a29e3ee50 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:50.588991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-822ee10c-efc6-4ae9-bd49-752a29e3ee50 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 10:46:50.588991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:46:50.588991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:46:50.588991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:46:50.588991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:46:50.588991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:46:50.588991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:46:50.588991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:46:50.588991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:46:50.588991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:46:50.588991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:46:50.588991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:46:50.588991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:46:50.588991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:46:50.588991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:46:50.588991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:46:50.593449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:46:50.593449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:46:50.593449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:46:50.593449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:46:50.593449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:46:50.593449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:46:50.593449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:46:50.593449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:46:50.593449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:46:50.593449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:46:50.593449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:46:50.593449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:46:50.593449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:46:50.593449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:46:50.593449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:46:50.593449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:46:50.593449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:46:50.593449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:46:50.594581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:46:50.594581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:46:50.594581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:46:50.594581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:46:50.594581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:46:50.594581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:46:50.594581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:46:50.594581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:46:50.594581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 10:46:50.594581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:46:50.594581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 611/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:46:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:46:50.596015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82621a74-6072-44d5-bf3d-559518edb680 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:50.643823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:50.698142 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82621a74-6072-44d5-bf3d-559518edb680 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:50.731366 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1dc1d-86ba-44f7-b5be-b788cd5668d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:50.732223 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1dc1d-86ba-44f7-b5be-b788cd5668d9 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:50.732505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1dc1d-86ba-44f7-b5be-b788cd5668d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:50.732785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1dc1d-86ba-44f7-b5be-b788cd5668d9 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:50.733516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1dc1d-86ba-44f7-b5be-b788cd5668d9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:50.733821 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1dc1d-86ba-44f7-b5be-b788cd5668d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:50.735416 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe1dc1d-86ba-44f7-b5be-b788cd5668d9 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:50.754299 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 616/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Aug 11 10:46:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:46:50.760983 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ee10c-efc6-4ae9-bd49-752a29e3ee50 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:50.866801 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ee10c-efc6-4ae9-bd49-752a29e3ee50 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:50.901212 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80559a-e5da-497e-83db-274b4e3b9387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:50.901888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80559a-e5da-497e-83db-274b4e3b9387 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:50.902237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80559a-e5da-497e-83db-274b4e3b9387 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:50.902557 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80559a-e5da-497e-83db-274b4e3b9387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:50.912883 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80559a-e5da-497e-83db-274b4e3b9387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:50.916728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80559a-e5da-497e-83db-274b4e3b9387 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:50.928619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-4e80559a-e5da-497e-83db-274b4e3b9387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:46:50.928619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:46:50.928619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:46:50.928619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:46:50.928619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:46:50.928619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:46:50.928619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:46:50.928619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:46:50.928619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:46:50.928619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:46:50.928619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:46:50.928619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:46:50.928619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:46:50.928619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:46:50.928619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:46:50.928619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:46:50.930407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:46:50.930407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:46:50.930407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:46:50.930407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:46:50.930407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:46:50.930407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:46:50.930407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:46:50.930407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:46:50.930407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:46:50.930407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:46:50.930407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:46:50.930407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:46:50.930407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:46:50.930407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:46:50.930407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:46:50.930407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:46:50.930407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:46:50.931437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:46:50.931437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:46:50.931437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:46:50.931437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 612/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:46:50.936370 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1dc1d-86ba-44f7-b5be-b788cd5668d9 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:51.035193 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1dc1d-86ba-44f7-b5be-b788cd5668d9 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:51.037563 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:51.070263 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6401e13-a9d6-4b3d-a74a-d2c6037ca3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:51.071117 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6401e13-a9d6-4b3d-a74a-d2c6037ca3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:51.071401 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6401e13-a9d6-4b3d-a74a-d2c6037ca3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:51.071706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6401e13-a9d6-4b3d-a74a-d2c6037ca3c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:51.072362 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6401e13-a9d6-4b3d-a74a-d2c6037ca3c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:51.072664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6401e13-a9d6-4b3d-a74a-d2c6037ca3c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:51.074025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6401e13-a9d6-4b3d-a74a-d2c6037ca3c3 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:51.084667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 617/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:46:51.090678 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80559a-e5da-497e-83db-274b4e3b9387 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:51.100162 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:51.189133 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80559a-e5da-497e-83db-274b4e3b9387 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:51.221431 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245334d-1ebc-4ecc-aed8-5dbbb3713a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:51.222049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245334d-1ebc-4ecc-aed8-5dbbb3713a46 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:51.222326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245334d-1ebc-4ecc-aed8-5dbbb3713a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:51.222598 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245334d-1ebc-4ecc-aed8-5dbbb3713a46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:51.229725 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245334d-1ebc-4ecc-aed8-5dbbb3713a46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:51.231191 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245334d-1ebc-4ecc-aed8-5dbbb3713a46 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:51.243009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e245334d-1ebc-4ecc-aed8-5dbbb3713a46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:46:51.243009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:46:51.243009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:46:51.243009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:46:51.243009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:46:51.243009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:46:51.243009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:46:51.243009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:46:51.243009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:46:51.243009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:46:51.243009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:46:51.243009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:46:51.243009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:46:51.243009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:46:51.243009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:46:51.244059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:46:51.244059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:46:51.244059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:46:51.244059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:46:51.244059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:46:51.244059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:46:51.244059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:46:51.244059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:46:51.244059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:46:51.244059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:46:51.244059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:46:51.244059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:46:51.244059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:46:51.244059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:46:51.244059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:46:51.244059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:46:51.244059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:46:51.244961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:46:51.244961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:46:51.244961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:46:51.244961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:46:51.244961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:46:51.244961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:46:51.244961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:46:51.244961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:46:51.245626 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 613/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:46:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:46:51.251378 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6401e13-a9d6-4b3d-a74a-d2c6037ca3c3 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:51.349604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6401e13-a9d6-4b3d-a74a-d2c6037ca3c3 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:51.383987 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502c0e5-9208-4bdb-82b4-8267d98f3f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:51.384586 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502c0e5-9208-4bdb-82b4-8267d98f3f08 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:51.384868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502c0e5-9208-4bdb-82b4-8267d98f3f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:51.385141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502c0e5-9208-4bdb-82b4-8267d98f3f08 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:51.385866 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502c0e5-9208-4bdb-82b4-8267d98f3f08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:51.386174 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502c0e5-9208-4bdb-82b4-8267d98f3f08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:51.387636 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502c0e5-9208-4bdb-82b4-8267d98f3f08 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:51.399437 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 618/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:46:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:46:51.405633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245334d-1ebc-4ecc-aed8-5dbbb3713a46 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:51.470918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:51.512183 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245334d-1ebc-4ecc-aed8-5dbbb3713a46 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:51.544262 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbf9d1-53e8-434b-8720-953b63452332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:51.544912 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbf9d1-53e8-434b-8720-953b63452332 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:51.545196 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbf9d1-53e8-434b-8720-953b63452332 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:51.545504 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbf9d1-53e8-434b-8720-953b63452332 None admin] PATH_INFO: `/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/4db99589bb504e8fa4068925badf3942/roles/6de833fef4c9456cb5d8ad66caf96586` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:51.561547 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bbf9d1-53e8-434b-8720-953b63452332 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb12c96bf3a84df0b86967fbe93d1c17, user_id=4db99589bb504e8fa4068925badf3942, role_id=6de833fef4c9456cb5d8ad66caf96586)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:51.563100 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bbf9d1-53e8-434b-8720-953b63452332 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:51.673052 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 614/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:46:51 2022] PUT /identity/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/4db99589bb504e8fa4068925badf3942/roles/6de833fef4c9456cb5d8ad66caf96586 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:46:53.675449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a49639-a052-487e-9558-adbcc35ddddc None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:53.675983 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a49639-a052-487e-9558-adbcc35ddddc None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:53.676101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a49639-a052-487e-9558-adbcc35ddddc None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:53.677331 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 619/1233] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:46:53.683166 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83d8d5-9d9c-4631-a40f-e809bd46f2c7 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:53.690022 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83d8d5-9d9c-4631-a40f-e809bd46f2c7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:53.690022 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83d8d5-9d9c-4631-a40f-e809bd46f2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:53.701782 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-cd83d8d5-9d9c-4631-a40f-e809bd46f2c7 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:46:53.702998 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cd83d8d5-9d9c-4631-a40f-e809bd46f2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:46:53.767823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 615/1234] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:46:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:46:53.792607 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a49639-a052-487e-9558-adbcc35ddddc None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:53.817388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:53.893018 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a49639-a052-487e-9558-adbcc35ddddc None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:53.926678 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf60842-f9dd-4bc1-9dab-7389631a6477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:53.927255 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf60842-f9dd-4bc1-9dab-7389631a6477 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:53.927529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf60842-f9dd-4bc1-9dab-7389631a6477 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:53.927800 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf60842-f9dd-4bc1-9dab-7389631a6477 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:53.937719 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf60842-f9dd-4bc1-9dab-7389631a6477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:46:53.942382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-ccf60842-f9dd-4bc1-9dab-7389631a6477 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:46:53.942382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:46:53.942382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:46:53.942382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:46:53.942382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:46:53.942382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:46:53.942382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:46:53.942382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:46:53.942382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:46:53.942382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:46:53.942382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:46:53.942382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:46:53.942382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:46:53.942382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:46:53.942382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:46:53.942382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:46:53.943488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:46:53.943488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:46:53.943488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:46:53.943488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:46:53.943488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:46:53.943488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:46:53.943488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:46:53.943488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:46:53.943488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:46:53.943488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:46:53.943488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:46:53.943488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:46:53.943488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:46:53.943488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:46:53.943488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:46:53.943488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:46:53.944556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:46:53.944556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:46:53.944556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:46:53.944556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:46:53.944556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:46:53.944556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:46:53.944556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:46:53.944556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:46:53.944556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:46:53.944556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:46:53.944556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 11 10:46:53.944556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:46:53.944556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 620/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Aug 11 10:46:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:46:53.950388 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83d8d5-9d9c-4631-a40f-e809bd46f2c7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:53.996152 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:54.049030 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83d8d5-9d9c-4631-a40f-e809bd46f2c7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:54.081751 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1027ac-8ea8-4064-836e-fae370ba22bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:54.082351 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1027ac-8ea8-4064-836e-fae370ba22bf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:54.082627 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1027ac-8ea8-4064-836e-fae370ba22bf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:54.082963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1027ac-8ea8-4064-836e-fae370ba22bf None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:54.083618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1027ac-8ea8-4064-836e-fae370ba22bf None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:54.083916 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1027ac-8ea8-4064-836e-fae370ba22bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:54.085267 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1027ac-8ea8-4064-836e-fae370ba22bf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:54.093508 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 616/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Aug 11 10:46:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:46:54.099472 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf60842-f9dd-4bc1-9dab-7389631a6477 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:54.182293 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:54.198540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf60842-f9dd-4bc1-9dab-7389631a6477 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:54.232537 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671c01a-1e24-4dea-a87f-d47ad99dc037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:54.233178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671c01a-1e24-4dea-a87f-d47ad99dc037 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:54.233490 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671c01a-1e24-4dea-a87f-d47ad99dc037 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:54.233767 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671c01a-1e24-4dea-a87f-d47ad99dc037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:54.244813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671c01a-1e24-4dea-a87f-d47ad99dc037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:54.246257 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671c01a-1e24-4dea-a87f-d47ad99dc037 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:54.260787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-b671c01a-1e24-4dea-a87f-d47ad99dc037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:46:54.260787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:46:54.260787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:46:54.260787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:46:54.260787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:46:54.260787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:46:54.260787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:46:54.260787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:46:54.260787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:46:54.260787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:46:54.260787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:46:54.260787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:46:54.260787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:46:54.260787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:46:54.260787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:46:54.260787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:46:54.261872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:46:54.261872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:46:54.261872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:46:54.261872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:46:54.261872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:46:54.261872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:46:54.261872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:46:54.261872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:46:54.261872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:46:54.261872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:46:54.261872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:46:54.261872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:46:54.261872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:46:54.261872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:46:54.261872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:46:54.261872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:46:54.261872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:46:54.262947 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:46:54.262947 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:46:54.262947 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:46:54.262947 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 621/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:46:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:46:54.267846 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1027ac-8ea8-4064-836e-fae370ba22bf None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:54.369364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1027ac-8ea8-4064-836e-fae370ba22bf None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:54.378063 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:54.402738 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223e2fa-be40-43e4-86fa-585ba2cb3efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:54.403369 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223e2fa-be40-43e4-86fa-585ba2cb3efb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:54.403652 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223e2fa-be40-43e4-86fa-585ba2cb3efb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:54.403927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223e2fa-be40-43e4-86fa-585ba2cb3efb None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:54.404553 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223e2fa-be40-43e4-86fa-585ba2cb3efb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:54.404849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223e2fa-be40-43e4-86fa-585ba2cb3efb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:54.406205 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3223e2fa-be40-43e4-86fa-585ba2cb3efb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:54.417528 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 617/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:46:54.423533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671c01a-1e24-4dea-a87f-d47ad99dc037 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:54.522410 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671c01a-1e24-4dea-a87f-d47ad99dc037 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:54.556244 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6535c9-7cff-4882-afe7-8f1a4b7db96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:54.556866 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6535c9-7cff-4882-afe7-8f1a4b7db96f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:54.557199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6535c9-7cff-4882-afe7-8f1a4b7db96f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:54.557485 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6535c9-7cff-4882-afe7-8f1a4b7db96f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:54.560142 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:54.565764 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6535c9-7cff-4882-afe7-8f1a4b7db96f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:54.567242 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6535c9-7cff-4882-afe7-8f1a4b7db96f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:54.577956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-ff6535c9-7cff-4882-afe7-8f1a4b7db96f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 10:46:54.577956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:46:54.577956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:46:54.577956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:46:54.577956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:46:54.577956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:46:54.577956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:46:54.577956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:46:54.577956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:46:54.577956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:46:54.577956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:46:54.577956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:46:54.577956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:46:54.577956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:46:54.577956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:46:54.577956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:46:54.583394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:46:54.583394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:46:54.583394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:46:54.583394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:46:54.583394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:46:54.583394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:46:54.583394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:46:54.583394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:46:54.583394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:46:54.583394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:46:54.583394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:46:54.583394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:46:54.583394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:46:54.583394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:46:54.583394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:46:54.583394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:46:54.583394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:46:54.583394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:46:54.584356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:46:54.584356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:46:54.584356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:46:54.584356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:46:54.584356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:46:54.584356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:46:54.584356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:46:54.584356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:46:54.584356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 10:46:54.584356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:46:54.584356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 622/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:46:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:46:54.586599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223e2fa-be40-43e4-86fa-585ba2cb3efb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:54.685658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223e2fa-be40-43e4-86fa-585ba2cb3efb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:54.719539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d5fb9-96e7-4dce-a2dd-9f135bdaf7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:54.720136 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d5fb9-96e7-4dce-a2dd-9f135bdaf7ba None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:54.720418 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d5fb9-96e7-4dce-a2dd-9f135bdaf7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:54.720688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d5fb9-96e7-4dce-a2dd-9f135bdaf7ba None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:54.721401 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d5fb9-96e7-4dce-a2dd-9f135bdaf7ba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:54.721699 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d5fb9-96e7-4dce-a2dd-9f135bdaf7ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:54.723150 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d5fb9-96e7-4dce-a2dd-9f135bdaf7ba None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:54.740419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 618/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Aug 11 10:46:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:46:54.746339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6535c9-7cff-4882-afe7-8f1a4b7db96f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:54.843604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6535c9-7cff-4882-afe7-8f1a4b7db96f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:54.876625 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac84a8-c122-428d-ad5d-3a4519a849e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:54.877222 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac84a8-c122-428d-ad5d-3a4519a849e6 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:54.877501 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac84a8-c122-428d-ad5d-3a4519a849e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:54.877775 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac84a8-c122-428d-ad5d-3a4519a849e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:54.936704 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:54.943726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac84a8-c122-428d-ad5d-3a4519a849e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:54.945741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac84a8-c122-428d-ad5d-3a4519a849e6 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:55.041481 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 623/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:46:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 10:46:55.047387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d5fb9-96e7-4dce-a2dd-9f135bdaf7ba None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:55.075283 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:55.146018 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d5fb9-96e7-4dce-a2dd-9f135bdaf7ba None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:55.180061 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039edbd-e666-4594-b8e7-d46c3f925383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:55.180722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039edbd-e666-4594-b8e7-d46c3f925383 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:55.181031 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039edbd-e666-4594-b8e7-d46c3f925383 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:55.181307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039edbd-e666-4594-b8e7-d46c3f925383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:55.191149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039edbd-e666-4594-b8e7-d46c3f925383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:55.195697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039edbd-e666-4594-b8e7-d46c3f925383 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:55.207140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-4039edbd-e666-4594-b8e7-d46c3f925383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:46:55.207140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:46:55.207140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:46:55.207140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:46:55.207140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:46:55.207140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:46:55.207140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:46:55.207140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:46:55.207140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:46:55.207140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:46:55.207140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:46:55.207140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:46:55.207140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:46:55.207140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:46:55.207140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:46:55.207140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:46:55.208889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:46:55.208889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:46:55.208889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:46:55.208889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:46:55.208889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:46:55.208889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:46:55.208889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:46:55.208889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:46:55.208889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:46:55.208889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:46:55.208889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:46:55.208889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:46:55.208889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:46:55.208889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:46:55.208889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:46:55.208889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:46:55.208889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:46:55.210640 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:46:55.210640 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:46:55.210640 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:46:55.210640 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 619/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:46:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:46:55.214036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac84a8-c122-428d-ad5d-3a4519a849e6 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:55.305122 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:55.310620 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac84a8-c122-428d-ad5d-3a4519a849e6 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:55.342724 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32ce4f-47df-4317-aeff-77290966b21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:55.343491 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32ce4f-47df-4317-aeff-77290966b21f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:55.343769 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32ce4f-47df-4317-aeff-77290966b21f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:55.344038 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32ce4f-47df-4317-aeff-77290966b21f None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:55.344667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32ce4f-47df-4317-aeff-77290966b21f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:55.344965 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32ce4f-47df-4317-aeff-77290966b21f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:55.346353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32ce4f-47df-4317-aeff-77290966b21f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:55.357302 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 624/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:46:55.363066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039edbd-e666-4594-b8e7-d46c3f925383 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:55.446737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:55.466780 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039edbd-e666-4594-b8e7-d46c3f925383 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:55.499725 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e096379-0e14-45cf-a83d-52cf0f265ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:55.500367 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e096379-0e14-45cf-a83d-52cf0f265ccb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:55.500630 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e096379-0e14-45cf-a83d-52cf0f265ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:55.500903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e096379-0e14-45cf-a83d-52cf0f265ccb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:55.507402 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e096379-0e14-45cf-a83d-52cf0f265ccb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:55.508878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e096379-0e14-45cf-a83d-52cf0f265ccb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:55.519624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-2e096379-0e14-45cf-a83d-52cf0f265ccb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:46:55.519624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:46:55.519624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:46:55.519624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:46:55.519624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:46:55.519624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:46:55.519624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:46:55.519624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:46:55.519624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:46:55.519624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:46:55.519624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:46:55.519624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:46:55.519624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:46:55.519624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:46:55.519624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:46:55.520734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:46:55.520734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:46:55.520734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:46:55.520734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:46:55.520734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:46:55.520734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:46:55.520734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:46:55.520734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:46:55.520734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:46:55.520734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:46:55.520734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:46:55.520734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:46:55.520734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:46:55.520734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:46:55.520734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:46:55.520734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:46:55.520734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:46:55.521642 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:46:55.521642 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:46:55.521642 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:46:55.521642 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:46:55.521642 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:46:55.521642 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:46:55.521642 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:46:55.521642 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:46:55.521642 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 620/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:46:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:46:55.526662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32ce4f-47df-4317-aeff-77290966b21f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:55.626349 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32ce4f-47df-4317-aeff-77290966b21f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:55.659348 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965afde9-d59b-4e5a-abfb-6b20ab4b2347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:55.659944 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965afde9-d59b-4e5a-abfb-6b20ab4b2347 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:55.660248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965afde9-d59b-4e5a-abfb-6b20ab4b2347 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:55.660519 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965afde9-d59b-4e5a-abfb-6b20ab4b2347 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:55.661199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965afde9-d59b-4e5a-abfb-6b20ab4b2347 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:55.661500 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965afde9-d59b-4e5a-abfb-6b20ab4b2347 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:55.663338 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965afde9-d59b-4e5a-abfb-6b20ab4b2347 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:55.674831 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 625/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:46:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:46:55.681101 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e096379-0e14-45cf-a83d-52cf0f265ccb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:55.779556 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e096379-0e14-45cf-a83d-52cf0f265ccb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:55.812044 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e7d4d-1ba9-4087-8190-9748d3f76098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:55.812636 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e7d4d-1ba9-4087-8190-9748d3f76098 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:55.812913 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e7d4d-1ba9-4087-8190-9748d3f76098 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:55.813182 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e7d4d-1ba9-4087-8190-9748d3f76098 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:55.813890 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e7d4d-1ba9-4087-8190-9748d3f76098 None admin] RBAC: Adding query filter params (role.id=6de833fef4c9456cb5d8ad66caf96586, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=4db99589bb504e8fa4068925badf3942) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:55.814191 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e7d4d-1ba9-4087-8190-9748d3f76098 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:55.815659 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e7d4d-1ba9-4087-8190-9748d3f76098 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:55.821896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 621/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:46:55 2022] GET /identity/v3/role_assignments?user.id=4db99589bb504e8fa4068925badf3942&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=6de833fef4c9456cb5d8ad66caf96586 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:46:57.900802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac68f1-2d11-4f34-ba0f-6013f825d933 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:57.901367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac68f1-2d11-4f34-ba0f-6013f825d933 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:57.901367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac68f1-2d11-4f34-ba0f-6013f825d933 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:57.902670 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 626/1247] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:46:57.907795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c97c8-4e39-4a97-9277-f70d80270521 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:57.908238 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c97c8-4e39-4a97-9277-f70d80270521 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:57.908340 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c97c8-4e39-4a97-9277-f70d80270521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:57.914539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:57.926542 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-023c97c8-4e39-4a97-9277-f70d80270521 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:46:57.927749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-023c97c8-4e39-4a97-9277-f70d80270521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:46:57.993943 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 622/1248] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:46:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:46:58.017288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac68f1-2d11-4f34-ba0f-6013f825d933 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:58.039079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:58.119358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac68f1-2d11-4f34-ba0f-6013f825d933 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:58.152424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eca6f4-4249-4135-9212-51e3a9cf611b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:58.152968 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eca6f4-4249-4135-9212-51e3a9cf611b None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:58.153247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eca6f4-4249-4135-9212-51e3a9cf611b None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:58.153518 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eca6f4-4249-4135-9212-51e3a9cf611b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:58.163091 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eca6f4-4249-4135-9212-51e3a9cf611b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:46:58.168503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-93eca6f4-4249-4135-9212-51e3a9cf611b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:46:58.168503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:46:58.168503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:46:58.168503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:46:58.168503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:46:58.168503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:46:58.168503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:46:58.168503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:46:58.168503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:46:58.168503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:46:58.168503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:46:58.168503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:46:58.168503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:46:58.168503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:46:58.168503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:46:58.168503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:46:58.169604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:46:58.169604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:46:58.169604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:46:58.169604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:46:58.169604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:46:58.169604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:46:58.169604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:46:58.169604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:46:58.169604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:46:58.169604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:46:58.169604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:46:58.169604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:46:58.169604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:46:58.169604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:46:58.169604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:46:58.169604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:46:58.170611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:46:58.170611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:46:58.170611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:46:58.170611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:46:58.170611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:46:58.170611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:46:58.170611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:46:58.170611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:46:58.170611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:46:58.170611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:46:58.170611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:46:58.170611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:46:58.170611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 627/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:46:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:46:58.175936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c97c8-4e39-4a97-9277-f70d80270521 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:58.271336 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c97c8-4e39-4a97-9277-f70d80270521 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:58.301458 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:58.306170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c556ef9-7a23-480d-9379-df14cf35dad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:58.306777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c556ef9-7a23-480d-9379-df14cf35dad7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:58.307074 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c556ef9-7a23-480d-9379-df14cf35dad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:58.307349 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c556ef9-7a23-480d-9379-df14cf35dad7 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:58.308002 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c556ef9-7a23-480d-9379-df14cf35dad7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:58.308297 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c556ef9-7a23-480d-9379-df14cf35dad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:58.309633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c556ef9-7a23-480d-9379-df14cf35dad7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:58.317644 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 623/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:46:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:46:58.323941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eca6f4-4249-4135-9212-51e3a9cf611b None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:58.401428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:58.424064 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eca6f4-4249-4135-9212-51e3a9cf611b None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:58.456197 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f681f06-009e-4660-a7be-42c23da2063f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:58.456817 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f681f06-009e-4660-a7be-42c23da2063f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:58.457096 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f681f06-009e-4660-a7be-42c23da2063f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:58.457368 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f681f06-009e-4660-a7be-42c23da2063f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:58.468449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f681f06-009e-4660-a7be-42c23da2063f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:58.469897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f681f06-009e-4660-a7be-42c23da2063f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:58.483641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-2f681f06-009e-4660-a7be-42c23da2063f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:46:58.483641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:46:58.483641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:46:58.483641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:46:58.483641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:46:58.483641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:46:58.483641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:46:58.483641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:46:58.483641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:46:58.483641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:46:58.483641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:46:58.483641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:46:58.483641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:46:58.483641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:46:58.483641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:46:58.483641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:46:58.484706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:46:58.484706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:46:58.484706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:46:58.484706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:46:58.484706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:46:58.484706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:46:58.484706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:46:58.484706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:46:58.484706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:46:58.484706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:46:58.484706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:46:58.484706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:46:58.484706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:46:58.484706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:46:58.484706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:46:58.484706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:46:58.484706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:46:58.485896 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:46:58.485896 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:46:58.485896 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:46:58.485896 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 628/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:46:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:46:58.490696 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c556ef9-7a23-480d-9379-df14cf35dad7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:58.592886 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c556ef9-7a23-480d-9379-df14cf35dad7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:58.625251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dba97c-5500-4383-94ad-f04fbc3889e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:58.625853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dba97c-5500-4383-94ad-f04fbc3889e7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:58.626135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dba97c-5500-4383-94ad-f04fbc3889e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:58.626410 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dba97c-5500-4383-94ad-f04fbc3889e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:58.627073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dba97c-5500-4383-94ad-f04fbc3889e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:58.627375 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dba97c-5500-4383-94ad-f04fbc3889e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:58.628747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dba97c-5500-4383-94ad-f04fbc3889e7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:58.640554 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 624/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:46:58.646264 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f681f06-009e-4660-a7be-42c23da2063f None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:58.745296 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f681f06-009e-4660-a7be-42c23da2063f None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:58.770417 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:58.778899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97849d7b-efc6-49c6-bcd4-7a7916290735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:58.779520 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97849d7b-efc6-49c6-bcd4-7a7916290735 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:58.779801 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97849d7b-efc6-49c6-bcd4-7a7916290735 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:58.780075 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97849d7b-efc6-49c6-bcd4-7a7916290735 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:58.787066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97849d7b-efc6-49c6-bcd4-7a7916290735 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:58.788590 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97849d7b-efc6-49c6-bcd4-7a7916290735 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:58.799300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-97849d7b-efc6-49c6-bcd4-7a7916290735 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 10:46:58.799300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:46:58.799300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:46:58.799300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:46:58.799300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:46:58.799300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:46:58.799300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:46:58.799300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:46:58.799300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:46:58.799300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:46:58.799300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:46:58.799300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:46:58.799300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:46:58.799300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:46:58.799300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:46:58.799300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:46:58.802069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:46:58.802069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:46:58.802069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:46:58.802069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:46:58.802069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:46:58.802069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:46:58.802069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:46:58.802069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:46:58.802069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:46:58.802069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:46:58.802069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:46:58.802069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:46:58.802069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:46:58.802069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:46:58.802069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:46:58.802069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:46:58.802069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:46:58.802069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:46:58.803316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:46:58.803316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:46:58.803316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:46:58.803316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:46:58.803316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:46:58.803316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:46:58.803316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:46:58.803316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:46:58.803316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 10:46:58.803316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:46:58.803316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 629/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:46:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:46:58.806868 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dba97c-5500-4383-94ad-f04fbc3889e7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:58.861162 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:58.904822 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dba97c-5500-4383-94ad-f04fbc3889e7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:58.937742 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e047e1-533b-420d-8b89-ee607b65a714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:58.938377 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e047e1-533b-420d-8b89-ee607b65a714 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:58.938614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e047e1-533b-420d-8b89-ee607b65a714 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:58.938933 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e047e1-533b-420d-8b89-ee607b65a714 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:58.939695 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e047e1-533b-420d-8b89-ee607b65a714 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:58.940034 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e047e1-533b-420d-8b89-ee607b65a714 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:58.941462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e047e1-533b-420d-8b89-ee607b65a714 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:58.958649 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 625/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Aug 11 10:46:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:46:58.972205 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97849d7b-efc6-49c6-bcd4-7a7916290735 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:59.064533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97849d7b-efc6-49c6-bcd4-7a7916290735 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:59.097642 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c959637-935d-4a6f-a935-fdd2debead6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:59.098247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c959637-935d-4a6f-a935-fdd2debead6d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:59.098529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c959637-935d-4a6f-a935-fdd2debead6d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:59.098828 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c959637-935d-4a6f-a935-fdd2debead6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:59.152958 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:59.165409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c959637-935d-4a6f-a935-fdd2debead6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:59.166926 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c959637-935d-4a6f-a935-fdd2debead6d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:59.260190 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 630/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:46:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 10:46:59.265988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e047e1-533b-420d-8b89-ee607b65a714 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:59.366374 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e047e1-533b-420d-8b89-ee607b65a714 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:59.380432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:59.400757 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab299f4-9bca-424a-bd84-4d6dbb30743b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:59.401385 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab299f4-9bca-424a-bd84-4d6dbb30743b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:59.401663 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab299f4-9bca-424a-bd84-4d6dbb30743b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:59.401935 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab299f4-9bca-424a-bd84-4d6dbb30743b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:59.411549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab299f4-9bca-424a-bd84-4d6dbb30743b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:59.412996 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab299f4-9bca-424a-bd84-4d6dbb30743b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:59.427447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-cab299f4-9bca-424a-bd84-4d6dbb30743b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:46:59.427447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:46:59.427447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:46:59.427447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:46:59.427447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:46:59.427447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:46:59.427447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:46:59.427447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:46:59.427447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:46:59.427447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:46:59.427447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:46:59.427447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:46:59.427447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:46:59.427447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:46:59.427447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:46:59.427447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:46:59.428498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:46:59.428498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:46:59.428498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:46:59.428498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:46:59.428498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:46:59.428498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:46:59.428498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:46:59.428498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:46:59.428498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:46:59.428498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:46:59.428498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:46:59.428498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:46:59.428498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:46:59.428498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:46:59.428498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:46:59.428498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:46:59.428498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:46:59.430080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:46:59.430080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:46:59.430080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:46:59.430080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 626/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:46:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:46:59.434994 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c959637-935d-4a6f-a935-fdd2debead6d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:59.520664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:46:59.532822 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c959637-935d-4a6f-a935-fdd2debead6d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:59.567526 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e09f3-38ba-46aa-b26e-d43d1407366a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:59.568131 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e09f3-38ba-46aa-b26e-d43d1407366a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:59.568410 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e09f3-38ba-46aa-b26e-d43d1407366a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:59.568680 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e09f3-38ba-46aa-b26e-d43d1407366a None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:59.569315 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e09f3-38ba-46aa-b26e-d43d1407366a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:59.569692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e09f3-38ba-46aa-b26e-d43d1407366a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:59.571201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e09f3-38ba-46aa-b26e-d43d1407366a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:59.581751 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 631/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:46:59.588733 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab299f4-9bca-424a-bd84-4d6dbb30743b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:59.688884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab299f4-9bca-424a-bd84-4d6dbb30743b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:59.722227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcff398-118d-481e-8691-63ff6ffae3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:59.723382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcff398-118d-481e-8691-63ff6ffae3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:59.723382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcff398-118d-481e-8691-63ff6ffae3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:59.723382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcff398-118d-481e-8691-63ff6ffae3b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:59.730672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcff398-118d-481e-8691-63ff6ffae3b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:59.732410 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcff398-118d-481e-8691-63ff6ffae3b3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:59.743881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-cfcff398-118d-481e-8691-63ff6ffae3b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:46:59.743881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:46:59.743881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:46:59.743881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:46:59.743881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:46:59.743881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:46:59.743881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:46:59.743881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:46:59.743881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:46:59.743881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:46:59.743881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:46:59.743881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:46:59.743881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:46:59.743881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:46:59.743881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:46:59.744919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:46:59.744919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:46:59.744919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:46:59.744919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:46:59.744919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:46:59.744919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:46:59.744919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:46:59.744919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:46:59.744919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:46:59.744919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:46:59.744919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:46:59.744919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:46:59.744919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:46:59.744919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:46:59.744919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:46:59.744919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:46:59.744919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:46:59.746137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:46:59.746137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:46:59.746137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:46:59.746137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:46:59.746137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:46:59.746137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:46:59.746137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:46:59.746137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:46:59.746137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 627/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:46:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:46:59.750907 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e09f3-38ba-46aa-b26e-d43d1407366a None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:59.849488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e09f3-38ba-46aa-b26e-d43d1407366a None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:46:59.882750 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812c784-0e81-4c4a-ae68-c87c028716d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:46:59.883376 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812c784-0e81-4c4a-ae68-c87c028716d0 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:46:59.883658 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812c784-0e81-4c4a-ae68-c87c028716d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:46:59.883931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812c784-0e81-4c4a-ae68-c87c028716d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:46:59.884619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812c784-0e81-4c4a-ae68-c87c028716d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:46:59.884923 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812c784-0e81-4c4a-ae68-c87c028716d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:46:59.886351 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812c784-0e81-4c4a-ae68-c87c028716d0 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:46:59.898435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 632/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:46:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:46:59.904639 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcff398-118d-481e-8691-63ff6ffae3b3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:46:59.931904 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:00.004959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcff398-118d-481e-8691-63ff6ffae3b3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:00.039056 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e781ff-28d8-4312-9ea3-bc4f995c866f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:00.039628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e781ff-28d8-4312-9ea3-bc4f995c866f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:00.039905 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e781ff-28d8-4312-9ea3-bc4f995c866f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:00.040174 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e781ff-28d8-4312-9ea3-bc4f995c866f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:00.040884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e781ff-28d8-4312-9ea3-bc4f995c866f None admin] RBAC: Adding query filter params (role.id=00c6de5dd6cd4267ba05941ddb91e6ad, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=4db99589bb504e8fa4068925badf3942) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:47:00.041188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e781ff-28d8-4312-9ea3-bc4f995c866f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:00.042611 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e781ff-28d8-4312-9ea3-bc4f995c866f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:00.047827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 628/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:46:59 2022] GET /identity/v3/role_assignments?user.id=4db99589bb504e8fa4068925badf3942&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=00c6de5dd6cd4267ba05941ddb91e6ad => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:47:02.065350 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031e290-bf00-43fa-94c4-895cc7a101b5 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:02.065866 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031e290-bf00-43fa-94c4-895cc7a101b5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:02.065972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031e290-bf00-43fa-94c4-895cc7a101b5 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:02.067368 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 633/1261] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:47:02.072815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86673c2-8b96-422d-80af-478d143e74e4 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:02.073237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86673c2-8b96-422d-80af-478d143e74e4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:02.083605 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86673c2-8b96-422d-80af-478d143e74e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:02.091825 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a86673c2-8b96-422d-80af-478d143e74e4 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:47:02.093002 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a86673c2-8b96-422d-80af-478d143e74e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:47:02.158468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 629/1262] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:47:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:47:02.180746 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031e290-bf00-43fa-94c4-895cc7a101b5 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:02.191617 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:02.278904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031e290-bf00-43fa-94c4-895cc7a101b5 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:02.310204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef2961-519b-47b2-8a2f-6d944496d74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:02.310786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef2961-519b-47b2-8a2f-6d944496d74e None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:02.311072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef2961-519b-47b2-8a2f-6d944496d74e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:02.311342 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef2961-519b-47b2-8a2f-6d944496d74e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:02.321423 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef2961-519b-47b2-8a2f-6d944496d74e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:47:02.326015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-04ef2961-519b-47b2-8a2f-6d944496d74e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:47:02.326015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:47:02.326015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:47:02.326015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:47:02.326015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:47:02.326015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:47:02.326015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:47:02.326015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:47:02.326015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:47:02.326015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:47:02.326015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:47:02.326015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:47:02.326015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:47:02.326015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:47:02.326015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:47:02.326015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:47:02.327094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:47:02.327094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:47:02.327094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:47:02.327094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:47:02.327094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:47:02.327094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:47:02.327094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:47:02.327094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:47:02.327094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:47:02.327094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:47:02.327094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:47:02.327094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:47:02.327094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:47:02.327094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:47:02.327094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:47:02.327094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:47:02.327975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:47:02.327975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:47:02.327975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:47:02.327975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:47:02.327975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:47:02.327975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:47:02.327975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:47:02.327975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:47:02.327975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:47:02.327975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:47:02.327975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:47:02.327975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:47:02.327975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 634/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:47:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:47:02.333161 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86673c2-8b96-422d-80af-478d143e74e4 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:02.352010 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:02.431192 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86673c2-8b96-422d-80af-478d143e74e4 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:02.464686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e7f20-8323-4d8f-b625-af4e5ca181c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:02.465288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e7f20-8323-4d8f-b625-af4e5ca181c4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:02.465565 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e7f20-8323-4d8f-b625-af4e5ca181c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:02.465837 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e7f20-8323-4d8f-b625-af4e5ca181c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:02.466571 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e7f20-8323-4d8f-b625-af4e5ca181c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:47:02.466862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e7f20-8323-4d8f-b625-af4e5ca181c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:02.468221 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e7f20-8323-4d8f-b625-af4e5ca181c4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:02.476262 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 630/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:47:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:47:02.482351 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef2961-519b-47b2-8a2f-6d944496d74e None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:02.547102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:02.580277 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef2961-519b-47b2-8a2f-6d944496d74e None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:02.611605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f3583-2e3c-4b73-8033-84bebbd9579c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:02.612221 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f3583-2e3c-4b73-8033-84bebbd9579c None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:02.612500 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f3583-2e3c-4b73-8033-84bebbd9579c None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:02.612770 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f3583-2e3c-4b73-8033-84bebbd9579c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:02.623916 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f3583-2e3c-4b73-8033-84bebbd9579c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:02.625350 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f3583-2e3c-4b73-8033-84bebbd9579c None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:02.639502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-057f3583-2e3c-4b73-8033-84bebbd9579c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:47:02.639502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:47:02.639502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:47:02.639502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:47:02.639502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:47:02.639502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:47:02.639502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:47:02.639502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:47:02.639502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:47:02.639502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:47:02.639502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:47:02.639502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:47:02.639502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:47:02.639502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:47:02.639502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:47:02.639502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:47:02.640588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:47:02.640588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:47:02.640588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:47:02.640588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:47:02.640588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:47:02.640588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:47:02.640588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:47:02.640588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:47:02.640588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:47:02.640588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:47:02.640588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:47:02.640588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:47:02.640588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:47:02.640588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:47:02.640588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:47:02.640588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:47:02.640588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:47:02.641457 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:47:02.641457 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:47:02.641457 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:47:02.641457 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 635/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:47:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:47:02.646519 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e7f20-8323-4d8f-b625-af4e5ca181c4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:02.729501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:02.748332 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e7f20-8323-4d8f-b625-af4e5ca181c4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:02.780388 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6071587-2fa7-4739-821f-0cb7064efc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:02.780979 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6071587-2fa7-4739-821f-0cb7064efc9b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:02.781252 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6071587-2fa7-4739-821f-0cb7064efc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:02.781517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6071587-2fa7-4739-821f-0cb7064efc9b None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:02.782152 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6071587-2fa7-4739-821f-0cb7064efc9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:47:02.782450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6071587-2fa7-4739-821f-0cb7064efc9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:02.783829 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6071587-2fa7-4739-821f-0cb7064efc9b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:02.795156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 631/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:47:02.800836 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f3583-2e3c-4b73-8033-84bebbd9579c None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:02.903278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f3583-2e3c-4b73-8033-84bebbd9579c None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:02.924879 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:02.938954 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b072d-2ebc-4f23-9192-47977a6c5f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:02.939580 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b072d-2ebc-4f23-9192-47977a6c5f88 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:02.939863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b072d-2ebc-4f23-9192-47977a6c5f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:02.940152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b072d-2ebc-4f23-9192-47977a6c5f88 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:02.948252 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b072d-2ebc-4f23-9192-47977a6c5f88 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:02.949698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b072d-2ebc-4f23-9192-47977a6c5f88 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:02.960899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-823b072d-2ebc-4f23-9192-47977a6c5f88 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 10:47:02.960899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:47:02.960899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:47:02.960899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:47:02.960899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:47:02.960899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:47:02.960899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:47:02.960899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:47:02.960899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:47:02.960899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:47:02.960899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:47:02.960899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:47:02.960899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:47:02.960899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:47:02.960899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:47:02.960899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:47:02.961999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:47:02.961999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:47:02.961999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:47:02.961999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:47:02.961999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:47:02.961999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:47:02.961999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:47:02.961999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:47:02.961999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:47:02.961999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:47:02.961999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:47:02.961999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:47:02.961999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:47:02.961999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:47:02.961999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:47:02.961999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:47:02.961999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:47:02.961999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:47:02.963081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:47:02.963081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:47:02.963081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:47:02.963081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:47:02.963081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:47:02.963081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:47:02.963081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:47:02.963081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:47:02.963081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 10:47:02.963081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:47:02.963081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 636/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:47:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:47:02.967968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6071587-2fa7-4739-821f-0cb7064efc9b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:03.071307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6071587-2fa7-4739-821f-0cb7064efc9b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:03.104736 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7a520-fd03-40ce-bcab-92e7ead8c267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:03.105330 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7a520-fd03-40ce-bcab-92e7ead8c267 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:03.105613 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7a520-fd03-40ce-bcab-92e7ead8c267 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:03.105883 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7a520-fd03-40ce-bcab-92e7ead8c267 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:03.106608 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7a520-fd03-40ce-bcab-92e7ead8c267 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:47:03.107198 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7a520-fd03-40ce-bcab-92e7ead8c267 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:03.108633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7a520-fd03-40ce-bcab-92e7ead8c267 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:03.119122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:03.127155 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 632/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Aug 11 10:47:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:47:03.132888 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b072d-2ebc-4f23-9192-47977a6c5f88 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:03.229280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b072d-2ebc-4f23-9192-47977a6c5f88 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:03.261191 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15427de0-2350-4dec-a122-8d60c7ac0c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:03.261806 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15427de0-2350-4dec-a122-8d60c7ac0c72 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:03.262081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15427de0-2350-4dec-a122-8d60c7ac0c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:03.262350 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15427de0-2350-4dec-a122-8d60c7ac0c72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:03.272180 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15427de0-2350-4dec-a122-8d60c7ac0c72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:03.274170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15427de0-2350-4dec-a122-8d60c7ac0c72 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:03.287340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-15427de0-2350-4dec-a122-8d60c7ac0c72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:47:03.287340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:47:03.287340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:47:03.287340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:47:03.287340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:47:03.287340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:47:03.287340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:47:03.287340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:47:03.287340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:47:03.287340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:47:03.287340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:47:03.287340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:47:03.287340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:47:03.287340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:47:03.287340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:47:03.287340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:47:03.289676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:47:03.289676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:47:03.289676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:47:03.289676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:47:03.289676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:47:03.289676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:47:03.289676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:47:03.289676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:47:03.289676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:47:03.289676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:47:03.289676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:47:03.289676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:47:03.289676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:47:03.289676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:47:03.289676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:47:03.289676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:47:03.289676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:47:03.290903 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:47:03.290903 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:47:03.290903 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:47:03.290903 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 637/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:47:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:47:03.294867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7a520-fd03-40ce-bcab-92e7ead8c267 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:03.392246 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7a520-fd03-40ce-bcab-92e7ead8c267 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:03.425736 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2d2d2-c53a-4720-b7a0-3f17d5b4aa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:03.426338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2d2d2-c53a-4720-b7a0-3f17d5b4aa9d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:03.426620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2d2d2-c53a-4720-b7a0-3f17d5b4aa9d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:03.426926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2d2d2-c53a-4720-b7a0-3f17d5b4aa9d None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:03.427564 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2d2d2-c53a-4720-b7a0-3f17d5b4aa9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:47:03.427865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2d2d2-c53a-4720-b7a0-3f17d5b4aa9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:03.429493 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2d2d2-c53a-4720-b7a0-3f17d5b4aa9d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:03.440500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 633/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:47:03.446534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15427de0-2350-4dec-a122-8d60c7ac0c72 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:03.477981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:03.544837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15427de0-2350-4dec-a122-8d60c7ac0c72 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:03.577953 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc27a3-b767-42cb-b4b7-99f27ce464f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:03.578578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc27a3-b767-42cb-b4b7-99f27ce464f2 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:03.578888 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc27a3-b767-42cb-b4b7-99f27ce464f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:03.579321 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc27a3-b767-42cb-b4b7-99f27ce464f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:03.585809 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc27a3-b767-42cb-b4b7-99f27ce464f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:03.587286 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc27a3-b767-42cb-b4b7-99f27ce464f2 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:03.598170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-85dc27a3-b767-42cb-b4b7-99f27ce464f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:47:03.598170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:47:03.598170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:47:03.598170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:47:03.598170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:47:03.598170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:47:03.598170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:47:03.598170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:47:03.598170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:47:03.598170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:47:03.598170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:47:03.598170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:47:03.598170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:47:03.598170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:47:03.598170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:47:03.599231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:47:03.599231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:47:03.599231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:47:03.599231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:47:03.599231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:47:03.599231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:47:03.599231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:47:03.599231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:47:03.599231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:47:03.599231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:47:03.599231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:47:03.599231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:47:03.599231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:47:03.599231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:47:03.599231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:47:03.599231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:47:03.599231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:47:03.600330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:47:03.600330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:47:03.600330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:47:03.600330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:47:03.600330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:47:03.600330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:47:03.600330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:47:03.600330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:47:03.600330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 638/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:47:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:47:03.605439 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2d2d2-c53a-4720-b7a0-3f17d5b4aa9d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:03.664804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:03.706104 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2d2d2-c53a-4720-b7a0-3f17d5b4aa9d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:03.740321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7c40b-07b2-4991-941e-a526bda77f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:03.740927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7c40b-07b2-4991-941e-a526bda77f06 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:03.741289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7c40b-07b2-4991-941e-a526bda77f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:03.741622 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7c40b-07b2-4991-941e-a526bda77f06 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:03.742302 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7c40b-07b2-4991-941e-a526bda77f06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:47:03.742605 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7c40b-07b2-4991-941e-a526bda77f06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:03.744047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7c40b-07b2-4991-941e-a526bda77f06 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:03.755743 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 634/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:47:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:47:03.762520 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc27a3-b767-42cb-b4b7-99f27ce464f2 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:03.853630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:03.862252 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc27a3-b767-42cb-b4b7-99f27ce464f2 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:03.895404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cdcde-8aeb-4a19-b6e1-c5d58ecbc38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:03.896052 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cdcde-8aeb-4a19-b6e1-c5d58ecbc38e None admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:03.896335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cdcde-8aeb-4a19-b6e1-c5d58ecbc38e None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:03.896609 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cdcde-8aeb-4a19-b6e1-c5d58ecbc38e None admin] PATH_INFO: `/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/4db99589bb504e8fa4068925badf3942/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:03.898744 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cdcde-8aeb-4a19-b6e1-c5d58ecbc38e None admin] RBAC: Authorizing `identity:create_grant(project_id=bb12c96bf3a84df0b86967fbe93d1c17, user_id=4db99589bb504e8fa4068925badf3942, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:03.900220 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cdcde-8aeb-4a19-b6e1-c5d58ecbc38e None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:04.055496 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 639/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Aug 11 10:47:03 2022] PUT /identity/v3/projects/bb12c96bf3a84df0b86967fbe93d1c17/users/4db99589bb504e8fa4068925badf3942/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 10:47:06.044727 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3a009-7efe-4019-b676-5c72f54912a2 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:06.045154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3a009-7efe-4019-b676-5c72f54912a2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:06.045291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3a009-7efe-4019-b676-5c72f54912a2 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:06.046636 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 635/1274] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:47:06.051694 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd78f2f-9f08-4fd0-b4d2-d56e26482a1b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:06.052117 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd78f2f-9f08-4fd0-b4d2-d56e26482a1b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:06.052281 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd78f2f-9f08-4fd0-b4d2-d56e26482a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:06.071183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-edd78f2f-9f08-4fd0-b4d2-d56e26482a1b None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:47:06.072353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-edd78f2f-9f08-4fd0-b4d2-d56e26482a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:47:06.139454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 640/1275] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:47:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:47:06.162689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3a009-7efe-4019-b676-5c72f54912a2 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:06.264404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3a009-7efe-4019-b676-5c72f54912a2 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:06.281495 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:06.298193 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fbf4a-007d-414b-a1fc-a12536a80980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:06.298773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fbf4a-007d-414b-a1fc-a12536a80980 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:06.299061 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fbf4a-007d-414b-a1fc-a12536a80980 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:06.299335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fbf4a-007d-414b-a1fc-a12536a80980 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:06.309544 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fbf4a-007d-414b-a1fc-a12536a80980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 11 10:47:06.314122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-753fbf4a-007d-414b-a1fc-a12536a80980 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:47:06.314122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:47:06.314122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:47:06.314122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:47:06.314122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:47:06.314122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:47:06.314122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:47:06.314122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:47:06.314122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:47:06.314122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:47:06.314122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:47:06.314122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:47:06.314122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 11 10:47:06.314122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 11 10:47:06.314122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 11 10:47:06.314122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 11 10:47:06.315199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 11 10:47:06.315199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 11 10:47:06.315199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 11 10:47:06.315199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 11 10:47:06.315199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:47:06.315199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:47:06.315199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:47:06.315199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:47:06.315199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:47:06.315199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:47:06.315199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:47:06.315199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:47:06.315199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:47:06.315199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:47:06.315199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:47:06.315199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:47:06.316149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:47:06.316149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:47:06.316149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:47:06.316149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:47:06.316149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 11 10:47:06.316149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 11 10:47:06.316149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 11 10:47:06.316149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 11 10:47:06.316149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 11 10:47:06.316149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 11 10:47:06.316149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 11 10:47:06.316149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:47:06.316149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 636/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Aug 11 10:47:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:47:06.321726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd78f2f-9f08-4fd0-b4d2-d56e26482a1b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:06.402071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:06.419885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd78f2f-9f08-4fd0-b4d2-d56e26482a1b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:06.452648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fd357-0c6a-4be8-aece-7d11e466c4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:06.453248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fd357-0c6a-4be8-aece-7d11e466c4ca None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:06.453535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fd357-0c6a-4be8-aece-7d11e466c4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:06.453810 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fd357-0c6a-4be8-aece-7d11e466c4ca None admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:06.454474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fd357-0c6a-4be8-aece-7d11e466c4ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:47:06.454798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fd357-0c6a-4be8-aece-7d11e466c4ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:06.456171 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fd357-0c6a-4be8-aece-7d11e466c4ca None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:06.464588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 641/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Aug 11 10:47:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:47:06.470612 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fbf4a-007d-414b-a1fc-a12536a80980 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:06.578107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fbf4a-007d-414b-a1fc-a12536a80980 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:06.613795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7d196-17b1-4591-84f3-26ea08056af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:06.614510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7d196-17b1-4591-84f3-26ea08056af4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:06.614808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7d196-17b1-4591-84f3-26ea08056af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:06.615091 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7d196-17b1-4591-84f3-26ea08056af4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:06.625084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7d196-17b1-4591-84f3-26ea08056af4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:06.626553 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c7d196-17b1-4591-84f3-26ea08056af4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:06.641211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-12c7d196-17b1-4591-84f3-26ea08056af4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:47:06.641211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:47:06.641211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:47:06.641211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:47:06.641211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:47:06.641211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:47:06.641211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:47:06.641211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:47:06.641211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:47:06.641211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:47:06.641211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:47:06.641211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:47:06.641211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:47:06.641211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:47:06.641211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:47:06.641211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:47:06.642264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:47:06.642264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:47:06.642264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:47:06.642264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:47:06.642264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:47:06.642264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:47:06.642264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:47:06.642264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:47:06.642264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:47:06.642264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:47:06.642264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:47:06.642264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:47:06.642264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:47:06.642264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:47:06.642264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:47:06.642264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:47:06.642264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:47:06.643168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:47:06.643168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:47:06.643168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:47:06.643168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 637/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:47:06.648762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fd357-0c6a-4be8-aece-7d11e466c4ca None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:06.748373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fd357-0c6a-4be8-aece-7d11e466c4ca None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:06.780424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a09f8c-0456-473d-88ba-5cca1ec37776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:06.781025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a09f8c-0456-473d-88ba-5cca1ec37776 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:06.781312 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a09f8c-0456-473d-88ba-5cca1ec37776 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:06.781590 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a09f8c-0456-473d-88ba-5cca1ec37776 None admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:06.782245 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a09f8c-0456-473d-88ba-5cca1ec37776 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:47:06.782549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a09f8c-0456-473d-88ba-5cca1ec37776 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:06.783944 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a09f8c-0456-473d-88ba-5cca1ec37776 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:06.798362 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 642/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:47:06.804860 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7d196-17b1-4591-84f3-26ea08056af4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:06.837353 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:06.904218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7d196-17b1-4591-84f3-26ea08056af4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:06.937503 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411b263-3e59-40ef-b00e-efb7a06ac084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:06.938136 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411b263-3e59-40ef-b00e-efb7a06ac084 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:06.938415 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411b263-3e59-40ef-b00e-efb7a06ac084 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:06.938690 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411b263-3e59-40ef-b00e-efb7a06ac084 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:06.945596 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411b263-3e59-40ef-b00e-efb7a06ac084 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:06.947051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411b263-3e59-40ef-b00e-efb7a06ac084 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:06.960989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c411b263-3e59-40ef-b00e-efb7a06ac084 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 11 10:47:06.960989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:47:06.960989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:47:06.960989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:47:06.960989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:47:06.960989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:47:06.960989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:47:06.960989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:47:06.960989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:47:06.960989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:47:06.960989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:47:06.960989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:47:06.960989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 11 10:47:06.960989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 11 10:47:06.960989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 11 10:47:06.960989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 11 10:47:06.962235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:47:06.962235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:47:06.962235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 11 10:47:06.962235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:47:06.962235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 11 10:47:06.962235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 11 10:47:06.962235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:47:06.962235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:47:06.962235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:47:06.962235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:47:06.962235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:47:06.962235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:47:06.962235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:47:06.962235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:47:06.962235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:47:06.962235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:47:06.962235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:47:06.962235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:47:06.963549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:47:06.963549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:47:06.963549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 11 10:47:06.963549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 11 10:47:06.963549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 11 10:47:06.963549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 11 10:47:06.963549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 11 10:47:06.963549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 11 10:47:06.963549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 11 10:47:06.963549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:47:06.963549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 638/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:47:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:47:06.967844 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a09f8c-0456-473d-88ba-5cca1ec37776 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:06.971631 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:07.067155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a09f8c-0456-473d-88ba-5cca1ec37776 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:07.102119 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fa894-f1da-4fd0-81b9-65d0e6a85700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:07.102715 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fa894-f1da-4fd0-81b9-65d0e6a85700 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:07.103028 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fa894-f1da-4fd0-81b9-65d0e6a85700 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:07.103600 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fa894-f1da-4fd0-81b9-65d0e6a85700 None admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:07.104171 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fa894-f1da-4fd0-81b9-65d0e6a85700 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:47:07.104475 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fa894-f1da-4fd0-81b9-65d0e6a85700 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:07.105902 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fa894-f1da-4fd0-81b9-65d0e6a85700 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:07.122718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 643/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Aug 11 10:47:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:47:07.128595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411b263-3e59-40ef-b00e-efb7a06ac084 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:07.215048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:07.224230 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411b263-3e59-40ef-b00e-efb7a06ac084 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:07.257355 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32146b6-1eee-4dcc-ad9c-749193339ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:07.257974 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32146b6-1eee-4dcc-ad9c-749193339ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:07.258269 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32146b6-1eee-4dcc-ad9c-749193339ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:07.258531 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32146b6-1eee-4dcc-ad9c-749193339ea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:07.324710 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32146b6-1eee-4dcc-ad9c-749193339ea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:07.326264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32146b6-1eee-4dcc-ad9c-749193339ea9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:07.414026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:07.424021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 639/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Aug 11 10:47:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 11 10:47:07.430172 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fa894-f1da-4fd0-81b9-65d0e6a85700 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:07.490547 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:07.528150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fa894-f1da-4fd0-81b9-65d0e6a85700 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:07.561872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d78231-1397-4e73-9c64-b2d3101ad75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:07.562502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d78231-1397-4e73-9c64-b2d3101ad75d None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:07.562855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d78231-1397-4e73-9c64-b2d3101ad75d None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:07.563155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d78231-1397-4e73-9c64-b2d3101ad75d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:07.573881 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d78231-1397-4e73-9c64-b2d3101ad75d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:07.575374 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d78231-1397-4e73-9c64-b2d3101ad75d None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:07.589449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-06d78231-1397-4e73-9c64-b2d3101ad75d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:47:07.589449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:47:07.589449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:47:07.589449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:47:07.589449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:47:07.589449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:47:07.589449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:47:07.589449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:47:07.589449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:47:07.589449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:47:07.589449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:47:07.589449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:47:07.589449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 11 10:47:07.589449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 11 10:47:07.589449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 11 10:47:07.589449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 11 10:47:07.590534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:47:07.590534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:47:07.590534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:47:07.590534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:47:07.590534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:47:07.590534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:47:07.590534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:47:07.590534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:47:07.590534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:47:07.590534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:47:07.590534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:47:07.590534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:47:07.590534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:47:07.590534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:47:07.590534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:47:07.590534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:47:07.590534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 11 10:47:07.591802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 11 10:47:07.591802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 11 10:47:07.591802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:47:07.591802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 644/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 11 10:47:07.596453 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32146b6-1eee-4dcc-ad9c-749193339ea9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:07.692599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32146b6-1eee-4dcc-ad9c-749193339ea9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:07.725029 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dd39d-7fbf-4e56-873f-a1393b5ea944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:07.726159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dd39d-7fbf-4e56-873f-a1393b5ea944 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:07.726523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dd39d-7fbf-4e56-873f-a1393b5ea944 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:07.726827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744dd39d-7fbf-4e56-873f-a1393b5ea944 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:07.727465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744dd39d-7fbf-4e56-873f-a1393b5ea944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:47:07.727767 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744dd39d-7fbf-4e56-873f-a1393b5ea944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:07.729127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744dd39d-7fbf-4e56-873f-a1393b5ea944 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:07.740595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 640/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Aug 11 10:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:47:07.746867 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d78231-1397-4e73-9c64-b2d3101ad75d None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:07.843372 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d78231-1397-4e73-9c64-b2d3101ad75d None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:07.857428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:07.878106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3813aa-5318-4023-8a24-4ee77f4a9c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:07.878747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3813aa-5318-4023-8a24-4ee77f4a9c13 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:07.879051 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3813aa-5318-4023-8a24-4ee77f4a9c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:07.879327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3813aa-5318-4023-8a24-4ee77f4a9c13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:07.886159 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3813aa-5318-4023-8a24-4ee77f4a9c13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:07.887646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3813aa-5318-4023-8a24-4ee77f4a9c13 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:07.899993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application [None req-db3813aa-5318-4023-8a24-4ee77f4a9c13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:47:07.899993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:47:07.899993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:47:07.899993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:47:07.899993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:47:07.899993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:47:07.899993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:47:07.899993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:47:07.899993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:47:07.899993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:47:07.899993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:47:07.899993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:47:07.899993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 11 10:47:07.899993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 11 10:47:07.899993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 11 10:47:07.901020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 11 10:47:07.901020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:47:07.901020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:47:07.901020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:47:07.901020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:47:07.901020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:47:07.901020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:47:07.901020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:47:07.901020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application with Lock( Aug 11 10:47:07.901020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:47:07.901020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:47:07.901020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:47:07.901020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:47:07.901020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:47:07.901020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:47:07.901020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:47:07.901020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:47:07.902108 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 11 10:47:07.902108 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 11 10:47:07.902108 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 11 10:47:07.902108 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 11 10:47:07.902108 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 11 10:47:07.902108 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 11 10:47:07.902108 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 11 10:47:07.902108 dv-cinder-820027-17-smb devstack@keystone.service[81639]: ERROR keystone.server.flask.application Aug 11 10:47:07.902108 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 645/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Aug 11 10:47:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:47:07.906975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dd39d-7fbf-4e56-873f-a1393b5ea944 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:07.961146 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:08.007892 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744dd39d-7fbf-4e56-873f-a1393b5ea944 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:08.042522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e161e90-ddeb-42b4-b016-978463e72ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:08.043170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e161e90-ddeb-42b4-b016-978463e72ccf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:08.043453 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e161e90-ddeb-42b4-b016-978463e72ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:08.043776 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e161e90-ddeb-42b4-b016-978463e72ccf None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:08.044467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e161e90-ddeb-42b4-b016-978463e72ccf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:47:08.044771 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e161e90-ddeb-42b4-b016-978463e72ccf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:08.046190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e161e90-ddeb-42b4-b016-978463e72ccf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:08.058124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 641/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Aug 11 10:47:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:47:08.064562 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3813aa-5318-4023-8a24-4ee77f4a9c13 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:08.164778 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3813aa-5318-4023-8a24-4ee77f4a9c13 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:08.197439 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea70a73-8ba0-477e-9f68-20805de1884a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:08.198042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea70a73-8ba0-477e-9f68-20805de1884a None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:08.198322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea70a73-8ba0-477e-9f68-20805de1884a None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:08.198598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea70a73-8ba0-477e-9f68-20805de1884a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:08.199351 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea70a73-8ba0-477e-9f68-20805de1884a None admin] RBAC: Adding query filter params (role.id=00c6de5dd6cd4267ba05941ddb91e6ad, scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17, user.id=4db99589bb504e8fa4068925badf3942) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:47:08.199658 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea70a73-8ba0-477e-9f68-20805de1884a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:08.201088 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea70a73-8ba0-477e-9f68-20805de1884a None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:08.206811 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 646/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Aug 11 10:47:08 2022] GET /identity/v3/role_assignments?user.id=4db99589bb504e8fa4068925badf3942&scope.project.id=bb12c96bf3a84df0b86967fbe93d1c17&role.id=00c6de5dd6cd4267ba05941ddb91e6ad => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:47:10.235235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5b0ee-bb4a-4401-859a-c4fbd9e02e3a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:10.235807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5b0ee-bb4a-4401-859a-c4fbd9e02e3a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:10.235807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f5b0ee-bb4a-4401-859a-c4fbd9e02e3a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:10.237297 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 642/1288] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:47:10.242925 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca28371-3995-4b02-bc83-7f15ab75c898 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:10.243354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca28371-3995-4b02-bc83-7f15ab75c898 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:10.243479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca28371-3995-4b02-bc83-7f15ab75c898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:10.261155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-cca28371-3995-4b02-bc83-7f15ab75c898 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:47:10.262407 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-cca28371-3995-4b02-bc83-7f15ab75c898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:47:10.297056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:10.327183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 647/1289] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:47:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:47:10.349866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5b0ee-bb4a-4401-859a-c4fbd9e02e3a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:10.453086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f5b0ee-bb4a-4401-859a-c4fbd9e02e3a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:10.464458 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:10.487319 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded9201-b8bb-4eb8-9feb-aa54c4934b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:10.487945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded9201-b8bb-4eb8-9feb-aa54c4934b48 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:10.488229 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded9201-b8bb-4eb8-9feb-aa54c4934b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:10.488501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded9201-b8bb-4eb8-9feb-aa54c4934b48 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:10.489078 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded9201-b8bb-4eb8-9feb-aa54c4934b48 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:10.490435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded9201-b8bb-4eb8-9feb-aa54c4934b48 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:10.499071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-fded9201-b8bb-4eb8-9feb-aa54c4934b48 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 10:47:10.499071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:47:10.499071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:47:10.499071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:47:10.499071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:47:10.499071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:47:10.499071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:47:10.499071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:47:10.499071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 10:47:10.499071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:47:10.499071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:47:10.499071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:47:10.499071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:47:10.499071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:47:10.499071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:47:10.499071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:47:10.499071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:47:10.500344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:47:10.500344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:47:10.500344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:47:10.500344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:47:10.500344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:47:10.500344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:47:10.500344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:47:10.500344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:47:10.500344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:47:10.500344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:47:10.500344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:47:10.500344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:47:10.500344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:47:10.500344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:47:10.500344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:47:10.500344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:47:10.501253 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:47:10.501253 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:47:10.501253 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:47:10.501253 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:47:10.501253 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:47:10.501253 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:47:10.501253 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:47:10.501253 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:47:10.501253 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:47:10.501253 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:47:10.501253 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:47:10.501253 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:47:10.501253 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 10:47:10.501253 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:47:10.501253 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 643/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Aug 11 10:47:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:47:10.507240 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca28371-3995-4b02-bc83-7f15ab75c898 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:10.608633 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca28371-3995-4b02-bc83-7f15ab75c898 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:10.642284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b6dd4-9b4e-48ab-883b-0cc86779e9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:10.642968 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b6dd4-9b4e-48ab-883b-0cc86779e9bf None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:10.643252 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b6dd4-9b4e-48ab-883b-0cc86779e9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:10.643525 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b6dd4-9b4e-48ab-883b-0cc86779e9bf None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:10.644153 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b6dd4-9b4e-48ab-883b-0cc86779e9bf None admin] RBAC: Adding query filter params (name=placement) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:47:10.644453 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b6dd4-9b4e-48ab-883b-0cc86779e9bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:10.645818 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b6dd4-9b4e-48ab-883b-0cc86779e9bf None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:10.651213 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 648/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Aug 11 10:47:10 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:47:10.657202 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded9201-b8bb-4eb8-9feb-aa54c4934b48 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:10.755765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded9201-b8bb-4eb8-9feb-aa54c4934b48 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:10.789222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99189422-bc5b-4cd8-bd49-6c52ef6a38d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:10.789821 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99189422-bc5b-4cd8-bd49-6c52ef6a38d6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:10.790102 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99189422-bc5b-4cd8-bd49-6c52ef6a38d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:10.790376 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99189422-bc5b-4cd8-bd49-6c52ef6a38d6 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:10.791022 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99189422-bc5b-4cd8-bd49-6c52ef6a38d6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:47:10.791327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99189422-bc5b-4cd8-bd49-6c52ef6a38d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:10.792694 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99189422-bc5b-4cd8-bd49-6c52ef6a38d6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:10.796984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 644/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Aug 11 10:47:10 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:47:12.814381 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03df17-1690-47fd-b063-80174bd9436b None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:12.814946 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03df17-1690-47fd-b063-80174bd9436b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:12.814946 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03df17-1690-47fd-b063-80174bd9436b None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:12.816289 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 649/1293] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:47:12.821856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaa285-d371-43fe-9c71-cedb6065ebdb None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:12.824404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaa285-d371-43fe-9c71-cedb6065ebdb None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:12.824404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcaa285-d371-43fe-9c71-cedb6065ebdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:12.840425 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9bcaa285-d371-43fe-9c71-cedb6065ebdb None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:47:12.841602 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9bcaa285-d371-43fe-9c71-cedb6065ebdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:47:12.871542 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:12.909542 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 645/1294] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:47:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:47:12.932617 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03df17-1690-47fd-b063-80174bd9436b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:12.963724 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:13.032327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03df17-1690-47fd-b063-80174bd9436b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:13.064931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d05a2-4e02-425e-97ca-c898ff1355ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:13.065471 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d05a2-4e02-425e-97ca-c898ff1355ac None admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:13.065750 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d05a2-4e02-425e-97ca-c898ff1355ac None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:13.066018 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d05a2-4e02-425e-97ca-c898ff1355ac None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:13.066657 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d05a2-4e02-425e-97ca-c898ff1355ac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:13.068071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d05a2-4e02-425e-97ca-c898ff1355ac None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:13.153844 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 650/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Aug 11 10:47:12 2022] POST /identity/v3/services => generated 246 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:47:15.166590 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c3fa9-e02a-4e0e-8996-367a44534e53 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:15.167163 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c3fa9-e02a-4e0e-8996-367a44534e53 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:15.167277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c3fa9-e02a-4e0e-8996-367a44534e53 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:15.168648 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 646/1296] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:47:15.174074 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f9342-03e7-4aef-be55-5ee5d715342d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:15.174449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f9342-03e7-4aef-be55-5ee5d715342d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:15.178089 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f9342-03e7-4aef-be55-5ee5d715342d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:15.192539 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e26f9342-03e7-4aef-be55-5ee5d715342d None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:47:15.194348 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e26f9342-03e7-4aef-be55-5ee5d715342d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:47:15.266491 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 651/1297] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:47:15 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:47:15.290261 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c3fa9-e02a-4e0e-8996-367a44534e53 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:15.390663 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c3fa9-e02a-4e0e-8996-367a44534e53 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:15.424663 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62773a-1bb0-429a-a942-dfa60e284a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:15.425281 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62773a-1bb0-429a-a942-dfa60e284a16 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:15.425556 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62773a-1bb0-429a-a942-dfa60e284a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:15.425845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62773a-1bb0-429a-a942-dfa60e284a16 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:15.426399 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62773a-1bb0-429a-a942-dfa60e284a16 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:15.427772 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62773a-1bb0-429a-a942-dfa60e284a16 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:15.436545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-bc62773a-1bb0-429a-a942-dfa60e284a16 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 10:47:15.436545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:47:15.436545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:47:15.436545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:47:15.436545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:47:15.436545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:47:15.436545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:47:15.436545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:47:15.436545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 10:47:15.436545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:47:15.436545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:47:15.436545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:47:15.436545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:47:15.436545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:47:15.436545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:47:15.436545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:47:15.436545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:47:15.437658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:47:15.437658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:47:15.437658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:47:15.437658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:47:15.437658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:47:15.437658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:47:15.437658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:47:15.437658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:47:15.437658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:47:15.437658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:47:15.437658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:47:15.437658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:47:15.437658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:47:15.437658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:47:15.437658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:47:15.437658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:47:15.438830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:47:15.438830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:47:15.438830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:47:15.438830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:47:15.438830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:47:15.438830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:47:15.438830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:47:15.438830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:47:15.438830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:47:15.438830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:47:15.438830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:47:15.438830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:47:15.438830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 10:47:15.438830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:47:15.438830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 647/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Aug 11 10:47:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:47:15.443657 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f9342-03e7-4aef-be55-5ee5d715342d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:15.462145 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:15.539590 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f9342-03e7-4aef-be55-5ee5d715342d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:15.573976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c8f47-8b42-413a-98f5-6178b041a489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:15.574509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c8f47-8b42-413a-98f5-6178b041a489 None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:15.574809 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c8f47-8b42-413a-98f5-6178b041a489 None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:15.575109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c8f47-8b42-413a-98f5-6178b041a489 None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:15.575733 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c8f47-8b42-413a-98f5-6178b041a489 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:47:15.576048 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c8f47-8b42-413a-98f5-6178b041a489 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:15.577411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c8f47-8b42-413a-98f5-6178b041a489 None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:15.582232 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 652/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Aug 11 10:47:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:47:15.588540 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62773a-1bb0-429a-a942-dfa60e284a16 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:15.620721 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:15.689449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62773a-1bb0-429a-a942-dfa60e284a16 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:15.722442 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42fd98-1210-4992-89dd-ebd97d49a1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:15.723065 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42fd98-1210-4992-89dd-ebd97d49a1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:15.723346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42fd98-1210-4992-89dd-ebd97d49a1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:15.723622 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42fd98-1210-4992-89dd-ebd97d49a1a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:15.724306 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42fd98-1210-4992-89dd-ebd97d49a1a5 None admin] RBAC: Adding query filter params (interface=public, service_id=0985b17ef1cb4427b952634efa372738, region_id=RegionOne) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:47:15.724609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42fd98-1210-4992-89dd-ebd97d49a1a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:15.726475 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42fd98-1210-4992-89dd-ebd97d49a1a5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:15.731876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 648/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Aug 11 10:47:15 2022] GET /identity/v3/endpoints?service_id=0985b17ef1cb4427b952634efa372738&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:47:15.737697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c8f47-8b42-413a-98f5-6178b041a489 None admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:15.817037 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:15.834227 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c8f47-8b42-413a-98f5-6178b041a489 None admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:15.866205 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3bdd9-605e-4f3c-aa01-4dbc112c56ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:15.866822 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3bdd9-605e-4f3c-aa01-4dbc112c56ea None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:15.867100 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3bdd9-605e-4f3c-aa01-4dbc112c56ea None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:15.867431 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3bdd9-605e-4f3c-aa01-4dbc112c56ea None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:15.868031 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3bdd9-605e-4f3c-aa01-4dbc112c56ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:15.869410 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3bdd9-605e-4f3c-aa01-4dbc112c56ea None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:15.876211 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 653/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Aug 11 10:47:15 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:47:17.921692 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ddd5a-34fd-4906-8b2c-0f5e379c05c1 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:17.922279 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ddd5a-34fd-4906-8b2c-0f5e379c05c1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:17.922397 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ddd5a-34fd-4906-8b2c-0f5e379c05c1 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:17.923738 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 649/1302] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:47:17.929077 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b369e-04a6-4795-bc16-28e610044e82 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:17.929504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b369e-04a6-4795-bc16-28e610044e82 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:17.929629 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b369e-04a6-4795-bc16-28e610044e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:17.948246 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-8d4b369e-04a6-4795-bc16-28e610044e82 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:47:17.949420 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8d4b369e-04a6-4795-bc16-28e610044e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:47:18.015747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 654/1303] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:47:17 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 11 10:47:18.040105 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ddd5a-34fd-4906-8b2c-0f5e379c05c1 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:18.132916 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:18.139742 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ddd5a-34fd-4906-8b2c-0f5e379c05c1 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:18.173466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3abad-852f-442f-b846-888eac6784aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:18.174204 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3abad-852f-442f-b846-888eac6784aa None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:18.174671 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3abad-852f-442f-b846-888eac6784aa None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:18.175292 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3abad-852f-442f-b846-888eac6784aa None admin] PATH_INFO: `/v3/services/placement` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:18.175928 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3abad-852f-442f-b846-888eac6784aa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:18.177320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3abad-852f-442f-b846-888eac6784aa None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:18.186168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ecd3abad-852f-442f-b846-888eac6784aa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 10:47:18.186168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:47:18.186168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 11 10:47:18.186168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 11 10:47:18.186168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 11 10:47:18.186168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 11 10:47:18.186168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 11 10:47:18.186168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:47:18.186168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 10:47:18.186168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:47:18.186168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 11 10:47:18.186168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:47:18.186168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 11 10:47:18.186168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 11 10:47:18.186168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 11 10:47:18.186168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 11 10:47:18.186168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 11 10:47:18.187518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 11 10:47:18.187518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 11 10:47:18.187518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 11 10:47:18.187518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 11 10:47:18.187518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 11 10:47:18.187518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 11 10:47:18.187518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 11 10:47:18.187518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 11 10:47:18.187518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 11 10:47:18.187518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 11 10:47:18.187518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 11 10:47:18.187518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 11 10:47:18.187518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 11 10:47:18.187518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 11 10:47:18.187518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 11 10:47:18.187518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 11 10:47:18.188700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 11 10:47:18.188700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 11 10:47:18.188700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 11 10:47:18.188700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 11 10:47:18.188700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 11 10:47:18.188700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 11 10:47:18.188700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 11 10:47:18.188700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 11 10:47:18.188700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 11 10:47:18.188700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 11 10:47:18.188700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 11 10:47:18.188700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 11 10:47:18.188700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 11 10:47:18.188700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 11 10:47:18.188700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 650/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Aug 11 10:47:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 11 10:47:18.193960 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b369e-04a6-4795-bc16-28e610044e82 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:18.268336 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:18.290375 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b369e-04a6-4795-bc16-28e610044e82 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:18.323624 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce51b2f-8083-43f2-bad6-ac0fb179482f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:18.324227 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce51b2f-8083-43f2-bad6-ac0fb179482f None admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:18.324504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce51b2f-8083-43f2-bad6-ac0fb179482f None admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:18.324774 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce51b2f-8083-43f2-bad6-ac0fb179482f None admin] PATH_INFO: `/v3/services` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:18.325392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce51b2f-8083-43f2-bad6-ac0fb179482f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 10:47:18.325692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce51b2f-8083-43f2-bad6-ac0fb179482f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:18.327072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce51b2f-8083-43f2-bad6-ac0fb179482f None admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:18.331960 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 655/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Aug 11 10:47:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 10:47:18.338196 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3abad-852f-442f-b846-888eac6784aa None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:47:18.434524 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3abad-852f-442f-b846-888eac6784aa None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:47:18.466436 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf28ce-3237-406c-bf50-e361f5f42982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:47:18.467050 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf28ce-3237-406c-bf50-e361f5f42982 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:47:18.467330 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf28ce-3237-406c-bf50-e361f5f42982 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:47:18.467602 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf28ce-3237-406c-bf50-e361f5f42982 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:47:18.468246 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf28ce-3237-406c-bf50-e361f5f42982 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:47:18.469590 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf28ce-3237-406c-bf50-e361f5f42982 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:47:18.586112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 651/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 10:47:18 2022] POST /identity/v3/endpoints => generated 331 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 10:47:28.363361 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=30 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:47:28.581679 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:01.862298 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6e53b-bd84-4780-aa20-915151382ae0 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:01.863476 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6e53b-bd84-4780-aa20-915151382ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:01.863901 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6e53b-bd84-4780-aa20-915151382ae0 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:01.870751 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e55838-06e8-4f8c-a1eb-07420811a112 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:01.871568 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e55838-06e8-4f8c-a1eb-07420811a112 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:01.871992 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e55838-06e8-4f8c-a1eb-07420811a112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:01.876863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 656/1307] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:55:01 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:55:02.009341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-45e55838-06e8-4f8c-a1eb-07420811a112 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:55:02.015625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-45e55838-06e8-4f8c-a1eb-07420811a112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:02.214840 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 652/1308] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:55:02.259886 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdf111-5bed-4544-b1d7-a256fc99d47d None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:02.260173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdf111-5bed-4544-b1d7-a256fc99d47d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:02.260697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdf111-5bed-4544-b1d7-a256fc99d47d None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:02.262056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 657/1309] 10.222.0.43 () {54 vars in 965 bytes} [Thu Aug 11 10:55:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:55:02.268147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbf675-b07b-4713-b06c-d8a0b1878782 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:02.268507 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbf675-b07b-4713-b06c-d8a0b1878782 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:02.268853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbf675-b07b-4713-b06c-d8a0b1878782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:02.348139 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-40fbf675-b07b-4713-b06c-d8a0b1878782 None None] MFA Rules not processed for user `6302b1f98544470a8986055a68bcd948`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:55:02.349345 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-40fbf675-b07b-4713-b06c-d8a0b1878782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:02.371540 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:02.429169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 653/1310] 10.222.0.43 () {58 vars in 1062 bytes} [Thu Aug 11 10:55:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:55:02.438258 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdf111-5bed-4544-b1d7-a256fc99d47d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:55:02.440247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-44bdf111-5bed-4544-b1d7-a256fc99d47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:02.565251 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdf111-5bed-4544-b1d7-a256fc99d47d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:55:02.649028 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623844c8-cb6a-4212-83b6-f49092ec5141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:55:02.649733 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623844c8-cb6a-4212-83b6-f49092ec5141 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:02.650082 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623844c8-cb6a-4212-83b6-f49092ec5141 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:02.650420 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623844c8-cb6a-4212-83b6-f49092ec5141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:02.652254 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-623844c8-cb6a-4212-83b6-f49092ec5141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:02.710722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:02.768947 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623844c8-cb6a-4212-83b6-f49092ec5141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:55:02.770637 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623844c8-cb6a-4212-83b6-f49092ec5141 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:55:02.791608 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 658/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:55:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:55:05.120554 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df5bd4-b836-4224-ad1d-25290ead693d None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:05.121106 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df5bd4-b836-4224-ad1d-25290ead693d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:05.121106 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df5bd4-b836-4224-ad1d-25290ead693d None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:05.122641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 654/1312] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:55:05.127610 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c3dc5-6cbf-4540-8a69-fbcece8feb80 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:05.128009 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c3dc5-6cbf-4540-8a69-fbcece8feb80 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:05.128231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c3dc5-6cbf-4540-8a69-fbcece8feb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:05.212596 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4a7c3dc5-6cbf-4540-8a69-fbcece8feb80 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:55:05.213840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4a7c3dc5-6cbf-4540-8a69-fbcece8feb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:05.334491 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 659/1313] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:55:05.373960 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df5bd4-b836-4224-ad1d-25290ead693d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:55:05.375576 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-88df5bd4-b836-4224-ad1d-25290ead693d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:05.479210 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df5bd4-b836-4224-ad1d-25290ead693d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:55:05.550811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:05.553375 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6159c5-54be-412b-8e57-f3780113cf56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:55:05.553990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6159c5-54be-412b-8e57-f3780113cf56 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:05.554270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6159c5-54be-412b-8e57-f3780113cf56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:05.554584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6159c5-54be-412b-8e57-f3780113cf56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:05.556202 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bd6159c5-54be-412b-8e57-f3780113cf56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:05.663629 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6159c5-54be-412b-8e57-f3780113cf56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:55:05.665825 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6159c5-54be-412b-8e57-f3780113cf56 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:55:05.685211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 655/1314] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:55:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:55:08.224574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcba3d-3cae-4890-b00f-639a52e78fec None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:08.225127 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcba3d-3cae-4890-b00f-639a52e78fec None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:08.225127 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcba3d-3cae-4890-b00f-639a52e78fec None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:08.226485 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 660/1315] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:55:08.231884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f51495-5aad-4342-8e9d-46a427d7bb82 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:08.232275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f51495-5aad-4342-8e9d-46a427d7bb82 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:08.232437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f51495-5aad-4342-8e9d-46a427d7bb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:08.296658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-87f51495-5aad-4342-8e9d-46a427d7bb82 None None] MFA Rules not processed for user `d2ada0c204a84a70b855ffcb0dbe36d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:55:08.297894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-87f51495-5aad-4342-8e9d-46a427d7bb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:08.347663 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:08.392022 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 656/1316] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:55:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:55:08.432492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcba3d-3cae-4890-b00f-639a52e78fec None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:55:08.434007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-cfbcba3d-3cae-4890-b00f-639a52e78fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:08.443692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:08.534471 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcba3d-3cae-4890-b00f-639a52e78fec None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:55:08.606226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5e53d-8d10-4df6-9951-419a0ff5681e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:55:08.606854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5e53d-8d10-4df6-9951-419a0ff5681e service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:08.607135 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5e53d-8d10-4df6-9951-419a0ff5681e service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:08.607401 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5e53d-8d10-4df6-9951-419a0ff5681e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:08.608987 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9dd5e53d-8d10-4df6-9951-419a0ff5681e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:08.669957 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:08.715931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5e53d-8d10-4df6-9951-419a0ff5681e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:55:08.717357 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5e53d-8d10-4df6-9951-419a0ff5681e service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:55:08.734411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 661/1317] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:55:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:55:11.543642 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39c140-e604-44c9-bb1f-211b97b6ec77 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:11.544175 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39c140-e604-44c9-bb1f-211b97b6ec77 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:11.544175 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39c140-e604-44c9-bb1f-211b97b6ec77 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:11.545557 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 657/1318] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:55:11.550673 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954cfa3-a3ec-427f-80a6-47c787d773c4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:11.551105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954cfa3-a3ec-427f-80a6-47c787d773c4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:11.551282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954cfa3-a3ec-427f-80a6-47c787d773c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:11.615319 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e954cfa3-a3ec-427f-80a6-47c787d773c4 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:55:11.616514 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e954cfa3-a3ec-427f-80a6-47c787d773c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:11.708882 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 662/1319] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:55:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:55:11.748139 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39c140-e604-44c9-bb1f-211b97b6ec77 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:55:11.749664 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ca39c140-e604-44c9-bb1f-211b97b6ec77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:11.849671 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39c140-e604-44c9-bb1f-211b97b6ec77 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:55:11.920761 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda4091-b4a1-47d8-9bf3-341b43a5e1fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:55:11.921354 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda4091-b4a1-47d8-9bf3-341b43a5e1fe service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:11.921630 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda4091-b4a1-47d8-9bf3-341b43a5e1fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:11.921898 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda4091-b4a1-47d8-9bf3-341b43a5e1fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:11.923500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8eda4091-b4a1-47d8-9bf3-341b43a5e1fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:11.931253 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:12.032924 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda4091-b4a1-47d8-9bf3-341b43a5e1fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:55:12.034363 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eda4091-b4a1-47d8-9bf3-341b43a5e1fe service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:55:12.053212 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 658/1320] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:55:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:55:15.096759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb1e07-e048-4860-8d1b-309824e800c1 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:15.097283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb1e07-e048-4860-8d1b-309824e800c1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:15.097283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb1e07-e048-4860-8d1b-309824e800c1 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:15.098644 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 663/1321] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:55:15.104493 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162801e-0115-4478-aec3-1f3e64b8f609 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:15.104913 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162801e-0115-4478-aec3-1f3e64b8f609 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:15.105067 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162801e-0115-4478-aec3-1f3e64b8f609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:15.174642 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d162801e-0115-4478-aec3-1f3e64b8f609 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:55:15.175886 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d162801e-0115-4478-aec3-1f3e64b8f609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:15.354471 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:15.393383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 659/1322] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:55:15.430559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb1e07-e048-4860-8d1b-309824e800c1 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:55:15.432170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8bdb1e07-e048-4860-8d1b-309824e800c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:15.451280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:15.544572 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb1e07-e048-4860-8d1b-309824e800c1 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:55:15.624536 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a98573-4400-4cda-8e4a-fe47da81efd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:55:15.625069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a98573-4400-4cda-8e4a-fe47da81efd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:15.625350 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a98573-4400-4cda-8e4a-fe47da81efd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:15.625620 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a98573-4400-4cda-8e4a-fe47da81efd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:15.627298 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e9a98573-4400-4cda-8e4a-fe47da81efd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:15.704501 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:15.742874 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a98573-4400-4cda-8e4a-fe47da81efd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:55:15.744326 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a98573-4400-4cda-8e4a-fe47da81efd5 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:55:15.763774 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 664/1323] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:55:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:55:17.826116 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd74416-c350-44a0-8bd8-18ff62db8791 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:17.826676 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd74416-c350-44a0-8bd8-18ff62db8791 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:17.826676 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd74416-c350-44a0-8bd8-18ff62db8791 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:17.828014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 660/1324] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:55:17.833248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c46cc-7b91-4594-aad5-2ae8251aa984 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:17.833688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c46cc-7b91-4594-aad5-2ae8251aa984 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:17.833948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c46cc-7b91-4594-aad5-2ae8251aa984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:17.911168 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0c4c46cc-7b91-4594-aad5-2ae8251aa984 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:55:17.912495 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0c4c46cc-7b91-4594-aad5-2ae8251aa984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:18.011099 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 665/1325] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:55:18.047861 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd74416-c350-44a0-8bd8-18ff62db8791 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:55:18.049382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5bd74416-c350-44a0-8bd8-18ff62db8791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:18.154045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd74416-c350-44a0-8bd8-18ff62db8791 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:55:18.227226 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a483c-3997-4232-a9eb-ddf40c97656f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:55:18.227826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a483c-3997-4232-a9eb-ddf40c97656f service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:18.228098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a483c-3997-4232-a9eb-ddf40c97656f service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:18.228361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a483c-3997-4232-a9eb-ddf40c97656f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:18.229954 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c04a483c-3997-4232-a9eb-ddf40c97656f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:18.247001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:18.339284 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a483c-3997-4232-a9eb-ddf40c97656f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:55:18.340741 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a483c-3997-4232-a9eb-ddf40c97656f service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:55:18.360617 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 661/1326] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:55:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:55:20.429579 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247231e-c7e6-4e54-b9d1-032388fb1af0 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:20.430188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247231e-c7e6-4e54-b9d1-032388fb1af0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:20.430188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247231e-c7e6-4e54-b9d1-032388fb1af0 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:20.431620 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 666/1327] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:55:20.436536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2ea5e-cc9e-49ac-a471-73f2253a4f33 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:20.436933 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2ea5e-cc9e-49ac-a471-73f2253a4f33 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:20.437201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2ea5e-cc9e-49ac-a471-73f2253a4f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:20.505153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-36d2ea5e-cc9e-49ac-a471-73f2253a4f33 None None] MFA Rules not processed for user `d2ada0c204a84a70b855ffcb0dbe36d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:55:20.506342 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-36d2ea5e-cc9e-49ac-a471-73f2253a4f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:20.571189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:20.603150 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 662/1328] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:55:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:55:20.642708 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247231e-c7e6-4e54-b9d1-032388fb1af0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:55:20.644339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a247231e-c7e6-4e54-b9d1-032388fb1af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:20.674255 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:20.746060 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247231e-c7e6-4e54-b9d1-032388fb1af0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:55:20.821650 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ceb00-169f-4454-a834-70e4a8657c23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:55:20.822253 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ceb00-169f-4454-a834-70e4a8657c23 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:20.822527 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ceb00-169f-4454-a834-70e4a8657c23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:20.822841 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ceb00-169f-4454-a834-70e4a8657c23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:20.824402 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-be0ceb00-169f-4454-a834-70e4a8657c23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:20.903667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:20.936413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ceb00-169f-4454-a834-70e4a8657c23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:55:20.937848 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ceb00-169f-4454-a834-70e4a8657c23 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:55:20.955542 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 667/1329] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:55:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:55:23.452510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874b34b-7551-4a43-a513-2c5b2755194e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:23.453093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874b34b-7551-4a43-a513-2c5b2755194e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:23.453093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874b34b-7551-4a43-a513-2c5b2755194e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:23.454384 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 663/1330] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:55:23.459533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cd517-20e2-4982-ac72-379f2ce0979e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:23.460618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cd517-20e2-4982-ac72-379f2ce0979e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:23.460978 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850cd517-20e2-4982-ac72-379f2ce0979e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:23.528901 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-850cd517-20e2-4982-ac72-379f2ce0979e None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:55:23.537403 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-850cd517-20e2-4982-ac72-379f2ce0979e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:23.624563 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 668/1331] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:55:23.661453 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874b34b-7551-4a43-a513-2c5b2755194e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:55:23.663081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a874b34b-7551-4a43-a513-2c5b2755194e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:23.765994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874b34b-7551-4a43-a513-2c5b2755194e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:55:23.837727 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c3117-8f2f-461a-9e1c-87badc3b1e7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:55:23.838264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c3117-8f2f-461a-9e1c-87badc3b1e7e service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:23.838538 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c3117-8f2f-461a-9e1c-87badc3b1e7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:23.838842 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c3117-8f2f-461a-9e1c-87badc3b1e7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:23.840403 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-801c3117-8f2f-461a-9e1c-87badc3b1e7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:23.867774 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:23.948745 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c3117-8f2f-461a-9e1c-87badc3b1e7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:55:23.950179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c3117-8f2f-461a-9e1c-87badc3b1e7e service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:55:23.968227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 664/1332] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:55:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:55:26.011831 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249db007-e2ba-4bfe-a8c5-0475cd808743 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:26.012375 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249db007-e2ba-4bfe-a8c5-0475cd808743 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:26.012375 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249db007-e2ba-4bfe-a8c5-0475cd808743 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:26.013726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 669/1333] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:55:26.018784 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea2d9d-71d6-4b4b-a676-97c3e3133501 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:26.019232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea2d9d-71d6-4b4b-a676-97c3e3133501 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:26.019358 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea2d9d-71d6-4b4b-a676-97c3e3133501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:26.086220 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b6ea2d9d-71d6-4b4b-a676-97c3e3133501 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:55:26.087440 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b6ea2d9d-71d6-4b4b-a676-97c3e3133501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:26.163972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:26.186576 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 665/1334] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:55:26.226747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249db007-e2ba-4bfe-a8c5-0475cd808743 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:55:26.228314 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-249db007-e2ba-4bfe-a8c5-0475cd808743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:26.267531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:26.329647 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249db007-e2ba-4bfe-a8c5-0475cd808743 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:55:26.405542 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e2be8-8378-4071-9e2f-e0f99584bcc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:55:26.406152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e2be8-8378-4071-9e2f-e0f99584bcc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:26.406429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e2be8-8378-4071-9e2f-e0f99584bcc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:26.406698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e2be8-8378-4071-9e2f-e0f99584bcc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:26.408321 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f45e2be8-8378-4071-9e2f-e0f99584bcc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:26.492493 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:26.517616 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e2be8-8378-4071-9e2f-e0f99584bcc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:55:26.519492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e2be8-8378-4071-9e2f-e0f99584bcc2 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:55:26.537728 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 670/1335] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:55:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:55:29.275700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c4be5-0c16-458d-97ab-38abd664b45e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:29.276366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c4be5-0c16-458d-97ab-38abd664b45e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:29.276366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c4be5-0c16-458d-97ab-38abd664b45e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:29.277588 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 666/1336] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:55:29.282688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb09a1b-4f54-4946-b0eb-419c44af1679 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:29.283123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb09a1b-4f54-4946-b0eb-419c44af1679 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:29.283273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb09a1b-4f54-4946-b0eb-419c44af1679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:29.347812 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-afb09a1b-4f54-4946-b0eb-419c44af1679 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:55:29.349019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-afb09a1b-4f54-4946-b0eb-419c44af1679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:29.444995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 671/1337] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:55:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:55:29.497257 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d7d8b-6033-467f-ab2e-9fa8f4f10785 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:29.497535 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d7d8b-6033-467f-ab2e-9fa8f4f10785 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:29.497807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d7d8b-6033-467f-ab2e-9fa8f4f10785 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:29.499186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 667/1338] 10.222.0.43 () {54 vars in 965 bytes} [Thu Aug 11 10:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:55:29.505036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8256b-01a7-411c-84c9-c98a4c2e103b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:29.505325 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8256b-01a7-411c-84c9-c98a4c2e103b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:29.505601 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8256b-01a7-411c-84c9-c98a4c2e103b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:29.560309 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:29.581352 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-38c8256b-01a7-411c-84c9-c98a4c2e103b None None] MFA Rules not processed for user `6302b1f98544470a8986055a68bcd948`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:55:29.582556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-38c8256b-01a7-411c-84c9-c98a4c2e103b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:29.658493 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 672/1339] 10.222.0.43 () {58 vars in 1062 bytes} [Thu Aug 11 10:55:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:55:29.668273 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d7d8b-6033-467f-ab2e-9fa8f4f10785 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:55:29.669785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-aa4d7d8b-6033-467f-ab2e-9fa8f4f10785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:29.772461 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d7d8b-6033-467f-ab2e-9fa8f4f10785 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:55:29.845381 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab569c-c26f-471c-a68e-e74566e54839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:55:29.845988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab569c-c26f-471c-a68e-e74566e54839 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:29.846305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab569c-c26f-471c-a68e-e74566e54839 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:29.846579 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab569c-c26f-471c-a68e-e74566e54839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:29.848237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-52ab569c-c26f-471c-a68e-e74566e54839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:29.884620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:29.958649 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab569c-c26f-471c-a68e-e74566e54839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:55:29.961168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab569c-c26f-471c-a68e-e74566e54839 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:55:29.979835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 668/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:55:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:55:34.798904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0ce6a-614c-4087-9783-d2bd994007d5 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:34.799468 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0ce6a-614c-4087-9783-d2bd994007d5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:34.799468 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0ce6a-614c-4087-9783-d2bd994007d5 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:34.800790 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 673/1341] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:55:34.806604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d88401-0744-4918-8a39-7aba5447e212 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:34.807030 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d88401-0744-4918-8a39-7aba5447e212 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:34.807182 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d88401-0744-4918-8a39-7aba5447e212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:34.874841 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-90d88401-0744-4918-8a39-7aba5447e212 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:55:34.876049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-90d88401-0744-4918-8a39-7aba5447e212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:34.972212 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:34.975787 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 669/1342] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:55:35.014522 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0ce6a-614c-4087-9783-d2bd994007d5 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:55:35.016213 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-48d0ce6a-614c-4087-9783-d2bd994007d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:35.130583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0ce6a-614c-4087-9783-d2bd994007d5 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:55:35.169377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:35.207436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b77f0-8d00-437a-a252-ba8cfd1e03cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:55:35.208053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b77f0-8d00-437a-a252-ba8cfd1e03cb service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:35.208374 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b77f0-8d00-437a-a252-ba8cfd1e03cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:35.208647 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b77f0-8d00-437a-a252-ba8cfd1e03cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:35.210551 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7a5b77f0-8d00-437a-a252-ba8cfd1e03cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:35.319782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b77f0-8d00-437a-a252-ba8cfd1e03cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:55:35.321231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b77f0-8d00-437a-a252-ba8cfd1e03cb service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:55:35.339447 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 674/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:55:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:55:38.414812 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c2c84-ba11-432b-9d42-ffaf7a8cf7b0 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:38.415344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c2c84-ba11-432b-9d42-ffaf7a8cf7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:38.415344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c2c84-ba11-432b-9d42-ffaf7a8cf7b0 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:38.416620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 670/1344] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:55:38.421735 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff306ea-58d5-4cfd-89b9-8198aafe1cc0 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:38.422160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff306ea-58d5-4cfd-89b9-8198aafe1cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:38.422323 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff306ea-58d5-4cfd-89b9-8198aafe1cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:38.488902 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-6ff306ea-58d5-4cfd-89b9-8198aafe1cc0 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:55:38.490109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6ff306ea-58d5-4cfd-89b9-8198aafe1cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:38.510129 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:38.590599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 675/1345] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:55:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:55:38.628703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c2c84-ba11-432b-9d42-ffaf7a8cf7b0 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:55:38.630217 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-202c2c84-ba11-432b-9d42-ffaf7a8cf7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:38.733499 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c2c84-ba11-432b-9d42-ffaf7a8cf7b0 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:55:38.812288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426fac7-fa15-411e-aa59-3229f9f8a984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:55:38.812898 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426fac7-fa15-411e-aa59-3229f9f8a984 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:38.813178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426fac7-fa15-411e-aa59-3229f9f8a984 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:38.813449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426fac7-fa15-411e-aa59-3229f9f8a984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:38.815049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d426fac7-fa15-411e-aa59-3229f9f8a984 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:38.857867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:38.925837 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426fac7-fa15-411e-aa59-3229f9f8a984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:55:38.927378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426fac7-fa15-411e-aa59-3229f9f8a984 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:55:38.946379 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 671/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:55:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:55:43.277076 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7611a8-5499-40e7-803b-6199f760f73f None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:43.277590 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7611a8-5499-40e7-803b-6199f760f73f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:43.277697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7611a8-5499-40e7-803b-6199f760f73f None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:43.279156 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 676/1347] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:55:43.284413 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdab74-660c-425e-971b-d56839375ec9 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:43.284846 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdab74-660c-425e-971b-d56839375ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:43.284953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdab74-660c-425e-971b-d56839375ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:43.361825 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-72bdab74-660c-425e-971b-d56839375ec9 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:55:43.363140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-72bdab74-660c-425e-971b-d56839375ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:43.476037 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:43.478799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 672/1348] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:55:43.519883 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7611a8-5499-40e7-803b-6199f760f73f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:55:43.520281 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9e7611a8-5499-40e7-803b-6199f760f73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:43.643108 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7611a8-5499-40e7-803b-6199f760f73f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:55:43.696184 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:43.725728 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6809ef-7bfe-43a8-829f-2b38f2dd43ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:55:43.726357 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6809ef-7bfe-43a8-829f-2b38f2dd43ee service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:43.726582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6809ef-7bfe-43a8-829f-2b38f2dd43ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:43.726918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6809ef-7bfe-43a8-829f-2b38f2dd43ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:43.728566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5f6809ef-7bfe-43a8-829f-2b38f2dd43ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:43.843583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6809ef-7bfe-43a8-829f-2b38f2dd43ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:55:43.845038 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6809ef-7bfe-43a8-829f-2b38f2dd43ee service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:55:43.865493 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 677/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:55:48.768352 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7828668-50dc-4bd8-99b9-997c2f97c64f None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:48.768771 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7828668-50dc-4bd8-99b9-997c2f97c64f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:48.769649 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7828668-50dc-4bd8-99b9-997c2f97c64f None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:48.771355 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 673/1350] 10.222.0.43 () {54 vars in 921 bytes} [Thu Aug 11 10:55:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:55:48.776678 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036bc9e-9ee1-44dd-8345-b0d263c11b47 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:48.777069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036bc9e-9ee1-44dd-8345-b0d263c11b47 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:48.777558 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036bc9e-9ee1-44dd-8345-b0d263c11b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:48.871850 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e036bc9e-9ee1-44dd-8345-b0d263c11b47 None None] MFA Rules not processed for user `4db99589bb504e8fa4068925badf3942`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:55:48.873303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e036bc9e-9ee1-44dd-8345-b0d263c11b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:48.895034 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:49.032780 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 678/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Aug 11 10:55:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:55:53.115673 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac784596-78d8-411b-b39c-73b196047295 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:53.116570 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac784596-78d8-411b-b39c-73b196047295 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:53.116988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac784596-78d8-411b-b39c-73b196047295 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:53.118776 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 674/1352] 10.222.0.43 () {54 vars in 921 bytes} [Thu Aug 11 10:55:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:55:53.124031 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36074e-9d35-4c09-8ba0-a4f3453d0a23 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:53.124819 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36074e-9d35-4c09-8ba0-a4f3453d0a23 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:53.125252 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36074e-9d35-4c09-8ba0-a4f3453d0a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:53.203204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ba36074e-9d35-4c09-8ba0-a4f3453d0a23 None None] MFA Rules not processed for user `4db99589bb504e8fa4068925badf3942`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:55:53.204393 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ba36074e-9d35-4c09-8ba0-a4f3453d0a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:53.277749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:53.315164 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 679/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Aug 11 10:55:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:55:54.829794 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd38cf-c981-42bc-84a1-cc29d655bc65 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:54.830348 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd38cf-c981-42bc-84a1-cc29d655bc65 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:54.830678 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd38cf-c981-42bc-84a1-cc29d655bc65 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:54.832213 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 675/1354] 10.222.0.43 () {54 vars in 921 bytes} [Thu Aug 11 10:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:55:54.838250 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb5a08-fe62-4c41-963d-6196c3c9e02a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:54.838694 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb5a08-fe62-4c41-963d-6196c3c9e02a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:54.838870 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb5a08-fe62-4c41-963d-6196c3c9e02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:54.916692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5bbb5a08-fe62-4c41-963d-6196c3c9e02a None None] MFA Rules not processed for user `4db99589bb504e8fa4068925badf3942`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:55:54.917901 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5bbb5a08-fe62-4c41-963d-6196c3c9e02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:55.023835 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 680/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Aug 11 10:55:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:55:58.476296 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8381a0-2d6c-4b4f-99e3-8452c564cb4f None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:58.477147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8381a0-2d6c-4b4f-99e3-8452c564cb4f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:58.477590 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8381a0-2d6c-4b4f-99e3-8452c564cb4f None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:58.479129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 676/1356] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:55:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:55:58.485216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9f179-b306-41d7-a40c-c5d259794006 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:58.486175 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9f179-b306-41d7-a40c-c5d259794006 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:58.486735 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9f179-b306-41d7-a40c-c5d259794006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:58.532247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:58.567655 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4dc9f179-b306-41d7-a40c-c5d259794006 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:55:58.569711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4dc9f179-b306-41d7-a40c-c5d259794006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:58.684953 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 681/1357] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:55:58.742144 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dfedb-168b-420e-8e5f-f99e68b085e6 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:58.745943 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dfedb-168b-420e-8e5f-f99e68b085e6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:58.745943 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dfedb-168b-420e-8e5f-f99e68b085e6 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:58.745943 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 677/1358] 10.222.0.43 () {54 vars in 962 bytes} [Thu Aug 11 10:55:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:55:58.754024 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3192b-4740-4402-b0c1-c547be7174d3 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:58.754502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3192b-4740-4402-b0c1-c547be7174d3 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:58.755168 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3192b-4740-4402-b0c1-c547be7174d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:58.840869 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1bf3192b-4740-4402-b0c1-c547be7174d3 None None] MFA Rules not processed for user `9267752ac6724013bc1edcdecff48dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:55:58.842184 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1bf3192b-4740-4402-b0c1-c547be7174d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:58.898135 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:59.004600 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 682/1359] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Aug 11 10:55:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:55:59.004856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dfedb-168b-420e-8e5f-f99e68b085e6 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:55:59.004856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-627dfedb-168b-420e-8e5f-f99e68b085e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:59.142276 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dfedb-168b-420e-8e5f-f99e68b085e6 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:55:59.221156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:59.262845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d162140-e402-489a-8a8d-72754cf8e171 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:55:59.263483 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d162140-e402-489a-8a8d-72754cf8e171 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:55:59.263767 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d162140-e402-489a-8a8d-72754cf8e171 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:55:59.264038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d162140-e402-489a-8a8d-72754cf8e171 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:55:59.265618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7d162140-e402-489a-8a8d-72754cf8e171 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:55:59.366565 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d162140-e402-489a-8a8d-72754cf8e171 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:55:59.368283 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d162140-e402-489a-8a8d-72754cf8e171 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:55:59.387704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 678/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:55:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:56:01.640649 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585de251-4726-40f5-b044-6fa8bb9a7858 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:01.641107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585de251-4726-40f5-b044-6fa8bb9a7858 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:01.641226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585de251-4726-40f5-b044-6fa8bb9a7858 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:01.642683 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 683/1361] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:01.647885 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152b934-1730-48c3-9b18-292881d488a0 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:01.648363 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152b934-1730-48c3-9b18-292881d488a0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:01.648457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152b934-1730-48c3-9b18-292881d488a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:01.722067 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1152b934-1730-48c3-9b18-292881d488a0 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:01.723424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1152b934-1730-48c3-9b18-292881d488a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:01.763872 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:01.827603 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 679/1362] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:56:01.873833 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585de251-4726-40f5-b044-6fa8bb9a7858 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:56:01.875693 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-585de251-4726-40f5-b044-6fa8bb9a7858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:02.060517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585de251-4726-40f5-b044-6fa8bb9a7858 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:56:02.071196 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:02.213073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8847b41-16a6-4635-8ad6-39f2f6155590 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:56:02.213695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8847b41-16a6-4635-8ad6-39f2f6155590 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:02.213978 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8847b41-16a6-4635-8ad6-39f2f6155590 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:02.214237 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8847b41-16a6-4635-8ad6-39f2f6155590 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:02.216987 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e8847b41-16a6-4635-8ad6-39f2f6155590 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:02.318272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8847b41-16a6-4635-8ad6-39f2f6155590 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:56:02.319910 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8847b41-16a6-4635-8ad6-39f2f6155590 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:56:02.339182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 684/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:56:04.855897 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca3fea-c987-47c2-bf17-66f8e14513b2 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:04.856432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca3fea-c987-47c2-bf17-66f8e14513b2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:04.856432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca3fea-c987-47c2-bf17-66f8e14513b2 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:04.858055 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 680/1364] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:04.864066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248726a4-df13-49ab-8a21-adcd076df658 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:04.864552 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248726a4-df13-49ab-8a21-adcd076df658 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:04.864657 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248726a4-df13-49ab-8a21-adcd076df658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:04.907186 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:04.938730 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-248726a4-df13-49ab-8a21-adcd076df658 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:04.940556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-248726a4-df13-49ab-8a21-adcd076df658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:05.053693 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 685/1365] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:56:05.102060 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dce37e-ce28-468e-81ae-10fd42b9c43c None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:05.102345 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dce37e-ce28-468e-81ae-10fd42b9c43c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:05.102824 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dce37e-ce28-468e-81ae-10fd42b9c43c None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:05.104214 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 681/1366] 10.222.0.43 () {54 vars in 962 bytes} [Thu Aug 11 10:56:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:05.110189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39d758-cd57-4d4a-b303-a9900346da8c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:05.110413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39d758-cd57-4d4a-b303-a9900346da8c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:05.110804 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39d758-cd57-4d4a-b303-a9900346da8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:05.191215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-de39d758-cd57-4d4a-b303-a9900346da8c None None] MFA Rules not processed for user `9267752ac6724013bc1edcdecff48dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:05.193262 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-de39d758-cd57-4d4a-b303-a9900346da8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:05.231572 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:05.319545 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 686/1367] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Aug 11 10:56:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:56:05.328074 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dce37e-ce28-468e-81ae-10fd42b9c43c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:56:05.329558 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c3dce37e-ce28-468e-81ae-10fd42b9c43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:05.494632 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dce37e-ce28-468e-81ae-10fd42b9c43c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:56:05.515905 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:05.612748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a419b4-dd7c-4c85-8f40-bac7cdce3775 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:56:05.614244 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a419b4-dd7c-4c85-8f40-bac7cdce3775 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:05.614707 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a419b4-dd7c-4c85-8f40-bac7cdce3775 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:05.615168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a419b4-dd7c-4c85-8f40-bac7cdce3775 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:05.616835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-26a419b4-dd7c-4c85-8f40-bac7cdce3775 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:05.710537 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a419b4-dd7c-4c85-8f40-bac7cdce3775 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:56:05.712184 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a419b4-dd7c-4c85-8f40-bac7cdce3775 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:56:05.731735 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 682/1368] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:56:06.722121 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa63176-fa11-4f90-a831-3d9833cb7a0f None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:06.722692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa63176-fa11-4f90-a831-3d9833cb7a0f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:06.722692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa63176-fa11-4f90-a831-3d9833cb7a0f None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:06.724738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 687/1369] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:56:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:06.730124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c1830-1286-43d6-bbbe-708f6b876d68 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:06.730575 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c1830-1286-43d6-bbbe-708f6b876d68 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:06.730681 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c1830-1286-43d6-bbbe-708f6b876d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:06.764686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:06.802568 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-fa2c1830-1286-43d6-bbbe-708f6b876d68 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:06.803846 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fa2c1830-1286-43d6-bbbe-708f6b876d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:06.902712 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 683/1370] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:56:07.249184 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5b594-e608-4f2d-94ae-8e860ac47fa9 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:07.249472 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5b594-e608-4f2d-94ae-8e860ac47fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:07.249746 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5b594-e608-4f2d-94ae-8e860ac47fa9 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:07.252099 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 688/1371] 10.222.0.43 () {54 vars in 964 bytes} [Thu Aug 11 10:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:07.256959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee01fdd-4b10-42b8-87d1-726f4a792616 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:07.257309 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee01fdd-4b10-42b8-87d1-726f4a792616 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:07.257591 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee01fdd-4b10-42b8-87d1-726f4a792616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:07.340836 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-aee01fdd-4b10-42b8-87d1-726f4a792616 None None] MFA Rules not processed for user `85551eadb87f496f882c4d6e984144c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:07.342049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-aee01fdd-4b10-42b8-87d1-726f4a792616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:07.390843 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:07.422141 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 684/1372] 10.222.0.43 () {58 vars in 1061 bytes} [Thu Aug 11 10:56:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:56:07.430104 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5b594-e608-4f2d-94ae-8e860ac47fa9 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:56:07.431746 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-64e5b594-e608-4f2d-94ae-8e860ac47fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:07.540854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5b594-e608-4f2d-94ae-8e860ac47fa9 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:56:07.583210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:07.621086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a889cfe-29eb-491c-8cb3-a4df94a50653 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:56:07.621703 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a889cfe-29eb-491c-8cb3-a4df94a50653 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:07.621986 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a889cfe-29eb-491c-8cb3-a4df94a50653 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:07.622259 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a889cfe-29eb-491c-8cb3-a4df94a50653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:07.623889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0a889cfe-29eb-491c-8cb3-a4df94a50653 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:07.742355 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a889cfe-29eb-491c-8cb3-a4df94a50653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:56:07.743847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a889cfe-29eb-491c-8cb3-a4df94a50653 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:56:07.763071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 689/1373] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:56:08.060431 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe09b2-d562-4938-bae9-468f78e50591 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:08.060866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe09b2-d562-4938-bae9-468f78e50591 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:08.061474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe09b2-d562-4938-bae9-468f78e50591 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:08.063800 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 685/1374] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:56:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:08.069241 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b15d5-4f98-4309-b08d-1a0e65a53bbb None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:08.069531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b15d5-4f98-4309-b08d-1a0e65a53bbb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:08.069822 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b15d5-4f98-4309-b08d-1a0e65a53bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:08.139401 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-843b15d5-4f98-4309-b08d-1a0e65a53bbb None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:08.140604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-843b15d5-4f98-4309-b08d-1a0e65a53bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:08.165733 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:08.267406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 690/1375] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:56:08.302415 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe09b2-d562-4938-bae9-468f78e50591 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:56:08.304646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e1fe09b2-d562-4938-bae9-468f78e50591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:08.464605 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe09b2-d562-4938-bae9-468f78e50591 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:56:08.517935 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:08.585442 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb005a-30dd-4695-b267-fd2765a4be2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:56:08.586063 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb005a-30dd-4695-b267-fd2765a4be2e service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:08.586346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb005a-30dd-4695-b267-fd2765a4be2e service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:08.586621 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb005a-30dd-4695-b267-fd2765a4be2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:08.588415 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6afb005a-30dd-4695-b267-fd2765a4be2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:08.680246 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb005a-30dd-4695-b267-fd2765a4be2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:56:08.681749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb005a-30dd-4695-b267-fd2765a4be2e service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:56:08.699492 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 686/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:56:10.884573 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361df6f-4d7c-41dd-a39b-40d1d8a7436f None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:10.885081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361df6f-4d7c-41dd-a39b-40d1d8a7436f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:10.885171 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361df6f-4d7c-41dd-a39b-40d1d8a7436f None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:10.886602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 691/1377] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:10.891705 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364869ca-ce57-4394-b26c-80464f569cac None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:10.892114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364869ca-ce57-4394-b26c-80464f569cac None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:10.892456 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364869ca-ce57-4394-b26c-80464f569cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:10.968806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-364869ca-ce57-4394-b26c-80464f569cac None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:10.972128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-364869ca-ce57-4394-b26c-80464f569cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:10.981716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:11.084076 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 687/1378] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:56:11.128870 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361df6f-4d7c-41dd-a39b-40d1d8a7436f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:56:11.131132 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f361df6f-4d7c-41dd-a39b-40d1d8a7436f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:11.277993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361df6f-4d7c-41dd-a39b-40d1d8a7436f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:56:11.281695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:11.424958 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79915445-ff9b-45b3-a384-f9d912d8490f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:56:11.426546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79915445-ff9b-45b3-a384-f9d912d8490f service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:11.427034 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79915445-ff9b-45b3-a384-f9d912d8490f service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:11.427383 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79915445-ff9b-45b3-a384-f9d912d8490f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:11.429151 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-79915445-ff9b-45b3-a384-f9d912d8490f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:11.539303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79915445-ff9b-45b3-a384-f9d912d8490f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:56:11.541172 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79915445-ff9b-45b3-a384-f9d912d8490f service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:56:11.563389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 692/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:56:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:56:13.826287 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5407ef0-40e0-48b5-8040-66117ce702fe None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:13.826948 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5407ef0-40e0-48b5-8040-66117ce702fe None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:13.826948 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5407ef0-40e0-48b5-8040-66117ce702fe None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:13.828448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 688/1380] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:13.833932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876b83a-724a-4c5b-9220-f16ad113b913 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:13.834510 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876b83a-724a-4c5b-9220-f16ad113b913 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:13.834510 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876b83a-724a-4c5b-9220-f16ad113b913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:13.846038 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:13.905317 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-8876b83a-724a-4c5b-9220-f16ad113b913 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:13.906508 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8876b83a-724a-4c5b-9220-f16ad113b913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:14.010881 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 693/1381] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:56:14.056092 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5407ef0-40e0-48b5-8040-66117ce702fe None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:56:14.057853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d5407ef0-40e0-48b5-8040-66117ce702fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:14.201864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:14.213660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5407ef0-40e0-48b5-8040-66117ce702fe None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:56:14.354912 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54934469-5f23-4b80-bed2-f732962a0b70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:56:14.355531 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54934469-5f23-4b80-bed2-f732962a0b70 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:14.355816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54934469-5f23-4b80-bed2-f732962a0b70 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:14.356233 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54934469-5f23-4b80-bed2-f732962a0b70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:14.357749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-54934469-5f23-4b80-bed2-f732962a0b70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:14.459118 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54934469-5f23-4b80-bed2-f732962a0b70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:56:14.460710 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54934469-5f23-4b80-bed2-f732962a0b70 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:56:14.471778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:14.481134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 689/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:56:16.890187 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7668fd-6a1a-4371-be3b-c373b848eebb None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:16.890789 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7668fd-6a1a-4371-be3b-c373b848eebb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:16.890789 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7668fd-6a1a-4371-be3b-c373b848eebb None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:16.892081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 694/1383] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:16.897832 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff21262-92dd-4909-8962-b1b904587b40 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:16.898406 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff21262-92dd-4909-8962-b1b904587b40 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:16.898514 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff21262-92dd-4909-8962-b1b904587b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:16.966254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5ff21262-92dd-4909-8962-b1b904587b40 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:16.967487 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5ff21262-92dd-4909-8962-b1b904587b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:17.070362 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 690/1384] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:56:17.114410 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7668fd-6a1a-4371-be3b-c373b848eebb None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:56:17.116283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8a7668fd-6a1a-4371-be3b-c373b848eebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:17.206166 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:17.268339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7668fd-6a1a-4371-be3b-c373b848eebb None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:56:17.383897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17008b-ad29-4b16-b2a8-e4bf27bb05ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:56:17.384503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17008b-ad29-4b16-b2a8-e4bf27bb05ef service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:17.384782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17008b-ad29-4b16-b2a8-e4bf27bb05ef service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:17.385055 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17008b-ad29-4b16-b2a8-e4bf27bb05ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:17.386678 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3d17008b-ad29-4b16-b2a8-e4bf27bb05ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:17.436324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:17.476258 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17008b-ad29-4b16-b2a8-e4bf27bb05ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:56:17.477818 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17008b-ad29-4b16-b2a8-e4bf27bb05ef service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:56:17.497100 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 695/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:56:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:56:19.553528 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e38eea-f918-4f77-9a19-59f05274325e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:19.554114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e38eea-f918-4f77-9a19-59f05274325e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:19.554114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e38eea-f918-4f77-9a19-59f05274325e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:19.555447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 691/1386] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:19.560656 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ef857-5507-4227-b6bd-6bd5bfdd9a1c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:19.561050 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ef857-5507-4227-b6bd-6bd5bfdd9a1c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:19.561183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ef857-5507-4227-b6bd-6bd5bfdd9a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:19.635097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-b65ef857-5507-4227-b6bd-6bd5bfdd9a1c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:19.636324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b65ef857-5507-4227-b6bd-6bd5bfdd9a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:19.734070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 696/1387] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:56:19.780684 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e38eea-f918-4f77-9a19-59f05274325e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:56:19.782250 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-19e38eea-f918-4f77-9a19-59f05274325e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:19.861726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:19.932452 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e38eea-f918-4f77-9a19-59f05274325e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:56:20.064836 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44782297-7118-4ee9-bb88-86d997e9e400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:56:20.065456 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44782297-7118-4ee9-bb88-86d997e9e400 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:20.065735 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44782297-7118-4ee9-bb88-86d997e9e400 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:20.066005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44782297-7118-4ee9-bb88-86d997e9e400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:20.067918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-44782297-7118-4ee9-bb88-86d997e9e400 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:20.112272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:20.167416 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44782297-7118-4ee9-bb88-86d997e9e400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:56:20.169087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44782297-7118-4ee9-bb88-86d997e9e400 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:56:20.188389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 692/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:56:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:56:22.463865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d47fe-d272-43f4-a561-eb5c48635d78 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:22.464399 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d47fe-d272-43f4-a561-eb5c48635d78 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:22.464489 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d47fe-d272-43f4-a561-eb5c48635d78 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:22.465862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 697/1389] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:22.473068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6895d1-78ca-404a-850c-fd3aa59efe98 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:22.473544 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6895d1-78ca-404a-850c-fd3aa59efe98 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:22.473813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6895d1-78ca-404a-850c-fd3aa59efe98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:22.541947 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-cc6895d1-78ca-404a-850c-fd3aa59efe98 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:22.543197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cc6895d1-78ca-404a-850c-fd3aa59efe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:22.640617 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 693/1390] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:56:22.697547 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d47fe-d272-43f4-a561-eb5c48635d78 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:56:22.699121 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-842d47fe-d272-43f4-a561-eb5c48635d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:22.731751 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:22.852815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d47fe-d272-43f4-a561-eb5c48635d78 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:56:22.955962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:22.967912 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b1162-3759-4314-bc69-284b11ab4469 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:56:22.968459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b1162-3759-4314-bc69-284b11ab4469 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:22.968747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b1162-3759-4314-bc69-284b11ab4469 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:22.968997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b1162-3759-4314-bc69-284b11ab4469 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:22.970729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-023b1162-3759-4314-bc69-284b11ab4469 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:23.063206 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b1162-3759-4314-bc69-284b11ab4469 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:56:23.065418 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b1162-3759-4314-bc69-284b11ab4469 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:56:23.089236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 698/1391] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:56:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:56:25.576132 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24d519-d8a6-419a-a99b-ccc9ed89e605 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:25.576759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24d519-d8a6-419a-a99b-ccc9ed89e605 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:25.576759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24d519-d8a6-419a-a99b-ccc9ed89e605 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:25.577971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 694/1392] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:25.583929 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862ffb1-bca4-4a1a-8a61-7dad0d62d71f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:25.584409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862ffb1-bca4-4a1a-8a61-7dad0d62d71f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:25.584518 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862ffb1-bca4-4a1a-8a61-7dad0d62d71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:25.650964 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d862ffb1-bca4-4a1a-8a61-7dad0d62d71f None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:25.652154 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d862ffb1-bca4-4a1a-8a61-7dad0d62d71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:25.711496 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:25.748703 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 699/1393] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:56:25.793214 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24d519-d8a6-419a-a99b-ccc9ed89e605 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:56:25.794728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-dc24d519-d8a6-419a-a99b-ccc9ed89e605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:25.809174 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:25.947400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24d519-d8a6-419a-a99b-ccc9ed89e605 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:56:26.043036 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:26.064590 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c3214-285b-4478-81a5-aced49da38f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:56:26.072568 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c3214-285b-4478-81a5-aced49da38f3 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:26.072568 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c3214-285b-4478-81a5-aced49da38f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:26.072568 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c3214-285b-4478-81a5-aced49da38f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:26.072568 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e55c3214-285b-4478-81a5-aced49da38f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:26.162102 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c3214-285b-4478-81a5-aced49da38f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:56:26.163719 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c3214-285b-4478-81a5-aced49da38f3 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:56:26.182717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 695/1394] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:56:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:56:26.252497 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82356dab-338c-4048-ac48-7c7ecd8923f9 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:26.252716 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82356dab-338c-4048-ac48-7c7ecd8923f9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:26.252952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82356dab-338c-4048-ac48-7c7ecd8923f9 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:26.254413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 700/1395] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:26.259731 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b56fb-ac5d-42fb-ad9f-442cbe02405c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:26.260020 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b56fb-ac5d-42fb-ad9f-442cbe02405c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:26.260294 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b56fb-ac5d-42fb-ad9f-442cbe02405c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:26.329058 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-648b56fb-ac5d-42fb-ad9f-442cbe02405c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:26.330275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-648b56fb-ac5d-42fb-ad9f-442cbe02405c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:26.383948 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:26.438517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 696/1396] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:56:26.496846 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3076986-24bf-409a-9a14-db9ad32e7072 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:26.497132 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3076986-24bf-409a-9a14-db9ad32e7072 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:26.497436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3076986-24bf-409a-9a14-db9ad32e7072 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:26.498781 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 701/1397] 10.222.0.43 () {54 vars in 967 bytes} [Thu Aug 11 10:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:26.504412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5095cf3-5d2e-4219-9e0a-296ec7b70e6e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:26.504961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5095cf3-5d2e-4219-9e0a-296ec7b70e6e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:26.505242 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5095cf3-5d2e-4219-9e0a-296ec7b70e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:26.582929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b5095cf3-5d2e-4219-9e0a-296ec7b70e6e None None] MFA Rules not processed for user `d4fe013f66e2452eaaf84d4b52eca489`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:26.584138 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b5095cf3-5d2e-4219-9e0a-296ec7b70e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:26.659952 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 697/1398] 10.222.0.43 () {58 vars in 1064 bytes} [Thu Aug 11 10:56:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:56:26.667870 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3076986-24bf-409a-9a14-db9ad32e7072 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:56:26.669369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c3076986-24bf-409a-9a14-db9ad32e7072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:26.782602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3076986-24bf-409a-9a14-db9ad32e7072 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:56:26.869866 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d03533-9c7d-40a0-a077-d92ce9b86e76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fe013f66e2452eaaf84d4b52eca489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:56:26.870497 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d03533-9c7d-40a0-a077-d92ce9b86e76 service glance] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:26.870795 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d03533-9c7d-40a0-a077-d92ce9b86e76 service glance] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:26.871058 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d03533-9c7d-40a0-a077-d92ce9b86e76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:26.872716 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-68d03533-9c7d-40a0-a077-d92ce9b86e76 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:26.895345 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:26.995229 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d03533-9c7d-40a0-a077-d92ce9b86e76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:56:26.996823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d03533-9c7d-40a0-a077-d92ce9b86e76 service glance] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:56:27.016858 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 702/1399] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:56:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:56:27.926934 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae3c56-0978-4d3c-b728-4737bf66e9d5 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:27.927459 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae3c56-0978-4d3c-b728-4737bf66e9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:27.927895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae3c56-0978-4d3c-b728-4737bf66e9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:27.995520 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:28.005453 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a2ae3c56-0978-4d3c-b728-4737bf66e9d5 None None] MFA Rules not processed for user `9751264123914c27b961009f75067660`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:28.006677 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a2ae3c56-0978-4d3c-b728-4737bf66e9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:28.105706 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 698/1400] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Aug 11 10:56:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:56:28.162407 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5414bc-7e9f-4762-8b7f-8cc980d4aa80 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:28.163081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5414bc-7e9f-4762-8b7f-8cc980d4aa80 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:28.163081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5414bc-7e9f-4762-8b7f-8cc980d4aa80 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:28.164874 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 703/1401] 10.222.0.43 () {54 vars in 943 bytes} [Thu Aug 11 10:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:28.171283 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0cdef-fc47-433f-88b2-ee41644b07b0 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:28.171568 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0cdef-fc47-433f-88b2-ee41644b07b0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:28.171844 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0cdef-fc47-433f-88b2-ee41644b07b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:28.258009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ccb0cdef-fc47-433f-88b2-ee41644b07b0 None None] MFA Rules not processed for user `cbd25d1bde0c4703b61e0edaf5b658d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:28.259729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ccb0cdef-fc47-433f-88b2-ee41644b07b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:28.337101 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:28.376452 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 699/1402] 10.222.0.43 () {58 vars in 1040 bytes} [Thu Aug 11 10:56:28 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:56:28.386605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5414bc-7e9f-4762-8b7f-8cc980d4aa80 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:56:28.388772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3e5414bc-7e9f-4762-8b7f-8cc980d4aa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:28.414329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479a9b2-0273-4721-8fc3-f730c29dcac3 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:28.414537 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479a9b2-0273-4721-8fc3-f730c29dcac3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:28.414847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479a9b2-0273-4721-8fc3-f730c29dcac3 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:28.416225 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 700/1403] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:56:28.422319 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d96fb-4e51-4573-aef1-edb230224622 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:28.422598 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d96fb-4e51-4573-aef1-edb230224622 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:28.422903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d96fb-4e51-4573-aef1-edb230224622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:28.497980 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d26d96fb-4e51-4573-aef1-edb230224622 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:28.499243 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d26d96fb-4e51-4573-aef1-edb230224622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:28.529979 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:28.542174 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5414bc-7e9f-4762-8b7f-8cc980d4aa80 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:56:28.614372 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 701/1404] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:56:28.657626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039038db-75b0-41db-b7e3-3f9f2b151f7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd25d1bde0c4703b61e0edaf5b658d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:56:28.658423 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039038db-75b0-41db-b7e3-3f9f2b151f7f service swift] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:28.658933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039038db-75b0-41db-b7e3-3f9f2b151f7f service swift] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:28.659393 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039038db-75b0-41db-b7e3-3f9f2b151f7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:28.661163 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d96fb-4e51-4573-aef1-edb230224622 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:56:28.662365 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d26d96fb-4e51-4573-aef1-edb230224622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:28.662482 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-039038db-75b0-41db-b7e3-3f9f2b151f7f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:28.725533 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:28.757565 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039038db-75b0-41db-b7e3-3f9f2b151f7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:56:28.759210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039038db-75b0-41db-b7e3-3f9f2b151f7f service swift] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:56:28.768467 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 704/1405] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Aug 11 10:56:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 10:56:28.795419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d96fb-4e51-4573-aef1-edb230224622 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:56:28.916942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a3241-0fc9-4880-935d-1824c1ba5156 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:56:28.917582 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a3241-0fc9-4880-935d-1824c1ba5156 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:28.917858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a3241-0fc9-4880-935d-1824c1ba5156 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:28.918130 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a3241-0fc9-4880-935d-1824c1ba5156 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:28.919747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ac6a3241-0fc9-4880-935d-1824c1ba5156 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:28.964027 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:29.013948 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a3241-0fc9-4880-935d-1824c1ba5156 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:56:29.015591 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a3241-0fc9-4880-935d-1824c1ba5156 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:56:29.034491 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 702/1406] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:56:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 10:56:31.242821 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a641cc1-fcf7-4c8f-9cce-3e836a394da0 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:31.243354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a641cc1-fcf7-4c8f-9cce-3e836a394da0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:31.243354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a641cc1-fcf7-4c8f-9cce-3e836a394da0 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:31.247094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 705/1407] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:56:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:31.250149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dc0e2-66c6-437d-8de2-64e588b6a8b2 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:31.250645 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dc0e2-66c6-437d-8de2-64e588b6a8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:31.250727 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52dc0e2-66c6-437d-8de2-64e588b6a8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:31.330918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e52dc0e2-66c6-437d-8de2-64e588b6a8b2 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:31.332737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e52dc0e2-66c6-437d-8de2-64e588b6a8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:31.454547 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 703/1408] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:56:31.510155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a641cc1-fcf7-4c8f-9cce-3e836a394da0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:56:31.511821 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4a641cc1-fcf7-4c8f-9cce-3e836a394da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:31.537803 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:31.677312 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a641cc1-fcf7-4c8f-9cce-3e836a394da0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:56:31.801583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a605f-ff06-471e-baa7-15573ff10b3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:56:31.802505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a605f-ff06-471e-baa7-15573ff10b3b service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:31.802813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a605f-ff06-471e-baa7-15573ff10b3b service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:31.803092 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a605f-ff06-471e-baa7-15573ff10b3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:31.804693 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c77a605f-ff06-471e-baa7-15573ff10b3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:31.828419 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:31.906954 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a605f-ff06-471e-baa7-15573ff10b3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:56:31.912578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a605f-ff06-471e-baa7-15573ff10b3b service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:56:31.934811 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 706/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:56:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:56:41.449716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=91 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:41.931949 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=53 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:52.288263 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e657f-aad9-409c-adfe-e01ae37c69a2 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:52.288858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e657f-aad9-409c-adfe-e01ae37c69a2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:52.288858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e657f-aad9-409c-adfe-e01ae37c69a2 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:52.290112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 704/1410] 10.222.0.43 () {54 vars in 918 bytes} [Thu Aug 11 10:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:52.295163 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58483acf-916a-4813-a80a-241de02117bd None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:52.295574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58483acf-916a-4813-a80a-241de02117bd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:52.295711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58483acf-916a-4813-a80a-241de02117bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:52.370047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-58483acf-916a-4813-a80a-241de02117bd None None] MFA Rules not processed for user `4db99589bb504e8fa4068925badf3942`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:52.371250 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-58483acf-916a-4813-a80a-241de02117bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:52.475063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 707/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Aug 11 10:56:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:56:52.489929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d972cc-192d-42e7-b8bb-1ad9a8fcc8d0 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:52.490212 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d972cc-192d-42e7-b8bb-1ad9a8fcc8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:52.490487 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d972cc-192d-42e7-b8bb-1ad9a8fcc8d0 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:52.491872 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 705/1412] 10.222.0.43 () {54 vars in 918 bytes} [Thu Aug 11 10:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:52.496522 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f27586-e337-4191-b543-f9931c9ee779 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:52.496811 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f27586-e337-4191-b543-f9931c9ee779 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:52.497089 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f27586-e337-4191-b543-f9931c9ee779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:52.568729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:52.571756 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-49f27586-e337-4191-b543-f9931c9ee779 None None] MFA Rules not processed for user `9267752ac6724013bc1edcdecff48dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:52.572965 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-49f27586-e337-4191-b543-f9931c9ee779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:52.685981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 708/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Aug 11 10:56:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:56:55.183755 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08775e01-ace6-4f64-ae8a-4021c3fe44d3 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:55.184318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08775e01-ace6-4f64-ae8a-4021c3fe44d3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:55.184318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08775e01-ace6-4f64-ae8a-4021c3fe44d3 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:55.185621 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 10:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:55.190923 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349721c7-e0b3-484a-8876-5cf88f733cd3 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:55.191492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349721c7-e0b3-484a-8876-5cf88f733cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:55.191492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349721c7-e0b3-484a-8876-5cf88f733cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:55.256319 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-349721c7-e0b3-484a-8876-5cf88f733cd3 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:55.257518 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-349721c7-e0b3-484a-8876-5cf88f733cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:55.312392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:55.355921 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 10:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:56:55.398954 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08775e01-ace6-4f64-ae8a-4021c3fe44d3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:56:55.400486 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-08775e01-ace6-4f64-ae8a-4021c3fe44d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:55.545695 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08775e01-ace6-4f64-ae8a-4021c3fe44d3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:56:55.617396 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:55.657253 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b02f4f-840f-4256-bfb2-e46f6a5a4686 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:56:55.657854 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b02f4f-840f-4256-bfb2-e46f6a5a4686 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:55.658132 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b02f4f-840f-4256-bfb2-e46f6a5a4686 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:55.658439 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b02f4f-840f-4256-bfb2-e46f6a5a4686 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:55.660057 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e4b02f4f-840f-4256-bfb2-e46f6a5a4686 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:55.747859 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b02f4f-840f-4256-bfb2-e46f6a5a4686 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:56:55.749445 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b02f4f-840f-4256-bfb2-e46f6a5a4686 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:56:55.769005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 707/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:56:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:56:56.675798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543615d-35b9-440c-8d80-fabf0989fa09 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:56.676367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543615d-35b9-440c-8d80-fabf0989fa09 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:56.676367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543615d-35b9-440c-8d80-fabf0989fa09 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:56.677689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 10:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:56.682545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf82b23-b33d-4500-8d48-b49d5de56b59 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:56.682977 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf82b23-b33d-4500-8d48-b49d5de56b59 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:56.683130 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf82b23-b33d-4500-8d48-b49d5de56b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:56.758718 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6bf82b23-b33d-4500-8d48-b49d5de56b59 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:56.759962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6bf82b23-b33d-4500-8d48-b49d5de56b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:56.787289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:56.856607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 10:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:56:57.008770 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543615d-35b9-440c-8d80-fabf0989fa09 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:56:57.010214 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9543615d-35b9-440c-8d80-fabf0989fa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:57.156052 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543615d-35b9-440c-8d80-fabf0989fa09 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:56:57.196323 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:57.387309 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf6381-aa11-45b6-bbd9-169cfe5ea23f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:56:57.387906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf6381-aa11-45b6-bbd9-169cfe5ea23f service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:57.388183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf6381-aa11-45b6-bbd9-169cfe5ea23f service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:57.388453 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf6381-aa11-45b6-bbd9-169cfe5ea23f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:57.390038 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b9cf6381-aa11-45b6-bbd9-169cfe5ea23f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:57.476959 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf6381-aa11-45b6-bbd9-169cfe5ea23f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:56:57.478545 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf6381-aa11-45b6-bbd9-169cfe5ea23f service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:56:57.496680 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 711/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:56:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:56:58.391023 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e58d2-49a8-4046-86f9-637ee4b6affa None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:58.391581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e58d2-49a8-4046-86f9-637ee4b6affa None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:58.391692 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e58d2-49a8-4046-86f9-637ee4b6affa None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:58.393079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 10:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:58.397975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90a7aa-46ee-495d-944d-e1b789bd5dd0 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:58.398387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90a7aa-46ee-495d-944d-e1b789bd5dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:58.398519 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90a7aa-46ee-495d-944d-e1b789bd5dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:58.451635 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:58.473696 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-bf90a7aa-46ee-495d-944d-e1b789bd5dd0 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:56:58.474940 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-bf90a7aa-46ee-495d-944d-e1b789bd5dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:58.575483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 10:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:56:58.732971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e58d2-49a8-4046-86f9-637ee4b6affa None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:56:58.734482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8e8e58d2-49a8-4046-86f9-637ee4b6affa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:58.881066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e58d2-49a8-4046-86f9-637ee4b6affa None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:56:58.894509 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:58.998401 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4061a-a02e-45e7-b193-932f03344beb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:56:58.998960 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4061a-a02e-45e7-b193-932f03344beb service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:58.999242 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4061a-a02e-45e7-b193-932f03344beb service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:58.999513 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4061a-a02e-45e7-b193-932f03344beb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:59.001150 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c5b4061a-a02e-45e7-b193-932f03344beb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:56:59.091411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4061a-a02e-45e7-b193-932f03344beb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:56:59.093040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4061a-a02e-45e7-b193-932f03344beb service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:56:59.113398 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 710/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:56:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:56:59.964887 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305f720-78cd-467d-b547-e9de14c397ad None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:59.965450 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305f720-78cd-467d-b547-e9de14c397ad None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:59.965450 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305f720-78cd-467d-b547-e9de14c397ad None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:59.966745 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 10:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:56:59.971710 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71970271-c8a1-43a0-af2f-e826a0d52167 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:56:59.972145 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71970271-c8a1-43a0-af2f-e826a0d52167 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:56:59.972778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71970271-c8a1-43a0-af2f-e826a0d52167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:56:59.993070 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:00.051493 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-71970271-c8a1-43a0-af2f-e826a0d52167 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:57:00.052703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-71970271-c8a1-43a0-af2f-e826a0d52167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:00.146463 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 10:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:57:00.296433 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305f720-78cd-467d-b547-e9de14c397ad None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:57:00.297854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7305f720-78cd-467d-b547-e9de14c397ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:00.404604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:00.440252 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305f720-78cd-467d-b547-e9de14c397ad None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:57:00.555186 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48918c16-bc76-4d89-a5f6-b4ea01738bbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:57:00.555692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48918c16-bc76-4d89-a5f6-b4ea01738bbc service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:00.555965 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48918c16-bc76-4d89-a5f6-b4ea01738bbc service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:00.556253 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48918c16-bc76-4d89-a5f6-b4ea01738bbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:00.557816 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-48918c16-bc76-4d89-a5f6-b4ea01738bbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:00.633213 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:00.647071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48918c16-bc76-4d89-a5f6-b4ea01738bbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:57:00.648674 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48918c16-bc76-4d89-a5f6-b4ea01738bbc service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:57:00.666318 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 714/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:57:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:57:01.530290 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfd778-b887-4f98-8575-dbe3a4f706ae None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:01.530851 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfd778-b887-4f98-8575-dbe3a4f706ae None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:01.530949 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfd778-b887-4f98-8575-dbe3a4f706ae None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:01.532239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 10:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:57:01.537209 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f503886-502a-4244-a638-f600477e7695 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:01.537665 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f503886-502a-4244-a638-f600477e7695 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:01.537769 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f503886-502a-4244-a638-f600477e7695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:01.611728 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1f503886-502a-4244-a638-f600477e7695 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:57:01.612971 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1f503886-502a-4244-a638-f600477e7695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:01.713500 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 10:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:57:01.865111 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfd778-b887-4f98-8575-dbe3a4f706ae None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:57:01.866522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-85bfd778-b887-4f98-8575-dbe3a4f706ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:01.950298 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:02.013374 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfd778-b887-4f98-8575-dbe3a4f706ae None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:57:02.126974 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662535a-67fb-46e3-b381-6f7bf5e32007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:57:02.127509 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662535a-67fb-46e3-b381-6f7bf5e32007 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:02.127792 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662535a-67fb-46e3-b381-6f7bf5e32007 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:02.128069 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662535a-67fb-46e3-b381-6f7bf5e32007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:02.130333 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a662535a-67fb-46e3-b381-6f7bf5e32007 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:02.179169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:02.222290 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662535a-67fb-46e3-b381-6f7bf5e32007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:57:02.223901 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662535a-67fb-46e3-b381-6f7bf5e32007 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:57:02.245277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 713/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:57:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:57:03.103917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011222e-1bf9-45f5-bbea-7c7db58e2e6b None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:03.104448 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011222e-1bf9-45f5-bbea-7c7db58e2e6b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:03.104555 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e011222e-1bf9-45f5-bbea-7c7db58e2e6b None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:03.105851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 10:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:57:03.110667 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7aba1-4f7a-4c1e-a33f-31dd67be9e0a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:03.111146 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7aba1-4f7a-4c1e-a33f-31dd67be9e0a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:03.111256 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7aba1-4f7a-4c1e-a33f-31dd67be9e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:03.188173 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-98f7aba1-4f7a-4c1e-a33f-31dd67be9e0a None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:57:03.189558 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-98f7aba1-4f7a-4c1e-a33f-31dd67be9e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:03.287752 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 10:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:57:03.438181 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011222e-1bf9-45f5-bbea-7c7db58e2e6b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:57:03.439742 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e011222e-1bf9-45f5-bbea-7c7db58e2e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:03.487266 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:03.583353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e011222e-1bf9-45f5-bbea-7c7db58e2e6b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:57:03.699409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b840b1e-6e8f-46c4-962a-3d8b68b6f5f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:57:03.700012 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b840b1e-6e8f-46c4-962a-3d8b68b6f5f6 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:03.700289 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b840b1e-6e8f-46c4-962a-3d8b68b6f5f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:03.700555 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b840b1e-6e8f-46c4-962a-3d8b68b6f5f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:03.702145 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6b840b1e-6e8f-46c4-962a-3d8b68b6f5f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:03.709221 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:03.791321 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b840b1e-6e8f-46c4-962a-3d8b68b6f5f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:57:03.792912 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b840b1e-6e8f-46c4-962a-3d8b68b6f5f6 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:57:03.811056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 717/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:57:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:57:04.678640 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a0c6d-5382-488b-902c-7a234f2f416a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:04.679239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a0c6d-5382-488b-902c-7a234f2f416a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:04.679239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a0c6d-5382-488b-902c-7a234f2f416a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:04.680638 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 10:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:57:04.685429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400f59-6e9c-44d7-a7ea-df6cf729842c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:04.685842 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400f59-6e9c-44d7-a7ea-df6cf729842c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:04.686045 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64400f59-6e9c-44d7-a7ea-df6cf729842c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:04.762769 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-64400f59-6e9c-44d7-a7ea-df6cf729842c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:57:04.763994 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-64400f59-6e9c-44d7-a7ea-df6cf729842c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:04.830562 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:04.858485 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 10:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:57:05.010632 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a0c6d-5382-488b-902c-7a234f2f416a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:57:05.012150 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-321a0c6d-5382-488b-902c-7a234f2f416a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:05.030387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:05.156859 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a0c6d-5382-488b-902c-7a234f2f416a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:57:05.246364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:05.272954 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9452a3-b308-4087-a435-ac3e186cb4c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:57:05.273500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9452a3-b308-4087-a435-ac3e186cb4c0 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:05.273784 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9452a3-b308-4087-a435-ac3e186cb4c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:05.274061 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9452a3-b308-4087-a435-ac3e186cb4c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:05.276405 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cb9452a3-b308-4087-a435-ac3e186cb4c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:05.366815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9452a3-b308-4087-a435-ac3e186cb4c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:57:05.368413 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9452a3-b308-4087-a435-ac3e186cb4c0 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:57:05.387040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 716/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:57:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:57:06.269803 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be0d86-31b6-4d7a-865d-4cfcae09e0b6 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:06.270337 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be0d86-31b6-4d7a-865d-4cfcae09e0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:06.270337 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be0d86-31b6-4d7a-865d-4cfcae09e0b6 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:06.271704 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 10:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:57:06.276586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193ee72-3986-4df7-bf71-78da65f8b6a7 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:06.277000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193ee72-3986-4df7-bf71-78da65f8b6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:06.277149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193ee72-3986-4df7-bf71-78da65f8b6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:06.354108 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1193ee72-3986-4df7-bf71-78da65f8b6a7 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:57:06.355328 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1193ee72-3986-4df7-bf71-78da65f8b6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:06.397557 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:06.452512 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 10:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:57:06.606975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be0d86-31b6-4d7a-865d-4cfcae09e0b6 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:57:06.608419 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-34be0d86-31b6-4d7a-865d-4cfcae09e0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:06.752623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be0d86-31b6-4d7a-865d-4cfcae09e0b6 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:57:06.808544 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:06.870183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a870d-3b99-485e-b0eb-2ebf97dc2252 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:57:06.870699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a870d-3b99-485e-b0eb-2ebf97dc2252 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:06.870996 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a870d-3b99-485e-b0eb-2ebf97dc2252 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:06.871262 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a870d-3b99-485e-b0eb-2ebf97dc2252 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:06.872835 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7a5a870d-3b99-485e-b0eb-2ebf97dc2252 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:06.965132 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a870d-3b99-485e-b0eb-2ebf97dc2252 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:57:06.966731 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a870d-3b99-485e-b0eb-2ebf97dc2252 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:57:06.986278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 720/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:57:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:57:07.840069 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e93da-efde-425c-a653-9bce8b095342 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:07.840641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e93da-efde-425c-a653-9bce8b095342 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:07.840641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e93da-efde-425c-a653-9bce8b095342 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:07.841998 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 10:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:57:07.847793 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe08df-59a2-4b4d-8a72-3b3d68af20df None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:07.848269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe08df-59a2-4b4d-8a72-3b3d68af20df None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:07.848557 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe08df-59a2-4b4d-8a72-3b3d68af20df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:07.935885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-fcbe08df-59a2-4b4d-8a72-3b3d68af20df None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:57:07.937074 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fcbe08df-59a2-4b4d-8a72-3b3d68af20df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:07.939055 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:08.033108 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 10:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:57:08.185928 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e93da-efde-425c-a653-9bce8b095342 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:57:08.187518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cb3e93da-efde-425c-a653-9bce8b095342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:08.337943 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e93da-efde-425c-a653-9bce8b095342 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:57:08.364579 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:08.449502 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd46b9-12e5-4c24-a670-3bfbf981a536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:57:08.450035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd46b9-12e5-4c24-a670-3bfbf981a536 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:08.450318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd46b9-12e5-4c24-a670-3bfbf981a536 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:08.450600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd46b9-12e5-4c24-a670-3bfbf981a536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:08.452218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6ddd46b9-12e5-4c24-a670-3bfbf981a536 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:08.543610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd46b9-12e5-4c24-a670-3bfbf981a536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:57:08.545204 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd46b9-12e5-4c24-a670-3bfbf981a536 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:57:08.563922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 719/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:57:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:57:10.542351 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cc277-a2d0-4fa0-a0da-de7b789db290 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:10.542980 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cc277-a2d0-4fa0-a0da-de7b789db290 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:10.543069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cc277-a2d0-4fa0-a0da-de7b789db290 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:10.544377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 10:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:57:10.549742 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c5ac4-bfb8-47ed-853f-2e098665fac1 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:10.550805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c5ac4-bfb8-47ed-853f-2e098665fac1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:10.551169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c5ac4-bfb8-47ed-853f-2e098665fac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:10.592582 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:10.618235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f34c5ac4-bfb8-47ed-853f-2e098665fac1 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:57:10.619461 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f34c5ac4-bfb8-47ed-853f-2e098665fac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:10.714014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 10:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:57:10.753547 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cc277-a2d0-4fa0-a0da-de7b789db290 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:57:10.755124 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9d7cc277-a2d0-4fa0-a0da-de7b789db290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:10.855328 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cc277-a2d0-4fa0-a0da-de7b789db290 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:57:10.886316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:10.929314 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962b814-58ea-4b38-b714-4cd83a6d5993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:57:10.929935 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962b814-58ea-4b38-b714-4cd83a6d5993 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:10.930245 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962b814-58ea-4b38-b714-4cd83a6d5993 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:10.930518 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962b814-58ea-4b38-b714-4cd83a6d5993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:10.932156 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7962b814-58ea-4b38-b714-4cd83a6d5993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:11.039756 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962b814-58ea-4b38-b714-4cd83a6d5993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:57:11.041201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962b814-58ea-4b38-b714-4cd83a6d5993 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:57:11.059336 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 723/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:57:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:57:13.228340 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b9d68-914a-46b1-bf3e-971df7f525ef None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:13.228872 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b9d68-914a-46b1-bf3e-971df7f525ef None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:13.228872 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b9d68-914a-46b1-bf3e-971df7f525ef None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:13.230236 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 10:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:57:13.235400 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc6108-7c03-44fb-bdb1-ee30e741975e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:13.235878 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc6108-7c03-44fb-bdb1-ee30e741975e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:13.235999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc6108-7c03-44fb-bdb1-ee30e741975e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:13.300709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-cfcc6108-7c03-44fb-bdb1-ee30e741975e None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:57:13.301819 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-cfcc6108-7c03-44fb-bdb1-ee30e741975e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:13.314189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:13.398483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 10:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:57:13.435756 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b9d68-914a-46b1-bf3e-971df7f525ef None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:57:13.437280 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-003b9d68-914a-46b1-bf3e-971df7f525ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:13.540506 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b9d68-914a-46b1-bf3e-971df7f525ef None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:57:13.552559 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:13.614161 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d0802-0f5f-4d64-8754-6279bfbccfee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:57:13.614782 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d0802-0f5f-4d64-8754-6279bfbccfee service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:13.615074 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d0802-0f5f-4d64-8754-6279bfbccfee service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:13.615350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d0802-0f5f-4d64-8754-6279bfbccfee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:13.616932 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-932d0802-0f5f-4d64-8754-6279bfbccfee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:13.725470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d0802-0f5f-4d64-8754-6279bfbccfee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:57:13.726947 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d0802-0f5f-4d64-8754-6279bfbccfee service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:57:13.745863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 722/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:57:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:57:16.217434 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfe747-c55b-408a-91a6-b79ba8aed021 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:16.217964 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfe747-c55b-408a-91a6-b79ba8aed021 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:16.217964 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbfe747-c55b-408a-91a6-b79ba8aed021 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:16.219338 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 10:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:57:16.224868 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437e512-38f0-4040-a186-7a0eea7888e8 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:16.225313 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437e512-38f0-4040-a186-7a0eea7888e8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:16.225421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437e512-38f0-4040-a186-7a0eea7888e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:16.278394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:16.302128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8437e512-38f0-4040-a186-7a0eea7888e8 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:57:16.303753 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8437e512-38f0-4040-a186-7a0eea7888e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:16.400803 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 10:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:57:16.440960 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfe747-c55b-408a-91a6-b79ba8aed021 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:57:16.442526 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fdbfe747-c55b-408a-91a6-b79ba8aed021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:16.544727 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbfe747-c55b-408a-91a6-b79ba8aed021 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:57:16.584535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:16.619933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fd634-1f5f-40ad-a3c0-b40482d97f9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:57:16.620541 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fd634-1f5f-40ad-a3c0-b40482d97f9e service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:16.620822 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fd634-1f5f-40ad-a3c0-b40482d97f9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:16.621097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fd634-1f5f-40ad-a3c0-b40482d97f9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:16.622694 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4b1fd634-1f5f-40ad-a3c0-b40482d97f9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:16.732783 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fd634-1f5f-40ad-a3c0-b40482d97f9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:57:16.734222 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fd634-1f5f-40ad-a3c0-b40482d97f9e service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:57:16.752573 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 726/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:57:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:57:18.884993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c469fe2-cc2c-44c6-874e-61d023dea1ab None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:18.885625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c469fe2-cc2c-44c6-874e-61d023dea1ab None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:18.885625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c469fe2-cc2c-44c6-874e-61d023dea1ab None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:18.886924 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 10:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:57:18.892067 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78f89d-c667-4c7c-963d-8be8f1866d1e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:18.892494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78f89d-c667-4c7c-963d-8be8f1866d1e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:18.892745 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78f89d-c667-4c7c-963d-8be8f1866d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:18.957865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-6b78f89d-c667-4c7c-963d-8be8f1866d1e None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:57:18.959116 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6b78f89d-c667-4c7c-963d-8be8f1866d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:18.979885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:19.058224 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 10:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:57:19.097718 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c469fe2-cc2c-44c6-874e-61d023dea1ab None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:57:19.099353 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5c469fe2-cc2c-44c6-874e-61d023dea1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:19.201556 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c469fe2-cc2c-44c6-874e-61d023dea1ab None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:57:19.221021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:19.273830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4572be2-ee82-4909-a845-519af1da73db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:57:19.274425 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4572be2-ee82-4909-a845-519af1da73db service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:19.274700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4572be2-ee82-4909-a845-519af1da73db service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:19.274994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4572be2-ee82-4909-a845-519af1da73db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:19.276556 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c4572be2-ee82-4909-a845-519af1da73db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:19.383707 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4572be2-ee82-4909-a845-519af1da73db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:57:19.385137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4572be2-ee82-4909-a845-519af1da73db service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:57:19.403877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 725/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:57:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:57:21.459582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c67836-e8be-42d4-ba83-87511e6effc9 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:21.460152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c67836-e8be-42d4-ba83-87511e6effc9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:21.460152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c67836-e8be-42d4-ba83-87511e6effc9 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:21.461436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 10:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:57:21.466552 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831db77-aff2-42ce-ac08-25e035d2bbf8 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:21.466963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831db77-aff2-42ce-ac08-25e035d2bbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:21.467135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831db77-aff2-42ce-ac08-25e035d2bbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:21.530222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:21.534064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c831db77-aff2-42ce-ac08-25e035d2bbf8 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:57:21.535390 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c831db77-aff2-42ce-ac08-25e035d2bbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:21.631458 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 10:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:57:21.670006 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c67836-e8be-42d4-ba83-87511e6effc9 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:57:21.671619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d5c67836-e8be-42d4-ba83-87511e6effc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:21.773833 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c67836-e8be-42d4-ba83-87511e6effc9 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:57:21.822141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:21.845937 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a466168-31de-4c3b-a241-3fe87ddde6ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:57:21.847303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a466168-31de-4c3b-a241-3fe87ddde6ec service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:21.847645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a466168-31de-4c3b-a241-3fe87ddde6ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:21.848098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a466168-31de-4c3b-a241-3fe87ddde6ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:21.850003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6a466168-31de-4c3b-a241-3fe87ddde6ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:21.956396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a466168-31de-4c3b-a241-3fe87ddde6ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:57:21.957866 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a466168-31de-4c3b-a241-3fe87ddde6ec service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:57:21.977719 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 729/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:57:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:57:24.012025 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7eb83-9c66-439a-9597-9218e7d8b361 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:24.012587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7eb83-9c66-439a-9597-9218e7d8b361 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:24.012587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7eb83-9c66-439a-9597-9218e7d8b361 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:24.013996 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 10:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:57:24.019917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f6223-846d-4ef8-a669-cdfea9385995 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:24.025249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f6223-846d-4ef8-a669-cdfea9385995 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:24.025249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f6223-846d-4ef8-a669-cdfea9385995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:24.085261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-2f6f6223-846d-4ef8-a669-cdfea9385995 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:57:24.086458 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2f6f6223-846d-4ef8-a669-cdfea9385995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:24.114928 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:24.179991 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 10:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:57:24.218227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7eb83-9c66-439a-9597-9218e7d8b361 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:57:24.219777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-eaa7eb83-9c66-439a-9597-9218e7d8b361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:24.325731 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7eb83-9c66-439a-9597-9218e7d8b361 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:57:24.353730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:24.398739 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ce017-c853-4219-ba7e-1adb120edada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:57:24.399370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ce017-c853-4219-ba7e-1adb120edada service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:24.399650 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ce017-c853-4219-ba7e-1adb120edada service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:24.399919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ce017-c853-4219-ba7e-1adb120edada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:24.401504 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-914ce017-c853-4219-ba7e-1adb120edada service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:24.510845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ce017-c853-4219-ba7e-1adb120edada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:57:24.512289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ce017-c853-4219-ba7e-1adb120edada service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:57:24.531075 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 728/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:57:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:57:26.599982 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef544e3-2935-43cc-9b94-e29343c24003 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:26.600571 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef544e3-2935-43cc-9b94-e29343c24003 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:26.600571 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef544e3-2935-43cc-9b94-e29343c24003 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:26.601853 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 10:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:57:26.607035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d4323-d4ba-4a79-91b3-dbf750d790f2 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:26.607462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d4323-d4ba-4a79-91b3-dbf750d790f2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:26.607597 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d4323-d4ba-4a79-91b3-dbf750d790f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:26.674068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4a9d4323-d4ba-4a79-91b3-dbf750d790f2 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:57:26.675295 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4a9d4323-d4ba-4a79-91b3-dbf750d790f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:26.683467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:26.772222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 10:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:57:26.810252 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef544e3-2935-43cc-9b94-e29343c24003 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:57:26.811802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-cef544e3-2935-43cc-9b94-e29343c24003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:26.914312 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef544e3-2935-43cc-9b94-e29343c24003 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:57:26.968047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:26.986276 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ce2cc-1a0e-409b-8aab-175fe7e00ce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:57:26.986922 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ce2cc-1a0e-409b-8aab-175fe7e00ce5 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:26.987204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ce2cc-1a0e-409b-8aab-175fe7e00ce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:26.987475 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ce2cc-1a0e-409b-8aab-175fe7e00ce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:26.989333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e36ce2cc-1a0e-409b-8aab-175fe7e00ce5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:27.096527 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ce2cc-1a0e-409b-8aab-175fe7e00ce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:57:27.097965 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ce2cc-1a0e-409b-8aab-175fe7e00ce5 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:57:27.116082 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 732/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:57:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:57:29.311550 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a4fd9-82a1-4c61-a6ca-68dd72f972f7 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:29.312081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a4fd9-82a1-4c61-a6ca-68dd72f972f7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:29.312081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a4fd9-82a1-4c61-a6ca-68dd72f972f7 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:29.313362 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 10:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:57:29.319403 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229dab4-f43a-49b2-899c-ed857cea5b9a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:29.319808 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229dab4-f43a-49b2-899c-ed857cea5b9a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:29.319962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229dab4-f43a-49b2-899c-ed857cea5b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:29.385710 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5229dab4-f43a-49b2-899c-ed857cea5b9a None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:57:29.386940 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5229dab4-f43a-49b2-899c-ed857cea5b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:29.424538 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:29.482722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 10:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:57:29.521814 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a4fd9-82a1-4c61-a6ca-68dd72f972f7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:57:29.523362 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9a9a4fd9-82a1-4c61-a6ca-68dd72f972f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:29.624470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a4fd9-82a1-4c61-a6ca-68dd72f972f7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:57:29.661660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:29.698671 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0d638-63e4-41da-ad69-eb2ca4c564bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:57:29.699306 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0d638-63e4-41da-ad69-eb2ca4c564bb service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:29.699589 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0d638-63e4-41da-ad69-eb2ca4c564bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:29.699864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0d638-63e4-41da-ad69-eb2ca4c564bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:29.701459 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a6b0d638-63e4-41da-ad69-eb2ca4c564bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:29.809783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0d638-63e4-41da-ad69-eb2ca4c564bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:57:29.811254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0d638-63e4-41da-ad69-eb2ca4c564bb service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:57:29.830130 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 731/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:57:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:57:31.842522 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314750a-004c-4189-af33-ce56aa45452c None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:31.843087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314750a-004c-4189-af33-ce56aa45452c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:31.843087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314750a-004c-4189-af33-ce56aa45452c None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:31.844481 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 10:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:57:31.850394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805059a-22cf-4e33-962a-d30fb053e30d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:31.850853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805059a-22cf-4e33-962a-d30fb053e30d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:31.850963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805059a-22cf-4e33-962a-d30fb053e30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:31.916909 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6805059a-22cf-4e33-962a-d30fb053e30d None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:57:31.918116 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6805059a-22cf-4e33-962a-d30fb053e30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:31.936187 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:32.016851 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 10:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:57:32.055207 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314750a-004c-4189-af33-ce56aa45452c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:57:32.056790 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e314750a-004c-4189-af33-ce56aa45452c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:32.159450 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314750a-004c-4189-af33-ce56aa45452c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:57:32.224526 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:32.231167 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d14dd0-d99c-4e54-98e9-b6d31aba5cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:57:32.231776 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d14dd0-d99c-4e54-98e9-b6d31aba5cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:32.232056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d14dd0-d99c-4e54-98e9-b6d31aba5cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:32.232325 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d14dd0-d99c-4e54-98e9-b6d31aba5cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:32.233914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-67d14dd0-d99c-4e54-98e9-b6d31aba5cd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:32.344473 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d14dd0-d99c-4e54-98e9-b6d31aba5cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:57:32.346904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d14dd0-d99c-4e54-98e9-b6d31aba5cd9 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:57:32.366120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 735/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:57:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:57:34.422876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eb3ae-69fe-42b1-af83-9a3e3ba745e8 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:34.423445 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eb3ae-69fe-42b1-af83-9a3e3ba745e8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:34.423445 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eb3ae-69fe-42b1-af83-9a3e3ba745e8 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:34.425484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 10:57:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:57:34.431010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a154a1-7e61-472f-a4fc-8101b3bb4236 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:34.431417 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a154a1-7e61-472f-a4fc-8101b3bb4236 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:34.431659 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a154a1-7e61-472f-a4fc-8101b3bb4236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:34.496912 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-18a154a1-7e61-472f-a4fc-8101b3bb4236 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:57:34.498098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-18a154a1-7e61-472f-a4fc-8101b3bb4236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:34.545603 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:34.593399 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 10:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:57:34.631070 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170eb3ae-69fe-42b1-af83-9a3e3ba745e8 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:57:34.632627 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-170eb3ae-69fe-42b1-af83-9a3e3ba745e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:34.738849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170eb3ae-69fe-42b1-af83-9a3e3ba745e8 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:57:34.787070 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:34.812230 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4f967-93f0-463f-a467-1198ad594440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:57:34.812836 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4f967-93f0-463f-a467-1198ad594440 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:34.813115 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4f967-93f0-463f-a467-1198ad594440 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:34.813387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4f967-93f0-463f-a467-1198ad594440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:34.815121 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7ae4f967-93f0-463f-a467-1198ad594440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:34.921817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4f967-93f0-463f-a467-1198ad594440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:57:34.923303 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4f967-93f0-463f-a467-1198ad594440 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:57:34.941348 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 734/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:57:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:57:44.591567 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=22 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:44.939128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=66 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:54.606719 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20b9df-43dc-4ce0-9bd6-5fc848570cc0 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:54.607347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20b9df-43dc-4ce0-9bd6-5fc848570cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:54.607347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20b9df-43dc-4ce0-9bd6-5fc848570cc0 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:54.608670 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 737/1471] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:57:54.614463 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d700d9-9404-4bc3-9960-62815b2e9b3b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:54.614920 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d700d9-9404-4bc3-9960-62815b2e9b3b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:54.615058 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d700d9-9404-4bc3-9960-62815b2e9b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:54.680727 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e8d700d9-9404-4bc3-9960-62815b2e9b3b None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:57:54.682147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e8d700d9-9404-4bc3-9960-62815b2e9b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:54.785792 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 735/1472] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:57:54.869673 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4e11f-405f-4f96-8e7c-629225d5f0d9 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:54.869950 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4e11f-405f-4f96-8e7c-629225d5f0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:54.870218 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4e11f-405f-4f96-8e7c-629225d5f0d9 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:54.871572 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 738/1473] 10.222.0.43 () {54 vars in 967 bytes} [Thu Aug 11 10:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:57:54.876905 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45ddc9-dc89-49c9-b05a-ab662359e81c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:54.877194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45ddc9-dc89-49c9-b05a-ab662359e81c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:54.877467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45ddc9-dc89-49c9-b05a-ab662359e81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:54.952455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0d45ddc9-dc89-49c9-b05a-ab662359e81c None None] MFA Rules not processed for user `d4fe013f66e2452eaaf84d4b52eca489`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:57:54.953641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0d45ddc9-dc89-49c9-b05a-ab662359e81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:54.974400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:55.030034 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 736/1474] 10.222.0.43 () {58 vars in 1064 bytes} [Thu Aug 11 10:57:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 10:57:55.037802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4e11f-405f-4f96-8e7c-629225d5f0d9 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:57:55.039392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e6a4e11f-405f-4f96-8e7c-629225d5f0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:55.141960 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a4e11f-405f-4f96-8e7c-629225d5f0d9 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:57:55.213548 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d024a3-2f54-4333-9d1b-9ce7a6fe6342 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fe013f66e2452eaaf84d4b52eca489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:57:55.214146 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d024a3-2f54-4333-9d1b-9ce7a6fe6342 service glance] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:55.214426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d024a3-2f54-4333-9d1b-9ce7a6fe6342 service glance] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:55.214699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d024a3-2f54-4333-9d1b-9ce7a6fe6342 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:55.216318 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e9d024a3-2f54-4333-9d1b-9ce7a6fe6342 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:55.269156 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:55.323390 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d024a3-2f54-4333-9d1b-9ce7a6fe6342 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:57:55.324863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d024a3-2f54-4333-9d1b-9ce7a6fe6342 service glance] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:57:55.343098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 739/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:57:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:57:57.422589 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da715bf-abfe-4086-8967-04aeb7a84faf None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:57.423157 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da715bf-abfe-4086-8967-04aeb7a84faf None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:57.423157 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da715bf-abfe-4086-8967-04aeb7a84faf None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:57.432698 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 737/1476] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:57:57.432801 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cf533-e830-48c6-85f2-08ed8fa2002f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:57.432801 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cf533-e830-48c6-85f2-08ed8fa2002f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:57.432801 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cf533-e830-48c6-85f2-08ed8fa2002f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:57.496849 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-df9cf533-e830-48c6-85f2-08ed8fa2002f None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:57:57.498075 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-df9cf533-e830-48c6-85f2-08ed8fa2002f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:57.593366 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 740/1477] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:57:57.617392 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da715bf-abfe-4086-8967-04aeb7a84faf None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:57:57.618880 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8da715bf-abfe-4086-8967-04aeb7a84faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:57:57.743296 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da715bf-abfe-4086-8967-04aeb7a84faf None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:57:57.792478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:57.837214 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e31c9-8010-4266-8b6e-618f74e73aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:57:57.837819 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e31c9-8010-4266-8b6e-618f74e73aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:57.838101 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e31c9-8010-4266-8b6e-618f74e73aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:57.838376 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e31c9-8010-4266-8b6e-618f74e73aa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:57.839039 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e31c9-8010-4266-8b6e-618f74e73aa6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:57:57.840780 dv-cinder-820027-17-smb devstack@keystone.service[81638]: WARNING py.warnings [None req-780e31c9-8010-4266-8b6e-618f74e73aa6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 10:57:57.840780 dv-cinder-820027-17-smb devstack@keystone.service[81638]: warnings.warn(msg) Aug 11 10:57:57.840780 dv-cinder-820027-17-smb devstack@keystone.service[81638]: Aug 11 10:57:57.841927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e31c9-8010-4266-8b6e-618f74e73aa6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:57:57.860558 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 738/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Aug 11 10:57:57 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 10:57:59.877362 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e565c4c-f099-48ea-9d18-75999ee951fd None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:59.877947 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e565c4c-f099-48ea-9d18-75999ee951fd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:59.877947 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e565c4c-f099-48ea-9d18-75999ee951fd None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:59.879288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 741/1479] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:57:59.884348 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c498869-3582-47fd-aa07-4b7dd1846653 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:57:59.884743 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c498869-3582-47fd-aa07-4b7dd1846653 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:57:59.884905 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c498869-3582-47fd-aa07-4b7dd1846653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:57:59.949584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0c498869-3582-47fd-aa07-4b7dd1846653 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:57:59.950820 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0c498869-3582-47fd-aa07-4b7dd1846653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:58:00.051379 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 739/1480] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:58:00.093687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e565c4c-f099-48ea-9d18-75999ee951fd None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:58:00.095852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0e565c4c-f099-48ea-9d18-75999ee951fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:58:00.105600 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:58:00.240353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e565c4c-f099-48ea-9d18-75999ee951fd None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:58:00.324392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:58:00.356341 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417cc3d-a33f-4acd-baa1-ab308e16536f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:58:00.356940 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417cc3d-a33f-4acd-baa1-ab308e16536f service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:58:00.357215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417cc3d-a33f-4acd-baa1-ab308e16536f service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:58:00.357484 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417cc3d-a33f-4acd-baa1-ab308e16536f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:58:00.359094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0417cc3d-a33f-4acd-baa1-ab308e16536f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:58:00.446092 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417cc3d-a33f-4acd-baa1-ab308e16536f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:58:00.447732 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417cc3d-a33f-4acd-baa1-ab308e16536f service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:58:00.465943 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 742/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:58:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:58:02.651517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42725cce-a831-42f6-9d84-febdeac5d852 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:58:02.652086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42725cce-a831-42f6-9d84-febdeac5d852 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:58:02.652086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42725cce-a831-42f6-9d84-febdeac5d852 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:58:02.653453 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 740/1482] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:58:02.658961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c6d05-9ee8-4b10-b0dd-ce1c46b69141 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:58:02.659368 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c6d05-9ee8-4b10-b0dd-ce1c46b69141 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:58:02.659508 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c6d05-9ee8-4b10-b0dd-ce1c46b69141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:58:02.724219 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1b0c6d05-9ee8-4b10-b0dd-ce1c46b69141 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:58:02.725443 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1b0c6d05-9ee8-4b10-b0dd-ce1c46b69141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:58:02.772332 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:58:02.821724 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 743/1483] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:58:02.859560 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42725cce-a831-42f6-9d84-febdeac5d852 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:58:02.861855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-42725cce-a831-42f6-9d84-febdeac5d852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:58:02.885551 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:58:02.963555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42725cce-a831-42f6-9d84-febdeac5d852 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:58:03.036050 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00760ef8-0385-4512-81a7-d0763489e27f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:58:03.036667 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00760ef8-0385-4512-81a7-d0763489e27f service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:58:03.036948 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00760ef8-0385-4512-81a7-d0763489e27f service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:58:03.037224 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00760ef8-0385-4512-81a7-d0763489e27f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:58:03.038882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-00760ef8-0385-4512-81a7-d0763489e27f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:58:03.116436 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:58:03.155013 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00760ef8-0385-4512-81a7-d0763489e27f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:58:03.157040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00760ef8-0385-4512-81a7-d0763489e27f service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:58:03.176908 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 741/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:58:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:58:05.280805 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73871d9-6952-4772-8856-e29afb420051 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:58:05.281965 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73871d9-6952-4772-8856-e29afb420051 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:58:05.281965 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73871d9-6952-4772-8856-e29afb420051 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:58:05.283279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 744/1485] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:58:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 10:58:05.288578 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f239ab1-c80c-49f7-b9c7-630888158efd None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:58:05.289001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f239ab1-c80c-49f7-b9c7-630888158efd None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:58:05.289115 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f239ab1-c80c-49f7-b9c7-630888158efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:58:05.354174 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1f239ab1-c80c-49f7-b9c7-630888158efd None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:58:05.355406 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1f239ab1-c80c-49f7-b9c7-630888158efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:58:05.452333 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 742/1486] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:58:05.491430 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73871d9-6952-4772-8856-e29afb420051 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:58:05.492981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e73871d9-6952-4772-8856-e29afb420051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:58:05.593730 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73871d9-6952-4772-8856-e29afb420051 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:58:05.664741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:58:05.666494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f25bcd-c15f-42fa-945a-2ed902f76668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:58:05.667132 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f25bcd-c15f-42fa-945a-2ed902f76668 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:58:05.667414 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f25bcd-c15f-42fa-945a-2ed902f76668 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:58:05.667711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f25bcd-c15f-42fa-945a-2ed902f76668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:58:05.669304 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c4f25bcd-c15f-42fa-945a-2ed902f76668 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:58:05.777577 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f25bcd-c15f-42fa-945a-2ed902f76668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:58:05.779033 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f25bcd-c15f-42fa-945a-2ed902f76668 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:58:05.797161 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 745/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:58:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:58:07.890041 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744dfe0-90d4-460a-a28c-98890643d023 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:58:07.891155 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744dfe0-90d4-460a-a28c-98890643d023 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:58:07.891155 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744dfe0-90d4-460a-a28c-98890643d023 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:58:07.892783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 743/1488] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:58:07.898114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a9ee8-dc1b-4e04-949a-f3b035b98f36 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:58:07.898583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a9ee8-dc1b-4e04-949a-f3b035b98f36 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:58:07.898677 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a9ee8-dc1b-4e04-949a-f3b035b98f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:58:07.963347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ce3a9ee8-dc1b-4e04-949a-f3b035b98f36 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:58:07.964562 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ce3a9ee8-dc1b-4e04-949a-f3b035b98f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:58:08.015517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:58:08.060393 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 746/1489] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:58:08.101336 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744dfe0-90d4-460a-a28c-98890643d023 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:58:08.102929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5744dfe0-90d4-460a-a28c-98890643d023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:58:08.139408 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:58:08.208262 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744dfe0-90d4-460a-a28c-98890643d023 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:58:08.279595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c6f1a-6f70-4a4c-9da4-99e2467d2390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:58:08.280194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c6f1a-6f70-4a4c-9da4-99e2467d2390 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:58:08.280472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c6f1a-6f70-4a4c-9da4-99e2467d2390 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:58:08.280742 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c6f1a-6f70-4a4c-9da4-99e2467d2390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:58:08.282634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9f1c6f1a-6f70-4a4c-9da4-99e2467d2390 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:58:08.363827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:58:08.392830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c6f1a-6f70-4a4c-9da4-99e2467d2390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:58:08.394340 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c6f1a-6f70-4a4c-9da4-99e2467d2390 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:58:08.413571 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 744/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:58:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:58:10.892346 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1319a-4804-44f0-9c90-54e52778a27e None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:58:10.892934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1319a-4804-44f0-9c90-54e52778a27e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:58:10.892934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1319a-4804-44f0-9c90-54e52778a27e None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:58:10.894215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 747/1491] 10.222.0.43 () {54 vars in 927 bytes} [Thu Aug 11 10:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 10:58:10.899461 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56096b0e-58d6-4205-9625-a5fe45d295ff None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:58:10.899894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56096b0e-58d6-4205-9625-a5fe45d295ff None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:58:10.900047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56096b0e-58d6-4205-9625-a5fe45d295ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:58:10.965059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-56096b0e-58d6-4205-9625-a5fe45d295ff None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 10:58:10.966255 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-56096b0e-58d6-4205-9625-a5fe45d295ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:58:11.060916 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 745/1492] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Aug 11 10:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 10:58:11.101654 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1319a-4804-44f0-9c90-54e52778a27e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 10:58:11.103274 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-22e1319a-4804-44f0-9c90-54e52778a27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:58:11.205846 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1319a-4804-44f0-9c90-54e52778a27e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 10:58:11.277971 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7dcb0-f1b1-4418-a9ea-12715e7c79f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 10:58:11.278579 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7dcb0-f1b1-4418-a9ea-12715e7c79f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 10:58:11.278891 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7dcb0-f1b1-4418-a9ea-12715e7c79f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 10:58:11.279161 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7dcb0-f1b1-4418-a9ea-12715e7c79f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 10:58:11.280757 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-cee7dcb0-f1b1-4418-a9ea-12715e7c79f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 10:58:11.290199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:58:11.387735 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7dcb0-f1b1-4418-a9ea-12715e7c79f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 10:58:11.389189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7dcb0-f1b1-4418-a9ea-12715e7c79f3 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 10:58:11.407219 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 748/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 10:58:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 10:58:21.059106 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=82 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:58:21.404423 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=50 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:00:08.098093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de0836-e12f-48e8-8b61-79fbcb8b74e8 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:00:08.098614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de0836-e12f-48e8-8b61-79fbcb8b74e8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:00:08.098720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de0836-e12f-48e8-8b61-79fbcb8b74e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:00:08.179241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-75de0836-e12f-48e8-8b61-79fbcb8b74e8 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:00:08.180436 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-75de0836-e12f-48e8-8b61-79fbcb8b74e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:00:08.281966 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 746/1494] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:00:08.290398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5df8bd-909f-40fe-98bf-fe26bc249596 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:00:08.290919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5df8bd-909f-40fe-98bf-fe26bc249596 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:00:08.291066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5df8bd-909f-40fe-98bf-fe26bc249596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:00:08.311071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-da5df8bd-909f-40fe-98bf-fe26bc249596 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:00:08.313032 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-da5df8bd-909f-40fe-98bf-fe26bc249596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:00:08.321638 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 749/1495] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:00:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:00:08.326446 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de0836-e12f-48e8-8b61-79fbcb8b74e8 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:00:08.339587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de0836-e12f-48e8-8b61-79fbcb8b74e8 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:00:08.342410 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f23d7d-3992-4a2e-a481-375950661e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:00:08.343312 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f23d7d-3992-4a2e-a481-375950661e5f admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:00:08.343600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f23d7d-3992-4a2e-a481-375950661e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:00:08.343879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f23d7d-3992-4a2e-a481-375950661e5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:00:08.344529 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f23d7d-3992-4a2e-a481-375950661e5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:00:08.344837 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f23d7d-3992-4a2e-a481-375950661e5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:00:08.345859 dv-cinder-820027-17-smb devstack@keystone.service[81638]: WARNING py.warnings [None req-81f23d7d-3992-4a2e-a481-375950661e5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 11:00:08.345859 dv-cinder-820027-17-smb devstack@keystone.service[81638]: warnings.warn(msg) Aug 11 11:00:08.345859 dv-cinder-820027-17-smb devstack@keystone.service[81638]: Aug 11 11:00:08.346823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f23d7d-3992-4a2e-a481-375950661e5f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:00:08.359151 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 747/1496] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:00:08.367807 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5df8bd-909f-40fe-98bf-fe26bc249596 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:00:08.377620 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5df8bd-909f-40fe-98bf-fe26bc249596 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:00:08.382253 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a560b-2af0-4a60-ab9f-ca29ddb37b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:00:08.382884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a560b-2af0-4a60-ab9f-ca29ddb37b4b admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:00:08.383167 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a560b-2af0-4a60-ab9f-ca29ddb37b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:00:08.383438 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a560b-2af0-4a60-ab9f-ca29ddb37b4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:00:08.384071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a560b-2af0-4a60-ab9f-ca29ddb37b4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:00:08.385806 dv-cinder-820027-17-smb devstack@keystone.service[81639]: WARNING py.warnings [None req-cb8a560b-2af0-4a60-ab9f-ca29ddb37b4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 11:00:08.385806 dv-cinder-820027-17-smb devstack@keystone.service[81639]: warnings.warn(msg) Aug 11 11:00:08.385806 dv-cinder-820027-17-smb devstack@keystone.service[81639]: Aug 11 11:00:08.387021 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a560b-2af0-4a60-ab9f-ca29ddb37b4b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:00:08.550501 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 750/1497] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:00:08 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:00:08.554741 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f23d7d-3992-4a2e-a481-375950661e5f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:00:08.565986 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f23d7d-3992-4a2e-a481-375950661e5f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:00:08.614771 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:00:08.621480 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b202f24-87d4-4ef0-b0f1-c5ce37a3d4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:00:08.622079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b202f24-87d4-4ef0-b0f1-c5ce37a3d4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:00:08.622359 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b202f24-87d4-4ef0-b0f1-c5ce37a3d4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:00:08.622649 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b202f24-87d4-4ef0-b0f1-c5ce37a3d4d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:00:08.623286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b202f24-87d4-4ef0-b0f1-c5ce37a3d4d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:00:08.625010 dv-cinder-820027-17-smb devstack@keystone.service[81638]: WARNING py.warnings [None req-7b202f24-87d4-4ef0-b0f1-c5ce37a3d4d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 11:00:08.625010 dv-cinder-820027-17-smb devstack@keystone.service[81638]: warnings.warn(msg) Aug 11 11:00:08.625010 dv-cinder-820027-17-smb devstack@keystone.service[81638]: Aug 11 11:00:08.626234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b202f24-87d4-4ef0-b0f1-c5ce37a3d4d2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:00:08.735390 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 748/1498] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:00:08 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:00:08.739409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a560b-2af0-4a60-ab9f-ca29ddb37b4b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:00:08.749998 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a560b-2af0-4a60-ab9f-ca29ddb37b4b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:00:08.754718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0278d2e-aef1-45e8-83c4-8e453c4f2546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:00:08.755390 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0278d2e-aef1-45e8-83c4-8e453c4f2546 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:00:08.755675 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0278d2e-aef1-45e8-83c4-8e453c4f2546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:00:08.755949 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0278d2e-aef1-45e8-83c4-8e453c4f2546 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:00:08.756592 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0278d2e-aef1-45e8-83c4-8e453c4f2546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:00:08.757607 dv-cinder-820027-17-smb devstack@keystone.service[81639]: WARNING py.warnings [None req-a0278d2e-aef1-45e8-83c4-8e453c4f2546 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 11:00:08.757607 dv-cinder-820027-17-smb devstack@keystone.service[81639]: warnings.warn(msg) Aug 11 11:00:08.757607 dv-cinder-820027-17-smb devstack@keystone.service[81639]: Aug 11 11:00:08.758491 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0278d2e-aef1-45e8-83c4-8e453c4f2546 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:00:08.771681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 751/1499] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:00:08.775681 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b202f24-87d4-4ef0-b0f1-c5ce37a3d4d2 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:00:08.785956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b202f24-87d4-4ef0-b0f1-c5ce37a3d4d2 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:00:08.790415 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b6191-53e3-43f6-8099-0ab8b7c8ee6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:00:08.791047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b6191-53e3-43f6-8099-0ab8b7c8ee6c admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:00:08.791329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b6191-53e3-43f6-8099-0ab8b7c8ee6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:00:08.791595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b6191-53e3-43f6-8099-0ab8b7c8ee6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:00:08.792221 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b6191-53e3-43f6-8099-0ab8b7c8ee6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:00:08.793221 dv-cinder-820027-17-smb devstack@keystone.service[81638]: WARNING py.warnings [None req-e09b6191-53e3-43f6-8099-0ab8b7c8ee6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 11:00:08.793221 dv-cinder-820027-17-smb devstack@keystone.service[81638]: warnings.warn(msg) Aug 11 11:00:08.793221 dv-cinder-820027-17-smb devstack@keystone.service[81638]: Aug 11 11:00:08.794092 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b6191-53e3-43f6-8099-0ab8b7c8ee6c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:00:08.807853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 749/1500] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:00:08.811979 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0278d2e-aef1-45e8-83c4-8e453c4f2546 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:00:08.821694 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0278d2e-aef1-45e8-83c4-8e453c4f2546 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:00:08.826601 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17ce98-40fe-48f5-aa05-d811262d8bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:00:08.827355 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17ce98-40fe-48f5-aa05-d811262d8bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:00:08.827630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17ce98-40fe-48f5-aa05-d811262d8bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:00:08.827908 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17ce98-40fe-48f5-aa05-d811262d8bf7 admin admin] PATH_INFO: `/v3/projects/78e6cbd27a884a98b974565edfd884cf/users/1a0e3f7576e543459306dac3c9168883/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:00:08.841920 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17ce98-40fe-48f5-aa05-d811262d8bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78e6cbd27a884a98b974565edfd884cf, user_id=1a0e3f7576e543459306dac3c9168883, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:00:08.843557 dv-cinder-820027-17-smb devstack@keystone.service[81639]: WARNING py.warnings [None req-7a17ce98-40fe-48f5-aa05-d811262d8bf7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 11:00:08.843557 dv-cinder-820027-17-smb devstack@keystone.service[81639]: warnings.warn(msg) Aug 11 11:00:08.843557 dv-cinder-820027-17-smb devstack@keystone.service[81639]: Aug 11 11:00:08.845474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17ce98-40fe-48f5-aa05-d811262d8bf7 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:00:08.908886 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 752/1501] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:00:08 2022] PUT /identity/v3/projects/78e6cbd27a884a98b974565edfd884cf/users/1a0e3f7576e543459306dac3c9168883/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:00:08.921867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da2f83-e544-4a0a-a05d-8032df4d3b33 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:00:08.922251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da2f83-e544-4a0a-a05d-8032df4d3b33 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:00:08.922535 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da2f83-e544-4a0a-a05d-8032df4d3b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:00:08.950410 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f0da2f83-e544-4a0a-a05d-8032df4d3b33 None None] MFA Rules not processed for user `1a0e3f7576e543459306dac3c9168883`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:00:08.951660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f0da2f83-e544-4a0a-a05d-8032df4d3b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:00:09.018073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 750/1502] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:00:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:00:09.035327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529133d6-f832-47c5-ba26-1924cc12a374 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:00:09.035567 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529133d6-f832-47c5-ba26-1924cc12a374 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:00:09.035840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529133d6-f832-47c5-ba26-1924cc12a374 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:00:09.037156 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 753/1503] 10.222.0.43 () {54 vars in 964 bytes} [Thu Aug 11 11:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:00:09.042333 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4496b4b-572b-48b8-8640-27188e7ca5a5 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:00:09.042619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4496b4b-572b-48b8-8640-27188e7ca5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:00:09.042926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4496b4b-572b-48b8-8640-27188e7ca5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:00:09.101908 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b4496b4b-572b-48b8-8640-27188e7ca5a5 None None] MFA Rules not processed for user `85551eadb87f496f882c4d6e984144c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:00:09.103150 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b4496b4b-572b-48b8-8640-27188e7ca5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:00:09.179814 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 751/1504] 10.222.0.43 () {58 vars in 1061 bytes} [Thu Aug 11 11:00:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:00:09.188627 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529133d6-f832-47c5-ba26-1924cc12a374 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:00:09.199180 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529133d6-f832-47c5-ba26-1924cc12a374 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:00:09.202688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbd245-aa76-4b93-9abe-69ec7b5c76c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:00:09.203316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbd245-aa76-4b93-9abe-69ec7b5c76c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:00:09.203599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbd245-aa76-4b93-9abe-69ec7b5c76c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:00:09.203871 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbd245-aa76-4b93-9abe-69ec7b5c76c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:00:09.211930 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbd245-aa76-4b93-9abe-69ec7b5c76c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:00:09.213349 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbd245-aa76-4b93-9abe-69ec7b5c76c5 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:00:09.222157 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 754/1505] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:00:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:00:09.267731 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4cc32-23d0-4fad-a446-13561031d6f5 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:00:09.268054 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4cc32-23d0-4fad-a446-13561031d6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:00:09.268335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4cc32-23d0-4fad-a446-13561031d6f5 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:00:09.269586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 752/1506] 10.222.0.43 () {52 vars in 830 bytes} [Thu Aug 11 11:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:00:09.273206 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbd245-aa76-4b93-9abe-69ec7b5c76c5 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:00:09.333523 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbd245-aa76-4b93-9abe-69ec7b5c76c5 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:00:09.338132 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd5b34-60d3-4022-810d-f456a809e679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:00:09.338742 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd5b34-60d3-4022-810d-f456a809e679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:00:09.339049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd5b34-60d3-4022-810d-f456a809e679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:00:09.339321 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd5b34-60d3-4022-810d-f456a809e679 admin admin] PATH_INFO: `/v3/users/1a0e3f7576e543459306dac3c9168883` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:00:09.340439 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd5b34-60d3-4022-810d-f456a809e679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a0e3f7576e543459306dac3c9168883)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:00:09.341459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: WARNING py.warnings [None req-19dd5b34-60d3-4022-810d-f456a809e679 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 11:00:09.341459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: warnings.warn(msg) Aug 11 11:00:09.341459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: Aug 11 11:00:09.342681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd5b34-60d3-4022-810d-f456a809e679 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:00:09.584731 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-19dd5b34-60d3-4022-810d-f456a809e679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a0e3f7576e543459306dac3c9168883'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:00:09.585446 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-19dd5b34-60d3-4022-810d-f456a809e679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a0e3f7576e543459306dac3c9168883'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:00:09.609122 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-19dd5b34-60d3-4022-810d-f456a809e679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a0e3f7576e543459306dac3c9168883'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:00:09.622532 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-19dd5b34-60d3-4022-810d-f456a809e679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a0e3f7576e543459306dac3c9168883'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:00:09.626437 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:00:09.704995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-19dd5b34-60d3-4022-810d-f456a809e679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a0e3f7576e543459306dac3c9168883'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:00:09.713503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 755/1507] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:00:09 2022] DELETE /identity/v3/users/1a0e3f7576e543459306dac3c9168883 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:00:09.718806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d8005-cc53-4b41-a24f-aea7944a8ad1 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:00:09.718943 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d8005-cc53-4b41-a24f-aea7944a8ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:00:09.719156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d8005-cc53-4b41-a24f-aea7944a8ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:00:09.738956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-930d8005-cc53-4b41-a24f-aea7944a8ad1 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:00:09.740160 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-930d8005-cc53-4b41-a24f-aea7944a8ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:00:09.749544 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:00:09.800205 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 753/1508] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:00:09.809836 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd5b34-60d3-4022-810d-f456a809e679 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:00:09.811304 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-19dd5b34-60d3-4022-810d-f456a809e679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:00:09.887648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd5b34-60d3-4022-810d-f456a809e679 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:00:09.891316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f44dc4-799f-44bb-8b13-98760ef45712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:00:09.891917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f44dc4-799f-44bb-8b13-98760ef45712 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:00:09.892196 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f44dc4-799f-44bb-8b13-98760ef45712 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:00:09.892470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f44dc4-799f-44bb-8b13-98760ef45712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:00:09.901279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f44dc4-799f-44bb-8b13-98760ef45712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:00:09.902708 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f44dc4-799f-44bb-8b13-98760ef45712 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:00:09.912043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 756/1509] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:00:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:00:10.378389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d8005-cc53-4b41-a24f-aea7944a8ad1 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:00:10.379973 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-930d8005-cc53-4b41-a24f-aea7944a8ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:00:10.392256 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d8005-cc53-4b41-a24f-aea7944a8ad1 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:00:10.399418 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74963a-eea7-42d5-9fc6-3e15cdb36b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:00:10.400103 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74963a-eea7-42d5-9fc6-3e15cdb36b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:00:10.400385 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74963a-eea7-42d5-9fc6-3e15cdb36b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:00:10.400996 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74963a-eea7-42d5-9fc6-3e15cdb36b42 admin admin] PATH_INFO: `/v3/projects/78e6cbd27a884a98b974565edfd884cf` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:00:10.402311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74963a-eea7-42d5-9fc6-3e15cdb36b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78e6cbd27a884a98b974565edfd884cf)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:00:10.403799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: WARNING py.warnings [None req-1a74963a-eea7-42d5-9fc6-3e15cdb36b42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 11:00:10.403799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: warnings.warn(msg) Aug 11 11:00:10.403799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: Aug 11 11:00:10.405482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74963a-eea7-42d5-9fc6-3e15cdb36b42 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:00:10.530521 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1a74963a-eea7-42d5-9fc6-3e15cdb36b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78e6cbd27a884a98b974565edfd884cf', 'request_id': 'req-1a74963a-eea7-42d5-9fc6-3e15cdb36b42'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:00:10.536638 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1a74963a-eea7-42d5-9fc6-3e15cdb36b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78e6cbd27a884a98b974565edfd884cf', 'request_id': 'req-1a74963a-eea7-42d5-9fc6-3e15cdb36b42'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:00:10.550281 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1a74963a-eea7-42d5-9fc6-3e15cdb36b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78e6cbd27a884a98b974565edfd884cf', 'request_id': 'req-1a74963a-eea7-42d5-9fc6-3e15cdb36b42'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:00:10.643392 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1a74963a-eea7-42d5-9fc6-3e15cdb36b42 admin admin] The token cache is being invalidate because project 78e6cbd27a884a98b974565edfd884cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:00:10.643613 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1a74963a-eea7-42d5-9fc6-3e15cdb36b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:00:10.644335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1a74963a-eea7-42d5-9fc6-3e15cdb36b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:00:10.645826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 754/1510] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:00:10 2022] DELETE /identity/v3/projects/78e6cbd27a884a98b974565edfd884cf => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:00:19.907999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:00:20.639313 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:01:46.690918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cb916-a4fc-403c-ba31-bec93f73478d None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:01:46.691522 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cb916-a4fc-403c-ba31-bec93f73478d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:01:46.691522 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62cb916-a4fc-403c-ba31-bec93f73478d None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:01:46.692857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 11:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:01:46.697793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd08b70-d8d2-4238-a102-ff7a6d7fab1a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:01:46.698247 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd08b70-d8d2-4238-a102-ff7a6d7fab1a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:01:46.698361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd08b70-d8d2-4238-a102-ff7a6d7fab1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:01:46.717919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7fd08b70-d8d2-4238-a102-ff7a6d7fab1a None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:01:46.719275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7fd08b70-d8d2-4238-a102-ff7a6d7fab1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:01:46.780183 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 11:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:01:46.935138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cb916-a4fc-403c-ba31-bec93f73478d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:01:46.936851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e62cb916-a4fc-403c-ba31-bec93f73478d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:01:47.039898 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62cb916-a4fc-403c-ba31-bec93f73478d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:01:47.046131 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cf838-909a-4f35-bfd0-080dd5cb0ce0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:01:47.052857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cf838-909a-4f35-bfd0-080dd5cb0ce0 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:01:47.052857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cf838-909a-4f35-bfd0-080dd5cb0ce0 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:01:47.052857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cf838-909a-4f35-bfd0-080dd5cb0ce0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:01:47.056696 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cf838-909a-4f35-bfd0-080dd5cb0ce0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:01:47.058280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cf838-909a-4f35-bfd0-080dd5cb0ce0 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:01:47.068352 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 758/1513] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:01:47.902820 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d64340-a054-4623-b83a-71d5862298a7 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:01:47.903351 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d64340-a054-4623-b83a-71d5862298a7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:01:47.903351 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d64340-a054-4623-b83a-71d5862298a7 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:01:47.904705 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 11:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:01:47.910327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc6648-b4c8-4849-a2ad-9bd7049a3663 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:01:47.910731 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc6648-b4c8-4849-a2ad-9bd7049a3663 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:01:47.910913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc6648-b4c8-4849-a2ad-9bd7049a3663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:01:47.930180 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c6cc6648-b4c8-4849-a2ad-9bd7049a3663 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:01:47.931438 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c6cc6648-b4c8-4849-a2ad-9bd7049a3663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:01:47.939739 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 11:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:01:48.091763 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d64340-a054-4623-b83a-71d5862298a7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:01:48.105773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d64340-a054-4623-b83a-71d5862298a7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:01:48.111404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83543d-6359-42c6-9887-9b9b93af61c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:01:48.112250 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83543d-6359-42c6-9887-9b9b93af61c6 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:01:48.112526 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83543d-6359-42c6-9887-9b9b93af61c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:01:48.112795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83543d-6359-42c6-9887-9b9b93af61c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:01:48.120603 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83543d-6359-42c6-9887-9b9b93af61c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:01:48.122158 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83543d-6359-42c6-9887-9b9b93af61c6 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:01:48.131779 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 757/1516] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:01:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:01:48.659345 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fabe3e-51e6-4eca-8207-fa4ce02ad58b None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:01:48.659633 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fabe3e-51e6-4eca-8207-fa4ce02ad58b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:01:48.659913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fabe3e-51e6-4eca-8207-fa4ce02ad58b None None] PATH_INFO: `/v3` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:01:48.661178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 760/1517] 10.222.0.47 () {54 vars in 925 bytes} [Thu Aug 11 11:01:48 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:01:48.667718 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e3faf-a7c8-434b-869c-ba463ae51e02 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:01:48.667972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e3faf-a7c8-434b-869c-ba463ae51e02 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:01:48.668245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e3faf-a7c8-434b-869c-ba463ae51e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:01:48.716726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-029e3faf-a7c8-434b-869c-ba463ae51e02 None None] MFA Rules not processed for user `4db99589bb504e8fa4068925badf3942`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:01:48.717915 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-029e3faf-a7c8-434b-869c-ba463ae51e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:01:48.789361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 758/1518] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Aug 11 11:01:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:01:57.925460 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=49 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:01:58.072057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7d7a9-39b8-476d-b503-7ee4171a8bc0 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:01:58.072278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7d7a9-39b8-476d-b503-7ee4171a8bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:01:58.072549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7d7a9-39b8-476d-b503-7ee4171a8bc0 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:01:58.073964 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 761/1519] 10.222.0.43 () {54 vars in 961 bytes} [Thu Aug 11 11:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:01:58.078823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068592f-4010-4097-8493-9b68a374eede None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:01:58.079465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068592f-4010-4097-8493-9b68a374eede None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:01:58.079465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068592f-4010-4097-8493-9b68a374eede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:01:58.098461 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6068592f-4010-4097-8493-9b68a374eede None None] MFA Rules not processed for user `4db99589bb504e8fa4068925badf3942`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:01:58.099708 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6068592f-4010-4097-8493-9b68a374eede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:01:58.108157 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 759/1520] 10.222.0.43 () {58 vars in 1058 bytes} [Thu Aug 11 11:01:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:01:58.116733 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7d7a9-39b8-476d-b503-7ee4171a8bc0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:01:58.131040 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7d7a9-39b8-476d-b503-7ee4171a8bc0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:01:58.136021 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158589ee-202f-4f13-a258-6ef2c0af7403 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db99589bb504e8fa4068925badf3942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:01:58.136608 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158589ee-202f-4f13-a258-6ef2c0af7403 service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:01:58.136890 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158589ee-202f-4f13-a258-6ef2c0af7403 service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:01:58.137161 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158589ee-202f-4f13-a258-6ef2c0af7403 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:01:58.145479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158589ee-202f-4f13-a258-6ef2c0af7403 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:01:58.147076 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158589ee-202f-4f13-a258-6ef2c0af7403 service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:01:58.156527 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 762/1521] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:01:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:01:59.359771 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f67676-8cc3-4499-8de2-5746795cb15d None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:01:59.360368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f67676-8cc3-4499-8de2-5746795cb15d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:01:59.360515 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f67676-8cc3-4499-8de2-5746795cb15d None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:01:59.362104 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 11:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:01:59.366864 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdd7f6-aa79-44db-b4d9-f9268e6e2614 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:01:59.367272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdd7f6-aa79-44db-b4d9-f9268e6e2614 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:01:59.367410 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdd7f6-aa79-44db-b4d9-f9268e6e2614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:01:59.387077 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c1cdd7f6-aa79-44db-b4d9-f9268e6e2614 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:01:59.388286 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c1cdd7f6-aa79-44db-b4d9-f9268e6e2614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:01:59.397215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 11:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:01:59.550048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f67676-8cc3-4499-8de2-5746795cb15d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:01:59.564691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f67676-8cc3-4499-8de2-5746795cb15d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:01:59.569956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dad15-0d9a-425f-9c14-d4788386c821 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:01:59.570545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dad15-0d9a-425f-9c14-d4788386c821 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:01:59.570861 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dad15-0d9a-425f-9c14-d4788386c821 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:01:59.571132 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dad15-0d9a-425f-9c14-d4788386c821 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:01:59.579401 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82dad15-0d9a-425f-9c14-d4788386c821 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:01:59.580951 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82dad15-0d9a-425f-9c14-d4788386c821 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:01:59.590454 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 761/1524] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:01:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:02:00.415288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591b98b-4df7-461f-b9ff-5f78a51a59d1 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:02:00.415736 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591b98b-4df7-461f-b9ff-5f78a51a59d1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:02:00.415858 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591b98b-4df7-461f-b9ff-5f78a51a59d1 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:02:00.417184 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 11 11:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:02:00.422022 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66321e8-379c-4166-b145-300d294e7d77 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:02:00.422952 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66321e8-379c-4166-b145-300d294e7d77 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:02:00.423168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66321e8-379c-4166-b145-300d294e7d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:02:00.442784 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c66321e8-379c-4166-b145-300d294e7d77 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:02:00.444003 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c66321e8-379c-4166-b145-300d294e7d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:02:00.451804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 11 11:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:02:00.607516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591b98b-4df7-461f-b9ff-5f78a51a59d1 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:02:00.623096 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591b98b-4df7-461f-b9ff-5f78a51a59d1 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:02:00.629277 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1248b-5653-41a9-9771-c5e1798678fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:02:00.629870 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1248b-5653-41a9-9771-c5e1798678fc service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:02:00.630152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1248b-5653-41a9-9771-c5e1798678fc service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:02:00.630424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1248b-5653-41a9-9771-c5e1798678fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:02:00.638460 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1248b-5653-41a9-9771-c5e1798678fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:02:00.640097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1248b-5653-41a9-9771-c5e1798678fc service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:02:00.649505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 765/1527] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:02:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:02:04.474937 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe3e24-9d31-4e55-9c0b-25fda105f9f5 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:02:04.475479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe3e24-9d31-4e55-9c0b-25fda105f9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:02:04.475603 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe3e24-9d31-4e55-9c0b-25fda105f9f5 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:02:04.476873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 11:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:02:04.482037 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d32723-4544-4659-bcba-30aea6700a56 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:02:04.482481 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d32723-4544-4659-bcba-30aea6700a56 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:02:04.482587 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d32723-4544-4659-bcba-30aea6700a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:02:04.502364 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-b3d32723-4544-4659-bcba-30aea6700a56 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:02:04.503577 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b3d32723-4544-4659-bcba-30aea6700a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:02:04.511289 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 11:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:02:04.584288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe3e24-9d31-4e55-9c0b-25fda105f9f5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:02:04.585975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6cbe3e24-9d31-4e55-9c0b-25fda105f9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:02:04.614654 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:02:04.644211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe3e24-9d31-4e55-9c0b-25fda105f9f5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:02:04.648116 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d9e8d-7c38-45a9-b4cd-8d01bddd53f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:02:04.648721 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d9e8d-7c38-45a9-b4cd-8d01bddd53f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:02:04.649001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d9e8d-7c38-45a9-b4cd-8d01bddd53f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:02:04.649272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d9e8d-7c38-45a9-b4cd-8d01bddd53f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:02:04.658958 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d9e8d-7c38-45a9-b4cd-8d01bddd53f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:02:04.660402 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d9e8d-7c38-45a9-b4cd-8d01bddd53f7 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:02:04.669519 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 764/1530] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:02:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:02:06.729492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea004dcf-a25e-488c-a3bf-ecf95a18f984 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:02:06.730065 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea004dcf-a25e-488c-a3bf-ecf95a18f984 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:02:06.730065 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea004dcf-a25e-488c-a3bf-ecf95a18f984 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:02:06.731417 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 11:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:02:06.737576 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ddbc4-bb86-45aa-988c-1af1d8299c11 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:02:06.737979 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ddbc4-bb86-45aa-988c-1af1d8299c11 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:02:06.738129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ddbc4-bb86-45aa-988c-1af1d8299c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:02:06.759091 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-626ddbc4-bb86-45aa-988c-1af1d8299c11 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:02:06.760295 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-626ddbc4-bb86-45aa-988c-1af1d8299c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:02:06.768242 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 11:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:02:06.805962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea004dcf-a25e-488c-a3bf-ecf95a18f984 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:02:06.816632 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea004dcf-a25e-488c-a3bf-ecf95a18f984 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:02:06.820076 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85802a-9af9-4632-8ff2-2a80037a2572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:02:06.820668 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85802a-9af9-4632-8ff2-2a80037a2572 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:02:06.820946 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85802a-9af9-4632-8ff2-2a80037a2572 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:02:06.821214 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85802a-9af9-4632-8ff2-2a80037a2572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:02:06.829996 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85802a-9af9-4632-8ff2-2a80037a2572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:02:06.831444 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85802a-9af9-4632-8ff2-2a80037a2572 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:02:06.840510 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 768/1533] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:02:10.399903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ea70a-7192-48a3-950f-438b25517805 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:02:10.400456 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ea70a-7192-48a3-950f-438b25517805 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:02:10.400456 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ea70a-7192-48a3-950f-438b25517805 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:02:10.401858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 11:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:02:10.407092 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d58701-5af7-427d-a4cf-35d04852de7d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:02:10.407537 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d58701-5af7-427d-a4cf-35d04852de7d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:02:10.407633 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d58701-5af7-427d-a4cf-35d04852de7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:02:10.426222 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-51d58701-5af7-427d-a4cf-35d04852de7d None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:02:10.427424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-51d58701-5af7-427d-a4cf-35d04852de7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:02:10.435010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 11:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:02:10.743264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ea70a-7192-48a3-950f-438b25517805 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:02:10.745026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-da7ea70a-7192-48a3-950f-438b25517805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:02:10.802908 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ea70a-7192-48a3-950f-438b25517805 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:02:10.806458 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac46bac-6ced-4cc4-b958-96e2ffe016e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:02:10.807092 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac46bac-6ced-4cc4-b958-96e2ffe016e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:02:10.807377 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac46bac-6ced-4cc4-b958-96e2ffe016e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:02:10.807652 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac46bac-6ced-4cc4-b958-96e2ffe016e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:02:10.816402 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac46bac-6ced-4cc4-b958-96e2ffe016e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:02:10.817821 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac46bac-6ced-4cc4-b958-96e2ffe016e7 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:02:10.827044 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 767/1536] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:02:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:02:12.881558 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdd54d-2b00-4d61-a0ef-3c91e68c76bb None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:02:12.882125 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdd54d-2b00-4d61-a0ef-3c91e68c76bb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:02:12.882125 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdd54d-2b00-4d61-a0ef-3c91e68c76bb None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:02:12.883545 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 11 11:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:02:12.889474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6871d19-ae3c-41bb-a628-5e8e5f417b7e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:02:12.889887 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6871d19-ae3c-41bb-a628-5e8e5f417b7e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:02:12.890024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6871d19-ae3c-41bb-a628-5e8e5f417b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:02:12.909665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d6871d19-ae3c-41bb-a628-5e8e5f417b7e None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:02:12.910881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d6871d19-ae3c-41bb-a628-5e8e5f417b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:02:12.918621 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 11 11:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:02:13.220166 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdd54d-2b00-4d61-a0ef-3c91e68c76bb None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:02:13.221886 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e6cdd54d-2b00-4d61-a0ef-3c91e68c76bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:02:13.235273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdd54d-2b00-4d61-a0ef-3c91e68c76bb None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:02:13.239176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44664808-26ec-4153-a8ef-0a9f16eea5f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:02:13.239779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44664808-26ec-4153-a8ef-0a9f16eea5f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:02:13.240062 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44664808-26ec-4153-a8ef-0a9f16eea5f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:02:13.240337 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44664808-26ec-4153-a8ef-0a9f16eea5f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:02:13.249368 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44664808-26ec-4153-a8ef-0a9f16eea5f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:02:13.251530 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44664808-26ec-4153-a8ef-0a9f16eea5f1 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:02:13.261156 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 771/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:02:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:02:22.905103 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=47 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:02:23.256681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=33 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:45.049576 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec912a-a7e9-4b29-b524-0866183e2aaa None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.050963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec912a-a7e9-4b29-b524-0866183e2aaa None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.051471 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec912a-a7e9-4b29-b524-0866183e2aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.085398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e8039-bedd-4797-afe7-0053ed425109 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.086007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e8039-bedd-4797-afe7-0053ed425109 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.086007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e8039-bedd-4797-afe7-0053ed425109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.090714 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-efec912a-a7e9-4b29-b524-0866183e2aaa None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:45.092203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-efec912a-a7e9-4b29-b524-0866183e2aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:45.110527 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 769/1540] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:03:45.120093 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a75e8039-bedd-4797-afe7-0053ed425109 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:45.121579 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a75e8039-bedd-4797-afe7-0053ed425109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:45.122000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276d73-bfef-49f7-92c0-e05c38fcb153 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.122514 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276d73-bfef-49f7-92c0-e05c38fcb153 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.123032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276d73-bfef-49f7-92c0-e05c38fcb153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.134411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 772/1541] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:45.135726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3d8d7-40fd-4495-a3a8-fcac23310aea None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.136017 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3d8d7-40fd-4495-a3a8-fcac23310aea None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.136295 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3d8d7-40fd-4495-a3a8-fcac23310aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.159846 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-40276d73-bfef-49f7-92c0-e05c38fcb153 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:45.161679 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-40276d73-bfef-49f7-92c0-e05c38fcb153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:45.170975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-03a3d8d7-40fd-4495-a3a8-fcac23310aea None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:45.172218 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-03a3d8d7-40fd-4495-a3a8-fcac23310aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:45.175161 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 770/1542] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:03:45.181792 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8b159-1b08-42e1-9834-fb3023c39ee2 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.182433 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8b159-1b08-42e1-9834-fb3023c39ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.182962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8b159-1b08-42e1-9834-fb3023c39ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.192227 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 773/1543] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:45.193533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12660551-61f8-49cd-8ba0-56dc4f1c2db8 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.193820 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12660551-61f8-49cd-8ba0-56dc4f1c2db8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.194099 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12660551-61f8-49cd-8ba0-56dc4f1c2db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.235310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-fea8b159-1b08-42e1-9834-fb3023c39ee2 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:45.237215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fea8b159-1b08-42e1-9834-fb3023c39ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:45.242533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-12660551-61f8-49cd-8ba0-56dc4f1c2db8 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:45.243746 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-12660551-61f8-49cd-8ba0-56dc4f1c2db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:45.249173 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 771/1544] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:45.250294 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8b159-1b08-42e1-9834-fb3023c39ee2 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:45.260615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 774/1545] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:45.261964 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e49b2-bba3-42e2-aa8a-14ec812af7dd None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.262250 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e49b2-bba3-42e2-aa8a-14ec812af7dd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.262526 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e49b2-bba3-42e2-aa8a-14ec812af7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.262841 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8b159-1b08-42e1-9834-fb3023c39ee2 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:45.268699 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8639f-536b-4fe8-8694-3d66f18ad112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:45.269586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8639f-536b-4fe8-8694-3d66f18ad112 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.270083 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8639f-536b-4fe8-8694-3d66f18ad112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.270591 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8639f-536b-4fe8-8694-3d66f18ad112 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.271474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8639f-536b-4fe8-8694-3d66f18ad112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:03:45.272001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8639f-536b-4fe8-8694-3d66f18ad112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:45.273823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8639f-536b-4fe8-8694-3d66f18ad112 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:45.284472 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-783e49b2-bba3-42e2-aa8a-14ec812af7dd None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:45.285675 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-783e49b2-bba3-42e2-aa8a-14ec812af7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:45.289289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 772/1546] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:03:45.290903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c16bf-fc4b-4aa0-ba65-d0eba2a554ae None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.291421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c16bf-fc4b-4aa0-ba65-d0eba2a554ae None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.291971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c16bf-fc4b-4aa0-ba65-d0eba2a554ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.303267 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 775/1547] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:45.304620 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1010f2c-8e78-4ab3-9fe8-2401c728248b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.304930 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1010f2c-8e78-4ab3-9fe8-2401c728248b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.305207 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1010f2c-8e78-4ab3-9fe8-2401c728248b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.316942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a02c16bf-fc4b-4aa0-ba65-d0eba2a554ae None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:45.318637 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a02c16bf-fc4b-4aa0-ba65-d0eba2a554ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:45.327879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 773/1548] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:45.329458 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a693b-cca2-4480-bab7-1c86c3dd6e2a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.330256 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f1010f2c-8e78-4ab3-9fe8-2401c728248b None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:45.330745 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a693b-cca2-4480-bab7-1c86c3dd6e2a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.331288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a693b-cca2-4480-bab7-1c86c3dd6e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.331695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f1010f2c-8e78-4ab3-9fe8-2401c728248b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:45.343875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 776/1549] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:45.343875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1010f2c-8e78-4ab3-9fe8-2401c728248b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:45.355190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d93a693b-cca2-4480-bab7-1c86c3dd6e2a None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:45.355411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1010f2c-8e78-4ab3-9fe8-2401c728248b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:45.356400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d93a693b-cca2-4480-bab7-1c86c3dd6e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:45.360113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ae8c7-bd8c-4a37-8a3d-62efc20ad3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:45.360719 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ae8c7-bd8c-4a37-8a3d-62efc20ad3fc admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.361975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ae8c7-bd8c-4a37-8a3d-62efc20ad3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.362256 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ae8c7-bd8c-4a37-8a3d-62efc20ad3fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.362939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ae8c7-bd8c-4a37-8a3d-62efc20ad3fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:03:45.363242 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ae8c7-bd8c-4a37-8a3d-62efc20ad3fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:45.364256 dv-cinder-820027-17-smb devstack@keystone.service[81639]: WARNING py.warnings [None req-8e9ae8c7-bd8c-4a37-8a3d-62efc20ad3fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 11:03:45.364256 dv-cinder-820027-17-smb devstack@keystone.service[81639]: warnings.warn(msg) Aug 11 11:03:45.364256 dv-cinder-820027-17-smb devstack@keystone.service[81639]: Aug 11 11:03:45.365139 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ae8c7-bd8c-4a37-8a3d-62efc20ad3fc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:45.365641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 774/1550] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:45.366416 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a693b-cca2-4480-bab7-1c86c3dd6e2a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:45.375977 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a693b-cca2-4480-bab7-1c86c3dd6e2a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:45.386286 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 777/1551] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:03:45.386286 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df10021-a2d0-4d3c-b834-2b9968ce486e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.386286 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df10021-a2d0-4d3c-b834-2b9968ce486e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.386608 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324aa69-ae8d-40b3-bb6a-131c3ff59bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:45.386713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df10021-a2d0-4d3c-b834-2b9968ce486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.386835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324aa69-ae8d-40b3-bb6a-131c3ff59bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.386835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324aa69-ae8d-40b3-bb6a-131c3ff59bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.386835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324aa69-ae8d-40b3-bb6a-131c3ff59bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.386835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324aa69-ae8d-40b3-bb6a-131c3ff59bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:45.386835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: WARNING py.warnings [None req-a324aa69-ae8d-40b3-bb6a-131c3ff59bf8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 11:03:45.386835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: warnings.warn(msg) Aug 11 11:03:45.386835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: Aug 11 11:03:45.387342 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324aa69-ae8d-40b3-bb6a-131c3ff59bf8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:45.400908 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-6df10021-a2d0-4d3c-b834-2b9968ce486e None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:45.402109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6df10021-a2d0-4d3c-b834-2b9968ce486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:45.410315 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 778/1552] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:45.418541 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df10021-a2d0-4d3c-b834-2b9968ce486e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:45.420670 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df10021-a2d0-4d3c-b834-2b9968ce486e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:45.425815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b26b7-a5e5-4a66-85cb-93d5da0d8542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:45.426385 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b26b7-a5e5-4a66-85cb-93d5da0d8542 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.426660 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b26b7-a5e5-4a66-85cb-93d5da0d8542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.426957 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b26b7-a5e5-4a66-85cb-93d5da0d8542 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.427590 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b26b7-a5e5-4a66-85cb-93d5da0d8542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:03:45.427887 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b26b7-a5e5-4a66-85cb-93d5da0d8542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:45.429459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b26b7-a5e5-4a66-85cb-93d5da0d8542 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:45.441090 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 779/1553] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:03:45.442203 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a8130-377e-4e4c-99bc-362cf5a6a1a1 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.442492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a8130-377e-4e4c-99bc-362cf5a6a1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.442778 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a8130-377e-4e4c-99bc-362cf5a6a1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.461484 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4e4a8130-377e-4e4c-99bc-362cf5a6a1a1 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:45.462634 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4e4a8130-377e-4e4c-99bc-362cf5a6a1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:45.471098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 780/1554] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:45.472343 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2025111-7208-462d-a10a-4448eab7f9d9 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.472624 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2025111-7208-462d-a10a-4448eab7f9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.472891 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2025111-7208-462d-a10a-4448eab7f9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.492677 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a2025111-7208-462d-a10a-4448eab7f9d9 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:45.493964 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a2025111-7208-462d-a10a-4448eab7f9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:45.502878 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 781/1555] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:45.504038 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5a82-77e0-4515-b7f4-09a1256ec9a3 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.504317 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5a82-77e0-4515-b7f4-09a1256ec9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.504588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc5a82-77e0-4515-b7f4-09a1256ec9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.518616 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 775/1556] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/projects => generated 389 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:45.519651 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324aa69-ae8d-40b3-bb6a-131c3ff59bf8 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:45.523718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-8afc5a82-77e0-4515-b7f4-09a1256ec9a3 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:45.524886 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8afc5a82-77e0-4515-b7f4-09a1256ec9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:45.584206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324aa69-ae8d-40b3-bb6a-131c3ff59bf8 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:45.584596 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 782/1557] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:45.585487 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc5a82-77e0-4515-b7f4-09a1256ec9a3 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:45.588892 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc1eea-955e-4f7b-8013-99d021f4b5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:45.589505 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc1eea-955e-4f7b-8013-99d021f4b5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.589902 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc1eea-955e-4f7b-8013-99d021f4b5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.590169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc1eea-955e-4f7b-8013-99d021f4b5f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.590995 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc1eea-955e-4f7b-8013-99d021f4b5f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:03:45.596392 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc1eea-955e-4f7b-8013-99d021f4b5f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:45.596392 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc1eea-955e-4f7b-8013-99d021f4b5f7 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:45.597438 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc5a82-77e0-4515-b7f4-09a1256ec9a3 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:45.602625 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb959cd-cf46-43c2-b031-993529cc4f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:45.603258 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb959cd-cf46-43c2-b031-993529cc4f9a admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.603541 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb959cd-cf46-43c2-b031-993529cc4f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.603818 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb959cd-cf46-43c2-b031-993529cc4f9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.604440 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb959cd-cf46-43c2-b031-993529cc4f9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:45.610935 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 776/1558] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:03:45.610935 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc1eea-955e-4f7b-8013-99d021f4b5f7 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:45.611464 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb959cd-cf46-43c2-b031-993529cc4f9a admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:45.620901 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc1eea-955e-4f7b-8013-99d021f4b5f7 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:45.625770 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261162db-e0c6-4e35-a4db-29d4404f4a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:45.626376 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261162db-e0c6-4e35-a4db-29d4404f4a3c admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.630419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261162db-e0c6-4e35-a4db-29d4404f4a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.630419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261162db-e0c6-4e35-a4db-29d4404f4a3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.630419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261162db-e0c6-4e35-a4db-29d4404f4a3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:03:45.630419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261162db-e0c6-4e35-a4db-29d4404f4a3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:45.630419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261162db-e0c6-4e35-a4db-29d4404f4a3c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:45.643798 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 777/1559] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:03:45.645300 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261162db-e0c6-4e35-a4db-29d4404f4a3c admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:45.654595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261162db-e0c6-4e35-a4db-29d4404f4a3c admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:45.659223 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ed6d0-d392-431a-9ecb-80f208cbbbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:45.659792 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ed6d0-d392-431a-9ecb-80f208cbbbac admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.660071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ed6d0-d392-431a-9ecb-80f208cbbbac admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.660339 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ed6d0-d392-431a-9ecb-80f208cbbbac admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.660940 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ed6d0-d392-431a-9ecb-80f208cbbbac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:45.662810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ed6d0-d392-431a-9ecb-80f208cbbbac admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:45.708099 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 783/1560] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:45.709410 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e82c6-6712-4de5-8c0a-b8d262fbc11d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.709698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e82c6-6712-4de5-8c0a-b8d262fbc11d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.709967 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e82c6-6712-4de5-8c0a-b8d262fbc11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.728590 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-459e82c6-6712-4de5-8c0a-b8d262fbc11d None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:45.729762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-459e82c6-6712-4de5-8c0a-b8d262fbc11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:45.754977 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 778/1561] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:45.756063 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ed6d0-d392-431a-9ecb-80f208cbbbac admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:45.785377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:45.794380 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 784/1562] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:45.801866 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e82c6-6712-4de5-8c0a-b8d262fbc11d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:45.806039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e82c6-6712-4de5-8c0a-b8d262fbc11d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:45.816818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:45.827900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ed6d0-d392-431a-9ecb-80f208cbbbac admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:45.833827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3204b20-cac1-42dd-9858-f1ec345e3160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:45.834440 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3204b20-cac1-42dd-9858-f1ec345e3160 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.834718 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3204b20-cac1-42dd-9858-f1ec345e3160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.835090 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3204b20-cac1-42dd-9858-f1ec345e3160 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.835736 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3204b20-cac1-42dd-9858-f1ec345e3160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:03:45.836040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3204b20-cac1-42dd-9858-f1ec345e3160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:45.837746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3204b20-cac1-42dd-9858-f1ec345e3160 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:45.850582 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 779/1563] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:03:45.852208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355fedc-0fb4-4a3f-974d-958b093df0ee None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.852598 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355fedc-0fb4-4a3f-974d-958b093df0ee None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.852970 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355fedc-0fb4-4a3f-974d-958b093df0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.870721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bae74-493c-4063-ba04-b5bf566c09b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:45.871358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bae74-493c-4063-ba04-b5bf566c09b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.871636 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bae74-493c-4063-ba04-b5bf566c09b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.871908 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bae74-493c-4063-ba04-b5bf566c09b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.872526 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bae74-493c-4063-ba04-b5bf566c09b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:45.873597 dv-cinder-820027-17-smb devstack@keystone.service[81639]: WARNING py.warnings [None req-760bae74-493c-4063-ba04-b5bf566c09b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 11:03:45.873597 dv-cinder-820027-17-smb devstack@keystone.service[81639]: warnings.warn(msg) Aug 11 11:03:45.873597 dv-cinder-820027-17-smb devstack@keystone.service[81639]: Aug 11 11:03:45.874813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bae74-493c-4063-ba04-b5bf566c09b5 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:45.877525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b355fedc-0fb4-4a3f-974d-958b093df0ee None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:45.878737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b355fedc-0fb4-4a3f-974d-958b093df0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:45.888319 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 780/1564] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:45.891605 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355fedc-0fb4-4a3f-974d-958b093df0ee None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:45.901375 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355fedc-0fb4-4a3f-974d-958b093df0ee None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:45.905957 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7944c8-a422-4458-8da8-a752a30df645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:45.906564 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7944c8-a422-4458-8da8-a752a30df645 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.906865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7944c8-a422-4458-8da8-a752a30df645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.907141 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7944c8-a422-4458-8da8-a752a30df645 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.907801 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7944c8-a422-4458-8da8-a752a30df645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:45.909689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7944c8-a422-4458-8da8-a752a30df645 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:45.963740 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 785/1565] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/users => generated 295 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:45.964680 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bae74-493c-4063-ba04-b5bf566c09b5 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:45.974122 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bae74-493c-4063-ba04-b5bf566c09b5 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:45.978670 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300b4e6-79f9-43c6-a5b8-fdeb49dc88c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:45.979291 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300b4e6-79f9-43c6-a5b8-fdeb49dc88c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:45.979569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300b4e6-79f9-43c6-a5b8-fdeb49dc88c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:45.979840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300b4e6-79f9-43c6-a5b8-fdeb49dc88c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:45.980445 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300b4e6-79f9-43c6-a5b8-fdeb49dc88c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:45.982383 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300b4e6-79f9-43c6-a5b8-fdeb49dc88c0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:46.022854 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 781/1566] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:46.023660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7944c8-a422-4458-8da8-a752a30df645 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:46.085092 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7944c8-a422-4458-8da8-a752a30df645 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:46.089821 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64245d2b-503b-416a-9b93-207d2990af05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:46.090418 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64245d2b-503b-416a-9b93-207d2990af05 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:46.090695 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64245d2b-503b-416a-9b93-207d2990af05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:46.091069 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64245d2b-503b-416a-9b93-207d2990af05 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:46.091774 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64245d2b-503b-416a-9b93-207d2990af05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:46.093684 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64245d2b-503b-416a-9b93-207d2990af05 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:46.107372 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 786/1567] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:03:45 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:46.108165 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300b4e6-79f9-43c6-a5b8-fdeb49dc88c0 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:46.170440 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300b4e6-79f9-43c6-a5b8-fdeb49dc88c0 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:46.175259 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973725d-3b69-4711-886c-b596b14d4436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:46.175871 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973725d-3b69-4711-886c-b596b14d4436 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:46.176155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973725d-3b69-4711-886c-b596b14d4436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:46.176430 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973725d-3b69-4711-886c-b596b14d4436 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:46.177086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973725d-3b69-4711-886c-b596b14d4436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:46.179171 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973725d-3b69-4711-886c-b596b14d4436 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:46.221336 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 782/1568] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:03:46 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:46.222952 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64245d2b-503b-416a-9b93-207d2990af05 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:46.232635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64245d2b-503b-416a-9b93-207d2990af05 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:46.237636 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d99a9-3848-4457-bc3d-18c7c0629ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:46.238220 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d99a9-3848-4457-bc3d-18c7c0629ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:46.238500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d99a9-3848-4457-bc3d-18c7c0629ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:46.238778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d99a9-3848-4457-bc3d-18c7c0629ca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:46.239434 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d99a9-3848-4457-bc3d-18c7c0629ca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:03:46.239735 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d99a9-3848-4457-bc3d-18c7c0629ca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:46.241317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d99a9-3848-4457-bc3d-18c7c0629ca3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:46.254366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 783/1569] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:03:46.255137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d99a9-3848-4457-bc3d-18c7c0629ca3 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:46.264200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d99a9-3848-4457-bc3d-18c7c0629ca3 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:46.269364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a70eba-7939-4ae7-bd48-d2941b7546ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:46.270342 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a70eba-7939-4ae7-bd48-d2941b7546ec admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:46.270342 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a70eba-7939-4ae7-bd48-d2941b7546ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:46.270543 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a70eba-7939-4ae7-bd48-d2941b7546ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:46.271057 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a70eba-7939-4ae7-bd48-d2941b7546ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:46.272928 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a70eba-7939-4ae7-bd48-d2941b7546ec admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:46.311715 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 787/1570] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:03:46 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:46.312535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973725d-3b69-4711-886c-b596b14d4436 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:46.322848 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973725d-3b69-4711-886c-b596b14d4436 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:46.327553 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acf7d5-9ab5-4f54-8b44-a76fcaf68ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:46.328154 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acf7d5-9ab5-4f54-8b44-a76fcaf68ecb admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:46.328438 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acf7d5-9ab5-4f54-8b44-a76fcaf68ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:46.328712 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acf7d5-9ab5-4f54-8b44-a76fcaf68ecb admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:46.329379 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acf7d5-9ab5-4f54-8b44-a76fcaf68ecb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:03:46.330929 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acf7d5-9ab5-4f54-8b44-a76fcaf68ecb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:46.332561 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acf7d5-9ab5-4f54-8b44-a76fcaf68ecb admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:46.345587 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 788/1571] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:03:46.346372 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acf7d5-9ab5-4f54-8b44-a76fcaf68ecb admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:46.355483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acf7d5-9ab5-4f54-8b44-a76fcaf68ecb admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:46.359944 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181ab45-2842-4e2b-b67d-a0e6a68d4645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:46.360508 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181ab45-2842-4e2b-b67d-a0e6a68d4645 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:46.360857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181ab45-2842-4e2b-b67d-a0e6a68d4645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:46.361450 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181ab45-2842-4e2b-b67d-a0e6a68d4645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:46.362071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181ab45-2842-4e2b-b67d-a0e6a68d4645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:46.363649 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181ab45-2842-4e2b-b67d-a0e6a68d4645 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:46.370622 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 784/1572] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:03:46 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:46.371460 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a70eba-7939-4ae7-bd48-d2941b7546ec admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:46.373238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 789/1573] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:46.375183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181ab45-2842-4e2b-b67d-a0e6a68d4645 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:46.387727 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181ab45-2842-4e2b-b67d-a0e6a68d4645 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:46.418542 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:46.435865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a70eba-7939-4ae7-bd48-d2941b7546ec admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:46.441459 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1668d67-88e2-443a-9156-d109cd9cc423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:46.442156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1668d67-88e2-443a-9156-d109cd9cc423 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:46.442441 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1668d67-88e2-443a-9156-d109cd9cc423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:46.442718 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1668d67-88e2-443a-9156-d109cd9cc423 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:46.443437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1668d67-88e2-443a-9156-d109cd9cc423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:46.444283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ba652-7e89-4869-ad6b-766264b91e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:46.444881 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ba652-7e89-4869-ad6b-766264b91e7a admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:46.445157 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ba652-7e89-4869-ad6b-766264b91e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:46.445357 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1668d67-88e2-443a-9156-d109cd9cc423 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:46.445467 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ba652-7e89-4869-ad6b-766264b91e7a admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:46.446020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ba652-7e89-4869-ad6b-766264b91e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:46.447960 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ba652-7e89-4869-ad6b-766264b91e7a admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:46.546160 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:46.551294 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 785/1574] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:03:46 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:46.552106 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1668d67-88e2-443a-9156-d109cd9cc423 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:46.561263 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1668d67-88e2-443a-9156-d109cd9cc423 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:46.566307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4c05c-effd-4c08-9ec4-b8b001fb0705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:46.566913 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4c05c-effd-4c08-9ec4-b8b001fb0705 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:46.567198 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4c05c-effd-4c08-9ec4-b8b001fb0705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:46.567505 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb4c05c-effd-4c08-9ec4-b8b001fb0705 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:46.568089 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4c05c-effd-4c08-9ec4-b8b001fb0705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:46.569661 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb4c05c-effd-4c08-9ec4-b8b001fb0705 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:46.579145 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 786/1575] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:46.580502 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4c05c-effd-4c08-9ec4-b8b001fb0705 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:46.589787 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb4c05c-effd-4c08-9ec4-b8b001fb0705 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:46.595915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 790/1576] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:03:46 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:46.595915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ba652-7e89-4869-ad6b-766264b91e7a admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:46.596124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d4ce2-9def-40ad-bc66-1352d37a30f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:46.596124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d4ce2-9def-40ad-bc66-1352d37a30f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:46.596124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d4ce2-9def-40ad-bc66-1352d37a30f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:46.596124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d4ce2-9def-40ad-bc66-1352d37a30f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:46.596752 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d4ce2-9def-40ad-bc66-1352d37a30f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:46.599305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d4ce2-9def-40ad-bc66-1352d37a30f9 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:46.602789 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ba652-7e89-4869-ad6b-766264b91e7a admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:46.607370 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed71a8f-2819-4587-b995-ad33bbb14594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:46.607967 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed71a8f-2819-4587-b995-ad33bbb14594 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:46.608248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed71a8f-2819-4587-b995-ad33bbb14594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:46.608517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed71a8f-2819-4587-b995-ad33bbb14594 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:46.609156 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed71a8f-2819-4587-b995-ad33bbb14594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:46.610738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed71a8f-2819-4587-b995-ad33bbb14594 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:46.621808 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 791/1577] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:46.624674 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed71a8f-2819-4587-b995-ad33bbb14594 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:46.633292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed71a8f-2819-4587-b995-ad33bbb14594 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:46.638010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64dca41-872e-4fad-91bb-5dd9cc0bf2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:46.638585 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64dca41-872e-4fad-91bb-5dd9cc0bf2fc admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:46.638904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64dca41-872e-4fad-91bb-5dd9cc0bf2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:46.639206 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64dca41-872e-4fad-91bb-5dd9cc0bf2fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:46.639820 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64dca41-872e-4fad-91bb-5dd9cc0bf2fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:46.641982 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64dca41-872e-4fad-91bb-5dd9cc0bf2fc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:46.713363 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 787/1578] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:03:46 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:46.714317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d4ce2-9def-40ad-bc66-1352d37a30f9 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:46.747546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 792/1579] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:03:46 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:46.748614 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64dca41-872e-4fad-91bb-5dd9cc0bf2fc admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:46.784999 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d4ce2-9def-40ad-bc66-1352d37a30f9 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:46.815239 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64dca41-872e-4fad-91bb-5dd9cc0bf2fc admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:46.821455 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58725825-9cec-4689-adf1-9a3ab074ffe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:46.822374 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58725825-9cec-4689-adf1-9a3ab074ffe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:46.822646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58725825-9cec-4689-adf1-9a3ab074ffe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:46.822947 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58725825-9cec-4689-adf1-9a3ab074ffe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:46.823869 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58725825-9cec-4689-adf1-9a3ab074ffe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:46.826656 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58725825-9cec-4689-adf1-9a3ab074ffe0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:46.841457 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 793/1580] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:46.842340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58725825-9cec-4689-adf1-9a3ab074ffe0 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:46.853777 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58725825-9cec-4689-adf1-9a3ab074ffe0 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:46.858528 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199c9d2-0772-4474-a2b8-266018658f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:46.859182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199c9d2-0772-4474-a2b8-266018658f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:46.859464 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199c9d2-0772-4474-a2b8-266018658f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:46.859729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199c9d2-0772-4474-a2b8-266018658f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:46.860411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199c9d2-0772-4474-a2b8-266018658f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:46.862816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936ad8e-18d0-4794-bef2-f6a8dbc03acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:46.863103 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199c9d2-0772-4474-a2b8-266018658f34 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:46.863951 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936ad8e-18d0-4794-bef2-f6a8dbc03acb admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:46.864541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936ad8e-18d0-4794-bef2-f6a8dbc03acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:46.864825 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936ad8e-18d0-4794-bef2-f6a8dbc03acb admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:46.865904 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936ad8e-18d0-4794-bef2-f6a8dbc03acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:46.868131 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936ad8e-18d0-4794-bef2-f6a8dbc03acb admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:46.877158 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 794/1581] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:46.877158 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199c9d2-0772-4474-a2b8-266018658f34 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:46.887378 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199c9d2-0772-4474-a2b8-266018658f34 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:46.893234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49fae1-8b4b-4ad8-ad5e-4a7ad9852788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:46.898888 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49fae1-8b4b-4ad8-ad5e-4a7ad9852788 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:46.898888 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49fae1-8b4b-4ad8-ad5e-4a7ad9852788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:46.898888 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49fae1-8b4b-4ad8-ad5e-4a7ad9852788 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:46.898888 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49fae1-8b4b-4ad8-ad5e-4a7ad9852788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:46.898888 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49fae1-8b4b-4ad8-ad5e-4a7ad9852788 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:46.907892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 795/1582] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:46.908878 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49fae1-8b4b-4ad8-ad5e-4a7ad9852788 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:46.919762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49fae1-8b4b-4ad8-ad5e-4a7ad9852788 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:46.925412 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b864710-ab48-4ffd-b692-6f4cca91a93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:46.928295 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b864710-ab48-4ffd-b692-6f4cca91a93e admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:46.928295 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b864710-ab48-4ffd-b692-6f4cca91a93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:46.928295 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b864710-ab48-4ffd-b692-6f4cca91a93e admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:46.928295 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b864710-ab48-4ffd-b692-6f4cca91a93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:46.928747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b864710-ab48-4ffd-b692-6f4cca91a93e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:46.938346 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 796/1583] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:46.939872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b864710-ab48-4ffd-b692-6f4cca91a93e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:46.950025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b864710-ab48-4ffd-b692-6f4cca91a93e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:46.955083 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36de04e-fb01-4630-8dce-c03dcc29cc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:46.955677 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36de04e-fb01-4630-8dce-c03dcc29cc61 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:46.958096 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36de04e-fb01-4630-8dce-c03dcc29cc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:46.958096 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36de04e-fb01-4630-8dce-c03dcc29cc61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:46.958096 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36de04e-fb01-4630-8dce-c03dcc29cc61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:46.958349 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 788/1584] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:03:46 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:46.959170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936ad8e-18d0-4794-bef2-f6a8dbc03acb admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:46.961862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36de04e-fb01-4630-8dce-c03dcc29cc61 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:46.969011 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936ad8e-18d0-4794-bef2-f6a8dbc03acb admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:46.975837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 797/1585] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:46.975837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36de04e-fb01-4630-8dce-c03dcc29cc61 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:46.976084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4835b81-a217-47c9-9aca-fc685c7f06ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:46.976084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4835b81-a217-47c9-9aca-fc685c7f06ee admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:46.976084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4835b81-a217-47c9-9aca-fc685c7f06ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:46.976373 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4835b81-a217-47c9-9aca-fc685c7f06ee admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:46.976992 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4835b81-a217-47c9-9aca-fc685c7f06ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:46.978966 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4835b81-a217-47c9-9aca-fc685c7f06ee admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:46.983438 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36de04e-fb01-4630-8dce-c03dcc29cc61 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:46.989456 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a54b16-be6a-4375-9638-c5e1c3051584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:46.990586 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a54b16-be6a-4375-9638-c5e1c3051584 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:46.990849 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a54b16-be6a-4375-9638-c5e1c3051584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:46.991130 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a54b16-be6a-4375-9638-c5e1c3051584 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:46.991757 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a54b16-be6a-4375-9638-c5e1c3051584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:46.993665 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a54b16-be6a-4375-9638-c5e1c3051584 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:47.083886 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 789/1586] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:03:46 2022] POST /identity/v3/users => generated 284 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:47.084846 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4835b81-a217-47c9-9aca-fc685c7f06ee admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:47.094570 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4835b81-a217-47c9-9aca-fc685c7f06ee admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:47.099692 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cd803-dc8e-4dbb-8f60-39264a059072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:47.100320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cd803-dc8e-4dbb-8f60-39264a059072 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:47.100602 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cd803-dc8e-4dbb-8f60-39264a059072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:47.100884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7cd803-dc8e-4dbb-8f60-39264a059072 admin admin] PATH_INFO: `/v3/projects/d7c5801ef6e4451e93be86c6870a07f9/users/060fd4adbdce44dfbf65e21561bfa532/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:47.116899 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7cd803-dc8e-4dbb-8f60-39264a059072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c5801ef6e4451e93be86c6870a07f9, user_id=060fd4adbdce44dfbf65e21561bfa532, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:47.117798 dv-cinder-820027-17-smb devstack@keystone.service[81638]: WARNING py.warnings [None req-4b7cd803-dc8e-4dbb-8f60-39264a059072 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 11:03:47.117798 dv-cinder-820027-17-smb devstack@keystone.service[81638]: warnings.warn(msg) Aug 11 11:03:47.117798 dv-cinder-820027-17-smb devstack@keystone.service[81638]: Aug 11 11:03:47.119793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7cd803-dc8e-4dbb-8f60-39264a059072 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:47.126128 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 798/1587] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:03:46 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:47.126128 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a54b16-be6a-4375-9638-c5e1c3051584 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:47.133861 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a54b16-be6a-4375-9638-c5e1c3051584 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:47.138467 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f0ed3-d959-40f9-b344-8e730d16bffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:47.139193 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f0ed3-d959-40f9-b344-8e730d16bffa admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:47.139477 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f0ed3-d959-40f9-b344-8e730d16bffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:47.139754 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f0ed3-d959-40f9-b344-8e730d16bffa admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:47.140392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f0ed3-d959-40f9-b344-8e730d16bffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:47.141988 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f0ed3-d959-40f9-b344-8e730d16bffa admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:47.152422 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 799/1588] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:47.153169 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f0ed3-d959-40f9-b344-8e730d16bffa admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:47.163372 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f0ed3-d959-40f9-b344-8e730d16bffa admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:47.168136 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5decc71-23cd-4e8c-a163-3350f03bf6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:47.168752 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5decc71-23cd-4e8c-a163-3350f03bf6c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:47.169032 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5decc71-23cd-4e8c-a163-3350f03bf6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:47.169332 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5decc71-23cd-4e8c-a163-3350f03bf6c9 admin admin] PATH_INFO: `/v3/projects/0dbaa50bdbe24375bc147900b041da52/users/9c0c0e4aa1ed4e05ba07764160ad12e9/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:47.180883 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:47.184623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5decc71-23cd-4e8c-a163-3350f03bf6c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dbaa50bdbe24375bc147900b041da52, user_id=9c0c0e4aa1ed4e05ba07764160ad12e9, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:47.187288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5decc71-23cd-4e8c-a163-3350f03bf6c9 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:47.221196 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 790/1589] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:03:47 2022] PUT /identity/v3/projects/d7c5801ef6e4451e93be86c6870a07f9/users/060fd4adbdce44dfbf65e21561bfa532/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:03:47.222095 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cd803-dc8e-4dbb-8f60-39264a059072 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:47.247483 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:47.281970 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7cd803-dc8e-4dbb-8f60-39264a059072 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:47.283993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 800/1590] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:03:47 2022] PUT /identity/v3/projects/0dbaa50bdbe24375bc147900b041da52/users/9c0c0e4aa1ed4e05ba07764160ad12e9/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:03:47.295482 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5decc71-23cd-4e8c-a163-3350f03bf6c9 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:47.348988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55580f-8cdc-4bb9-9a8c-5987ce147199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:47.349626 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55580f-8cdc-4bb9-9a8c-5987ce147199 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:47.349915 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55580f-8cdc-4bb9-9a8c-5987ce147199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:47.350269 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55580f-8cdc-4bb9-9a8c-5987ce147199 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:47.350954 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55580f-8cdc-4bb9-9a8c-5987ce147199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:47.351994 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5decc71-23cd-4e8c-a163-3350f03bf6c9 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:47.353001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55580f-8cdc-4bb9-9a8c-5987ce147199 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:47.357044 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbd664-5530-4d9f-baa8-9c340db41728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:47.357645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbd664-5530-4d9f-baa8-9c340db41728 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:47.357925 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbd664-5530-4d9f-baa8-9c340db41728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:47.358198 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbd664-5530-4d9f-baa8-9c340db41728 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:47.358867 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbd664-5530-4d9f-baa8-9c340db41728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:47.360454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbd664-5530-4d9f-baa8-9c340db41728 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:47.364415 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 791/1591] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:47.367785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55580f-8cdc-4bb9-9a8c-5987ce147199 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:47.371945 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 801/1592] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:47.372379 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbd664-5530-4d9f-baa8-9c340db41728 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:47.375645 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55580f-8cdc-4bb9-9a8c-5987ce147199 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:47.380774 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118163ac-0c39-481d-a7da-2ffa45d922db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:47.381425 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118163ac-0c39-481d-a7da-2ffa45d922db admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:47.381708 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118163ac-0c39-481d-a7da-2ffa45d922db admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:47.382012 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118163ac-0c39-481d-a7da-2ffa45d922db admin admin] PATH_INFO: `/v3/projects/3ea056d66ab545998c1b6304d191eda7/users/605a6db2971248ae8cffbc31f09115d1/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:47.383054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbd664-5530-4d9f-baa8-9c340db41728 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:47.388401 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb7a71-16a3-42b9-819d-12c15008d9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:47.388984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb7a71-16a3-42b9-819d-12c15008d9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:47.389268 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb7a71-16a3-42b9-819d-12c15008d9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:47.389559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb7a71-16a3-42b9-819d-12c15008d9f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:47.390200 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb7a71-16a3-42b9-819d-12c15008d9f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:47.391819 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb7a71-16a3-42b9-819d-12c15008d9f4 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:47.398672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118163ac-0c39-481d-a7da-2ffa45d922db admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea056d66ab545998c1b6304d191eda7, user_id=605a6db2971248ae8cffbc31f09115d1, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:47.401386 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118163ac-0c39-481d-a7da-2ffa45d922db admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:47.402151 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 802/1593] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:47.402972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb7a71-16a3-42b9-819d-12c15008d9f4 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:47.412993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb7a71-16a3-42b9-819d-12c15008d9f4 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:47.421965 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605754b1-d7b1-41d6-9c51-3db5c0e74545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:47.421965 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605754b1-d7b1-41d6-9c51-3db5c0e74545 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:47.421965 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605754b1-d7b1-41d6-9c51-3db5c0e74545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:47.421965 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605754b1-d7b1-41d6-9c51-3db5c0e74545 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:47.422355 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605754b1-d7b1-41d6-9c51-3db5c0e74545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:47.422355 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605754b1-d7b1-41d6-9c51-3db5c0e74545 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:47.431409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 803/1594] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:47.432211 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605754b1-d7b1-41d6-9c51-3db5c0e74545 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:47.441766 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605754b1-d7b1-41d6-9c51-3db5c0e74545 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:47.446320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa6eef-cf7c-44c5-be28-9bb9888747d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:47.446987 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa6eef-cf7c-44c5-be28-9bb9888747d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:47.447273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa6eef-cf7c-44c5-be28-9bb9888747d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:47.447569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa6eef-cf7c-44c5-be28-9bb9888747d4 admin admin] PATH_INFO: `/v3/projects/bda11fac1143401388fca98942985141/users/38e8806e8adc4d2cbdfdd06442834571/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:47.462238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa6eef-cf7c-44c5-be28-9bb9888747d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bda11fac1143401388fca98942985141, user_id=38e8806e8adc4d2cbdfdd06442834571, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:47.465004 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa6eef-cf7c-44c5-be28-9bb9888747d4 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:47.476559 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 792/1595] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:03:47 2022] PUT /identity/v3/projects/3ea056d66ab545998c1b6304d191eda7/users/605a6db2971248ae8cffbc31f09115d1/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:03:47.477842 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3582a-96ca-4fb6-8f85-5e343cacbcbf None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:47.478133 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3582a-96ca-4fb6-8f85-5e343cacbcbf None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:47.478412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3582a-96ca-4fb6-8f85-5e343cacbcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:47.500163 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-30d3582a-96ca-4fb6-8f85-5e343cacbcbf None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:47.501428 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-30d3582a-96ca-4fb6-8f85-5e343cacbcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:47.539345 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 804/1596] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:03:47 2022] PUT /identity/v3/projects/bda11fac1143401388fca98942985141/users/38e8806e8adc4d2cbdfdd06442834571/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:03:47.540608 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b76502-d8e3-4446-8c0a-78b269367201 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:47.540895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b76502-d8e3-4446-8c0a-78b269367201 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:47.541222 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b76502-d8e3-4446-8c0a-78b269367201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:47.561628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 793/1597] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:47.562515 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3582a-96ca-4fb6-8f85-5e343cacbcbf None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:47.569210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e3b76502-d8e3-4446-8c0a-78b269367201 None None] MFA Rules not processed for user `9c0c0e4aa1ed4e05ba07764160ad12e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:47.570428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e3b76502-d8e3-4446-8c0a-78b269367201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:47.572280 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3582a-96ca-4fb6-8f85-5e343cacbcbf None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:47.615091 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:47.636387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdef80a-fffe-4da7-8ec1-5b97143d100a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:47.637001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdef80a-fffe-4da7-8ec1-5b97143d100a admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:47.637279 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdef80a-fffe-4da7-8ec1-5b97143d100a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:47.637582 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdef80a-fffe-4da7-8ec1-5b97143d100a admin admin] PATH_INFO: `/v3/projects/633e05cf8c4d4977aa15c3a7cad34ed3/users/271696eb14674f20bd6855fa53f00380/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:47.638115 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 805/1598] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:47.642563 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b76502-d8e3-4446-8c0a-78b269367201 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:47.652757 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b76502-d8e3-4446-8c0a-78b269367201 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:47.654372 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdef80a-fffe-4da7-8ec1-5b97143d100a admin admin] RBAC: Authorizing `identity:create_grant(project_id=633e05cf8c4d4977aa15c3a7cad34ed3, user_id=271696eb14674f20bd6855fa53f00380, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:47.657273 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdef80a-fffe-4da7-8ec1-5b97143d100a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:47.661421 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ddf8e-3f47-4ad6-b500-1b24dc634401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:47.661421 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ddf8e-3f47-4ad6-b500-1b24dc634401 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:47.661421 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ddf8e-3f47-4ad6-b500-1b24dc634401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:47.661421 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ddf8e-3f47-4ad6-b500-1b24dc634401 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:47.661811 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ddf8e-3f47-4ad6-b500-1b24dc634401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:47.661811 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ddf8e-3f47-4ad6-b500-1b24dc634401 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:47.671187 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 806/1599] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:47.671969 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ddf8e-3f47-4ad6-b500-1b24dc634401 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:47.681326 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ddf8e-3f47-4ad6-b500-1b24dc634401 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:47.686058 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec23d1b-06b2-4f48-93f8-2ce2ae17a196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:47.686693 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec23d1b-06b2-4f48-93f8-2ce2ae17a196 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:47.687036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec23d1b-06b2-4f48-93f8-2ce2ae17a196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:47.687313 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec23d1b-06b2-4f48-93f8-2ce2ae17a196 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:47.688054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec23d1b-06b2-4f48-93f8-2ce2ae17a196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:47.689734 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec23d1b-06b2-4f48-93f8-2ce2ae17a196 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:47.699664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 807/1600] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:47.700585 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec23d1b-06b2-4f48-93f8-2ce2ae17a196 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:47.711029 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec23d1b-06b2-4f48-93f8-2ce2ae17a196 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:47.715547 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa93ae-dba4-4623-8f1b-933d0f72eeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:47.716184 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa93ae-dba4-4623-8f1b-933d0f72eeea admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:47.716473 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa93ae-dba4-4623-8f1b-933d0f72eeea admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:47.716748 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa93ae-dba4-4623-8f1b-933d0f72eeea admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:47.717363 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa93ae-dba4-4623-8f1b-933d0f72eeea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:47.718940 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa93ae-dba4-4623-8f1b-933d0f72eeea admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:47.720868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:47.732853 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 808/1601] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:47.736846 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132ab62-3c4e-4740-85b4-7ee549b4bbd5 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:47.736958 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132ab62-3c4e-4740-85b4-7ee549b4bbd5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:47.737222 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132ab62-3c4e-4740-85b4-7ee549b4bbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:47.764654 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 794/1602] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:03:47 2022] PUT /identity/v3/projects/633e05cf8c4d4977aa15c3a7cad34ed3/users/271696eb14674f20bd6855fa53f00380/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:03:47.765130 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5132ab62-3c4e-4740-85b4-7ee549b4bbd5 None None] MFA Rules not processed for user `605a6db2971248ae8cffbc31f09115d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:47.765940 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed0a79-f8cf-42a4-9a16-fc65774af55b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:47.766229 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed0a79-f8cf-42a4-9a16-fc65774af55b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:47.766472 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5132ab62-3c4e-4740-85b4-7ee549b4bbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:47.766599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed0a79-f8cf-42a4-9a16-fc65774af55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:47.785476 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e2ed0a79-f8cf-42a4-9a16-fc65774af55b None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:47.786683 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e2ed0a79-f8cf-42a4-9a16-fc65774af55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:47.840042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 809/1603] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:47.840999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132ab62-3c4e-4740-85b4-7ee549b4bbd5 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:47.842641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5132ab62-3c4e-4740-85b4-7ee549b4bbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:47.850968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 795/1604] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:47.852062 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed0a79-f8cf-42a4-9a16-fc65774af55b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:47.863539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed0a79-f8cf-42a4-9a16-fc65774af55b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:47.868329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29b7df-0b49-47e1-8e32-5b14a9c9ed33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:47.868871 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29b7df-0b49-47e1-8e32-5b14a9c9ed33 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:47.869174 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29b7df-0b49-47e1-8e32-5b14a9c9ed33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:47.869552 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29b7df-0b49-47e1-8e32-5b14a9c9ed33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:47.870469 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29b7df-0b49-47e1-8e32-5b14a9c9ed33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:47.872255 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29b7df-0b49-47e1-8e32-5b14a9c9ed33 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:47.909784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132ab62-3c4e-4740-85b4-7ee549b4bbd5 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:47.913540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f75bb-5094-45d6-ad33-c7727bd0967d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:47.914656 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f75bb-5094-45d6-ad33-c7727bd0967d service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:47.914967 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f75bb-5094-45d6-ad33-c7727bd0967d service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:47.915238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f75bb-5094-45d6-ad33-c7727bd0967d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:47.924624 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f75bb-5094-45d6-ad33-c7727bd0967d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:47.926059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f75bb-5094-45d6-ad33-c7727bd0967d service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:47.935236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 810/1605] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:03:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:03:47.939836 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f75bb-5094-45d6-ad33-c7727bd0967d service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:47.945579 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f75bb-5094-45d6-ad33-c7727bd0967d service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:47.950114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484b8c9-0c8a-439c-aa46-d858d66c3663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:47.950767 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484b8c9-0c8a-439c-aa46-d858d66c3663 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:47.951061 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484b8c9-0c8a-439c-aa46-d858d66c3663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:47.951334 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484b8c9-0c8a-439c-aa46-d858d66c3663 admin admin] PATH_INFO: `/v3/projects/dc574fd3698c4688af4478e2d3e66ef2/users/950e6ba9e8ed4e00843657869bc3a26d/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:47.966734 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484b8c9-0c8a-439c-aa46-d858d66c3663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc574fd3698c4688af4478e2d3e66ef2, user_id=950e6ba9e8ed4e00843657869bc3a26d, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:47.969401 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484b8c9-0c8a-439c-aa46-d858d66c3663 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:47.976197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 796/1606] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:03:47 2022] POST /identity/v3/projects => generated 363 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:47.977000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29b7df-0b49-47e1-8e32-5b14a9c9ed33 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:48.037189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29b7df-0b49-47e1-8e32-5b14a9c9ed33 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:48.042122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ca589-1121-4e0e-9dd3-dfdf9e8e8277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:48.042826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ca589-1121-4e0e-9dd3-dfdf9e8e8277 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:48.043109 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ca589-1121-4e0e-9dd3-dfdf9e8e8277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:48.043407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ca589-1121-4e0e-9dd3-dfdf9e8e8277 admin admin] PATH_INFO: `/v3/projects/8b5ff4798c4648deba2f90d8abeb9c5b/users/9422fb93cd6749a9a8a24a48d886bdc1/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:48.058031 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ca589-1121-4e0e-9dd3-dfdf9e8e8277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5ff4798c4648deba2f90d8abeb9c5b, user_id=9422fb93cd6749a9a8a24a48d886bdc1, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:48.060695 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ca589-1121-4e0e-9dd3-dfdf9e8e8277 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:48.101681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 811/1607] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:03:47 2022] PUT /identity/v3/projects/dc574fd3698c4688af4478e2d3e66ef2/users/950e6ba9e8ed4e00843657869bc3a26d/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:03:48.102602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484b8c9-0c8a-439c-aa46-d858d66c3663 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:48.165167 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484b8c9-0c8a-439c-aa46-d858d66c3663 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:48.169353 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 797/1608] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:03:47 2022] PUT /identity/v3/projects/8b5ff4798c4648deba2f90d8abeb9c5b/users/9422fb93cd6749a9a8a24a48d886bdc1/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:03:48.170626 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f58816-9c8a-406e-9051-f37ddaa67191 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:48.170939 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f58816-9c8a-406e-9051-f37ddaa67191 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:48.171213 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f58816-9c8a-406e-9051-f37ddaa67191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:48.176560 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:48.200928 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-48f58816-9c8a-406e-9051-f37ddaa67191 None None] MFA Rules not processed for user `271696eb14674f20bd6855fa53f00380`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:48.203741 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-48f58816-9c8a-406e-9051-f37ddaa67191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:48.215240 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:48.226356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735dc4a-7996-455f-91f2-ef9f983c14dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:48.227060 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735dc4a-7996-455f-91f2-ef9f983c14dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:48.227369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735dc4a-7996-455f-91f2-ef9f983c14dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:48.227644 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735dc4a-7996-455f-91f2-ef9f983c14dd admin admin] PATH_INFO: `/v3/projects/99c0b4a0d52741708f6a666693cb2b17/users/3b5684df0e4d412b98571426fafd91b1/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:48.244429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735dc4a-7996-455f-91f2-ef9f983c14dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c0b4a0d52741708f6a666693cb2b17, user_id=3b5684df0e4d412b98571426fafd91b1, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:48.247237 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735dc4a-7996-455f-91f2-ef9f983c14dd admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:48.269950 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 798/1609] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:48.274217 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f58816-9c8a-406e-9051-f37ddaa67191 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:48.330665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f58816-9c8a-406e-9051-f37ddaa67191 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:48.334410 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ae31c-6c62-4f07-b074-7e3cb5b1d323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:48.335115 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae31c-6c62-4f07-b074-7e3cb5b1d323 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:48.335402 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae31c-6c62-4f07-b074-7e3cb5b1d323 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:48.335679 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae31c-6c62-4f07-b074-7e3cb5b1d323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:48.343493 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 812/1610] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:03:48 2022] PUT /identity/v3/projects/99c0b4a0d52741708f6a666693cb2b17/users/3b5684df0e4d412b98571426fafd91b1/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:03:48.343493 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640baf8-f5a8-4112-96bf-1240a1368cf9 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:48.343493 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640baf8-f5a8-4112-96bf-1240a1368cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:48.343493 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640baf8-f5a8-4112-96bf-1240a1368cf9 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:48.350728 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 813/1611] 10.222.0.43 () {54 vars in 962 bytes} [Thu Aug 11 11:03:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:03:48.351778 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640baf8-f5a8-4112-96bf-1240a1368cf9 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:48.358530 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ae31c-6c62-4f07-b074-7e3cb5b1d323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:48.360041 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ae31c-6c62-4f07-b074-7e3cb5b1d323 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:48.371916 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 799/1612] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:03:48.373161 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338456d7-daaa-4eeb-a817-e89445849614 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:48.373689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338456d7-daaa-4eeb-a817-e89445849614 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:48.373979 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338456d7-daaa-4eeb-a817-e89445849614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:48.396724 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-338456d7-daaa-4eeb-a817-e89445849614 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:48.397946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-338456d7-daaa-4eeb-a817-e89445849614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:48.434542 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640baf8-f5a8-4112-96bf-1240a1368cf9 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:48.436369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ab1dc-0c08-4a53-91e3-d453ca0db31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:48.436977 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ab1dc-0c08-4a53-91e3-d453ca0db31d admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:48.437259 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ab1dc-0c08-4a53-91e3-d453ca0db31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:48.437535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ab1dc-0c08-4a53-91e3-d453ca0db31d admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:48.438159 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ab1dc-0c08-4a53-91e3-d453ca0db31d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:48.440166 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ab1dc-0c08-4a53-91e3-d453ca0db31d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:48.460539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 800/1613] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:48.463413 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e5271-0c34-45d0-8e0a-7cdc7b75f637 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:48.463413 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e5271-0c34-45d0-8e0a-7cdc7b75f637 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:48.463413 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e5271-0c34-45d0-8e0a-7cdc7b75f637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:48.491850 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-467e5271-0c34-45d0-8e0a-7cdc7b75f637 None None] MFA Rules not processed for user `9422fb93cd6749a9a8a24a48d886bdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:48.493214 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-467e5271-0c34-45d0-8e0a-7cdc7b75f637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:48.524327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 814/1614] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:03:48 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:48.524327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ab1dc-0c08-4a53-91e3-d453ca0db31d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:48.536628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ab1dc-0c08-4a53-91e3-d453ca0db31d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:48.541588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2171b0a-c74c-437f-91a5-a34cd197d180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:48.542487 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2171b0a-c74c-437f-91a5-a34cd197d180 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:48.542487 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2171b0a-c74c-437f-91a5-a34cd197d180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:48.543023 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2171b0a-c74c-437f-91a5-a34cd197d180 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:48.543674 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2171b0a-c74c-437f-91a5-a34cd197d180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:48.545854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2171b0a-c74c-437f-91a5-a34cd197d180 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:48.550092 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:48.576726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 801/1615] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:48.576726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30136535-1d5b-49a6-ab0d-1b355f89ee7f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:48.576726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30136535-1d5b-49a6-ab0d-1b355f89ee7f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:48.576726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30136535-1d5b-49a6-ab0d-1b355f89ee7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:48.619171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-30136535-1d5b-49a6-ab0d-1b355f89ee7f None None] MFA Rules not processed for user `9267752ac6724013bc1edcdecff48dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:48.620732 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-30136535-1d5b-49a6-ab0d-1b355f89ee7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:48.641695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 815/1616] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:03:48 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:48.643919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937675fb-d717-4305-a237-a9fb09ac1b18 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:48.645213 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937675fb-d717-4305-a237-a9fb09ac1b18 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:48.645651 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937675fb-d717-4305-a237-a9fb09ac1b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:48.678361 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-937675fb-d717-4305-a237-a9fb09ac1b18 None None] MFA Rules not processed for user `3b5684df0e4d412b98571426fafd91b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:48.679751 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-937675fb-d717-4305-a237-a9fb09ac1b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:48.700986 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 802/1617] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Aug 11 11:03:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:48.702052 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30136535-1d5b-49a6-ab0d-1b355f89ee7f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:48.729642 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:48.750889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 816/1618] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:48.750889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937675fb-d717-4305-a237-a9fb09ac1b18 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:48.758746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30136535-1d5b-49a6-ab0d-1b355f89ee7f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:48.817463 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937675fb-d717-4305-a237-a9fb09ac1b18 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:48.824449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c822049-e286-4810-9e2b-7f11e11f66b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:48.825693 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c822049-e286-4810-9e2b-7f11e11f66b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:48.831173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c822049-e286-4810-9e2b-7f11e11f66b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:48.831173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c822049-e286-4810-9e2b-7f11e11f66b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:48.831173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c822049-e286-4810-9e2b-7f11e11f66b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:48.831173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c822049-e286-4810-9e2b-7f11e11f66b2 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:48.832658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d3d19-6d30-40cc-a844-761eb8e8f7f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:48.833086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d3d19-6d30-40cc-a844-761eb8e8f7f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:48.833400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d3d19-6d30-40cc-a844-761eb8e8f7f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:48.834254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d3d19-6d30-40cc-a844-761eb8e8f7f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:48.842732 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 817/1619] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:48.843713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c822049-e286-4810-9e2b-7f11e11f66b2 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:48.849744 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d3d19-6d30-40cc-a844-761eb8e8f7f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:48.851340 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d3d19-6d30-40cc-a844-761eb8e8f7f9 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:48.864960 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 803/1620] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:03:48.865977 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d3d19-6d30-40cc-a844-761eb8e8f7f9 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:48.877826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d3d19-6d30-40cc-a844-761eb8e8f7f9 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:48.884098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9e17e-2a2a-43dc-a9ab-0935ada454b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:48.884715 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9e17e-2a2a-43dc-a9ab-0935ada454b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:48.884997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9e17e-2a2a-43dc-a9ab-0935ada454b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:48.885277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9e17e-2a2a-43dc-a9ab-0935ada454b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:48.886456 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9e17e-2a2a-43dc-a9ab-0935ada454b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:48.888842 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9e17e-2a2a-43dc-a9ab-0935ada454b2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:48.936602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c822049-e286-4810-9e2b-7f11e11f66b2 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:48.940412 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64257e-ab47-4daa-ada0-ee1339dbaac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:48.941021 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64257e-ab47-4daa-ada0-ee1339dbaac5 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:48.946025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64257e-ab47-4daa-ada0-ee1339dbaac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:48.946025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64257e-ab47-4daa-ada0-ee1339dbaac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:48.999633 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64257e-ab47-4daa-ada0-ee1339dbaac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:49.001224 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64257e-ab47-4daa-ada0-ee1339dbaac5 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:49.011115 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 818/1621] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:03:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:03:49.012458 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64257e-ab47-4daa-ada0-ee1339dbaac5 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:49.040521 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 804/1622] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:03:48 2022] POST /identity/v3/users => generated 296 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:49.042266 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a003e-9b88-4bd8-a03d-c3f95720d174 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:49.043082 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a003e-9b88-4bd8-a03d-c3f95720d174 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:49.043412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a003e-9b88-4bd8-a03d-c3f95720d174 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:49.044809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 805/1623] 10.222.0.43 () {54 vars in 962 bytes} [Thu Aug 11 11:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:03:49.053027 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a003e-9b88-4bd8-a03d-c3f95720d174 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:49.069193 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a003e-9b88-4bd8-a03d-c3f95720d174 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:49.073825 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bba2a2-a55e-4afb-b6b8-3ea58f1c65f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:49.074489 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bba2a2-a55e-4afb-b6b8-3ea58f1c65f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:49.074783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bba2a2-a55e-4afb-b6b8-3ea58f1c65f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:49.075073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bba2a2-a55e-4afb-b6b8-3ea58f1c65f1 admin admin] PATH_INFO: `/v3/projects/948d978c3f2643eb850b7b54c1e7729e/users/83a94b013bbf45328a9fbc2f174187aa/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:49.080734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:49.127732 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bba2a2-a55e-4afb-b6b8-3ea58f1c65f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=948d978c3f2643eb850b7b54c1e7729e, user_id=83a94b013bbf45328a9fbc2f174187aa, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:49.130569 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bba2a2-a55e-4afb-b6b8-3ea58f1c65f1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:49.150115 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64257e-ab47-4daa-ada0-ee1339dbaac5 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:49.169041 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bf11c-e224-4d10-9cee-e36e96ad499f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:49.169957 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bf11c-e224-4d10-9cee-e36e96ad499f service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:49.170384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bf11c-e224-4d10-9cee-e36e96ad499f service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:49.171396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bf11c-e224-4d10-9cee-e36e96ad499f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:49.247263 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 806/1624] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:03:49 2022] PUT /identity/v3/projects/948d978c3f2643eb850b7b54c1e7729e/users/83a94b013bbf45328a9fbc2f174187aa/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:03:49.249082 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bf11c-e224-4d10-9cee-e36e96ad499f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:49.249220 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bba2a2-a55e-4afb-b6b8-3ea58f1c65f1 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:49.254564 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bf11c-e224-4d10-9cee-e36e96ad499f service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:49.268165 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 819/1625] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:03:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:03:49.281560 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a47e00-d897-417e-907e-aae05bb89cfd None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:49.281977 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a47e00-d897-417e-907e-aae05bb89cfd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:49.282412 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a47e00-d897-417e-907e-aae05bb89cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:49.329254 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:49.340964 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-17a47e00-d897-417e-907e-aae05bb89cfd None None] MFA Rules not processed for user `9267752ac6724013bc1edcdecff48dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:49.343388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-17a47e00-d897-417e-907e-aae05bb89cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:49.349332 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bba2a2-a55e-4afb-b6b8-3ea58f1c65f1 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:49.359136 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2e995-ba4b-4df7-8876-38a87c7b430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:49.359915 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2e995-ba4b-4df7-8876-38a87c7b430d admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:49.360296 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2e995-ba4b-4df7-8876-38a87c7b430d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:49.360772 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2e995-ba4b-4df7-8876-38a87c7b430d admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:49.363662 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2e995-ba4b-4df7-8876-38a87c7b430d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:49.365574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d2e995-ba4b-4df7-8876-38a87c7b430d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:49.390670 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 807/1626] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:49.390670 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2e995-ba4b-4df7-8876-38a87c7b430d admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:49.412669 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2e995-ba4b-4df7-8876-38a87c7b430d admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:49.437919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a31ec7-9496-4c63-b9c1-780356e46d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:49.440128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a31ec7-9496-4c63-b9c1-780356e46d01 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:49.444093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a31ec7-9496-4c63-b9c1-780356e46d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:49.445821 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a31ec7-9496-4c63-b9c1-780356e46d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:49.446896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a31ec7-9496-4c63-b9c1-780356e46d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:49.448644 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a31ec7-9496-4c63-b9c1-780356e46d01 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:49.468942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 808/1627] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:49.469792 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a31ec7-9496-4c63-b9c1-780356e46d01 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:49.487345 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a31ec7-9496-4c63-b9c1-780356e46d01 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:49.499928 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa8e5d-69a6-4dea-af4c-ae0ca5ee7179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:49.500541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa8e5d-69a6-4dea-af4c-ae0ca5ee7179 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:49.504297 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa8e5d-69a6-4dea-af4c-ae0ca5ee7179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:49.509363 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa8e5d-69a6-4dea-af4c-ae0ca5ee7179 admin admin] PATH_INFO: `/v3/projects/4782ac6b79db46fc897c6d51488e8578/users/237360fcd4a8400aa15022214d7293a2/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:49.515730 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 820/1628] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Aug 11 11:03:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:49.516789 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a47e00-d897-417e-907e-aae05bb89cfd None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:49.541471 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a47e00-d897-417e-907e-aae05bb89cfd None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:49.551449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa8e5d-69a6-4dea-af4c-ae0ca5ee7179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4782ac6b79db46fc897c6d51488e8578, user_id=237360fcd4a8400aa15022214d7293a2, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:49.552052 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcf26f-91f0-48c8-a1e5-208b2162917d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:49.552742 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcf26f-91f0-48c8-a1e5-208b2162917d admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:49.553023 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcf26f-91f0-48c8-a1e5-208b2162917d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:49.553298 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dcf26f-91f0-48c8-a1e5-208b2162917d admin admin] PATH_INFO: `/v3/projects/948d978c3f2643eb850b7b54c1e7729e/users/83a94b013bbf45328a9fbc2f174187aa/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:49.559530 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dcf26f-91f0-48c8-a1e5-208b2162917d admin admin] RBAC: Authorizing `identity:create_grant(project_id=948d978c3f2643eb850b7b54c1e7729e, user_id=83a94b013bbf45328a9fbc2f174187aa, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:49.562326 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dcf26f-91f0-48c8-a1e5-208b2162917d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:49.565211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa8e5d-69a6-4dea-af4c-ae0ca5ee7179 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:49.587821 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 821/1629] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:03:49 2022] PUT /identity/v3/projects/948d978c3f2643eb850b7b54c1e7729e/users/83a94b013bbf45328a9fbc2f174187aa/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:03:49.588791 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcf26f-91f0-48c8-a1e5-208b2162917d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:49.667619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:49.679948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dcf26f-91f0-48c8-a1e5-208b2162917d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:49.686775 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3477e-d30f-4a0f-9b5f-a44e5798330c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:49.687779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3477e-d30f-4a0f-9b5f-a44e5798330c service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:49.688743 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3477e-d30f-4a0f-9b5f-a44e5798330c service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:49.690347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3477e-d30f-4a0f-9b5f-a44e5798330c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:49.697620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 809/1630] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:03:49 2022] PUT /identity/v3/projects/4782ac6b79db46fc897c6d51488e8578/users/237360fcd4a8400aa15022214d7293a2/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:03:49.701028 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ef097-a80c-4d44-846a-aa486de85467 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:49.701028 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ef097-a80c-4d44-846a-aa486de85467 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:49.701028 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ef097-a80c-4d44-846a-aa486de85467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:49.760057 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-131ef097-a80c-4d44-846a-aa486de85467 None None] MFA Rules not processed for user `83a94b013bbf45328a9fbc2f174187aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:49.761523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-131ef097-a80c-4d44-846a-aa486de85467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:49.833828 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3477e-d30f-4a0f-9b5f-a44e5798330c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:49.835754 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3477e-d30f-4a0f-9b5f-a44e5798330c service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:49.888888 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 822/1631] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:03:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:03:49.896882 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106739a-d1ab-44d6-b3f4-17abacc4c345 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:49.900149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106739a-d1ab-44d6-b3f4-17abacc4c345 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:49.901355 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106739a-d1ab-44d6-b3f4-17abacc4c345 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:49.907089 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 823/1632] 10.222.0.43 () {54 vars in 912 bytes} [Thu Aug 11 11:03:49 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:03:49.912113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106739a-d1ab-44d6-b3f4-17abacc4c345 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:49.938647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 810/1633] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:49.940101 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5e844-d7c6-449a-9e66-96bc8a21705e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:49.943944 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5e844-d7c6-449a-9e66-96bc8a21705e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:49.943944 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d5e844-d7c6-449a-9e66-96bc8a21705e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:49.972596 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-75d5e844-d7c6-449a-9e66-96bc8a21705e None None] MFA Rules not processed for user `9267752ac6724013bc1edcdecff48dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:49.981975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-75d5e844-d7c6-449a-9e66-96bc8a21705e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:50.018928 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:50.056683 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106739a-d1ab-44d6-b3f4-17abacc4c345 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:50.072106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69caa8c5-9c9e-4648-aad1-e6b25256e705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:50.073200 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caa8c5-9c9e-4648-aad1-e6b25256e705 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:50.073654 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caa8c5-9c9e-4648-aad1-e6b25256e705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:50.074075 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69caa8c5-9c9e-4648-aad1-e6b25256e705 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:50.075047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69caa8c5-9c9e-4648-aad1-e6b25256e705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:50.077910 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69caa8c5-9c9e-4648-aad1-e6b25256e705 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:50.102272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 824/1634] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:50.104108 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69caa8c5-9c9e-4648-aad1-e6b25256e705 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:50.118127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 811/1635] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Aug 11 11:03:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:50.119664 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5e844-d7c6-449a-9e66-96bc8a21705e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:50.133511 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d5e844-d7c6-449a-9e66-96bc8a21705e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:50.138519 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a15dc-56fd-40d2-b023-334462831487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:50.139467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a15dc-56fd-40d2-b023-334462831487 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:50.140002 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a15dc-56fd-40d2-b023-334462831487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:50.140652 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a15dc-56fd-40d2-b023-334462831487 admin admin] PATH_INFO: `/v3/projects/4782ac6b79db46fc897c6d51488e8578/users/237360fcd4a8400aa15022214d7293a2/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:50.143048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a15dc-56fd-40d2-b023-334462831487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4782ac6b79db46fc897c6d51488e8578, user_id=237360fcd4a8400aa15022214d7293a2, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:50.146106 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a15dc-56fd-40d2-b023-334462831487 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:50.159026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 812/1636] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:03:50 2022] PUT /identity/v3/projects/4782ac6b79db46fc897c6d51488e8578/users/237360fcd4a8400aa15022214d7293a2/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:03:50.169203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2477255-e384-416c-a54f-95939353f0f9 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:50.169732 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2477255-e384-416c-a54f-95939353f0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:50.170108 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2477255-e384-416c-a54f-95939353f0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:50.188075 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69caa8c5-9c9e-4648-aad1-e6b25256e705 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:50.204201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c2477255-e384-416c-a54f-95939353f0f9 None None] MFA Rules not processed for user `237360fcd4a8400aa15022214d7293a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:50.206320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c2477255-e384-416c-a54f-95939353f0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:50.269512 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:50.288478 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e325000-bb45-4457-9242-b39e8ed22305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:50.288478 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e325000-bb45-4457-9242-b39e8ed22305 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:50.288478 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e325000-bb45-4457-9242-b39e8ed22305 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:50.288778 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e325000-bb45-4457-9242-b39e8ed22305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:50.311315 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 813/1637] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:03:50.358572 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a246b3-b14d-4d94-b560-5ef2fb962e93 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:50.359339 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a246b3-b14d-4d94-b560-5ef2fb962e93 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:50.359897 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a246b3-b14d-4d94-b560-5ef2fb962e93 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:50.362751 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 814/1638] 10.222.0.43 () {54 vars in 912 bytes} [Thu Aug 11 11:03:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 11 11:03:50.372993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0efe70-f7ba-4dce-a402-2dca564ff369 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:50.373518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0efe70-f7ba-4dce-a402-2dca564ff369 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:50.374051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0efe70-f7ba-4dce-a402-2dca564ff369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:50.398835 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e325000-bb45-4457-9242-b39e8ed22305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:50.401048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1f0efe70-f7ba-4dce-a402-2dca564ff369 None None] MFA Rules not processed for user `9267752ac6724013bc1edcdecff48dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:50.401801 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e325000-bb45-4457-9242-b39e8ed22305 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:50.402655 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1f0efe70-f7ba-4dce-a402-2dca564ff369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:50.427494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 825/1639] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:03:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:03:50.441720 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e325000-bb45-4457-9242-b39e8ed22305 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:50.452689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e325000-bb45-4457-9242-b39e8ed22305 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:50.459335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2c47f-17f1-453c-bc59-eece2351cb7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:50.460415 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2c47f-17f1-453c-bc59-eece2351cb7c service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:50.460887 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2c47f-17f1-453c-bc59-eece2351cb7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:50.949094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2c47f-17f1-453c-bc59-eece2351cb7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:50.953641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 815/1640] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Aug 11 11:03:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:50.956937 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2c47f-17f1-453c-bc59-eece2351cb7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:50.956937 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2c47f-17f1-453c-bc59-eece2351cb7c service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:50.956937 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 826/1641] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:03:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:03:50.958702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0efe70-f7ba-4dce-a402-2dca564ff369 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:50.958702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0efe70-f7ba-4dce-a402-2dca564ff369 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:50.958702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49f392-485d-460a-8d13-04894ae26a04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:50.958702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49f392-485d-460a-8d13-04894ae26a04 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:50.959327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49f392-485d-460a-8d13-04894ae26a04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:50.959327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49f392-485d-460a-8d13-04894ae26a04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:50.959327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49f392-485d-460a-8d13-04894ae26a04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:50.959327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49f392-485d-460a-8d13-04894ae26a04 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:50.959327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 816/1642] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:03:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:03:50.959327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:51.699126 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2c47f-17f1-453c-bc59-eece2351cb7c service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:51.713848 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2c47f-17f1-453c-bc59-eece2351cb7c service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:51.733764 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc96b8-6b19-4ec2-bcf4-c66dee038d73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:51.734386 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc96b8-6b19-4ec2-bcf4-c66dee038d73 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:51.734826 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc96b8-6b19-4ec2-bcf4-c66dee038d73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:51.735080 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc96b8-6b19-4ec2-bcf4-c66dee038d73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:51.764108 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc96b8-6b19-4ec2-bcf4-c66dee038d73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:51.765950 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc96b8-6b19-4ec2-bcf4-c66dee038d73 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:51.790680 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 827/1643] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:03:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:03:52.113845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49f392-485d-460a-8d13-04894ae26a04 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:52.124431 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49f392-485d-460a-8d13-04894ae26a04 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:52.134483 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43744d-78d4-4261-9fd8-5913f47407ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:52.135165 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43744d-78d4-4261-9fd8-5913f47407ec service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:52.135500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43744d-78d4-4261-9fd8-5913f47407ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:52.135782 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43744d-78d4-4261-9fd8-5913f47407ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:52.280062 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43744d-78d4-4261-9fd8-5913f47407ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:52.281584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43744d-78d4-4261-9fd8-5913f47407ec service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:52.304256 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 817/1644] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:03:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:03:52.331437 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc96b8-6b19-4ec2-bcf4-c66dee038d73 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:52.438347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc96b8-6b19-4ec2-bcf4-c66dee038d73 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:52.447524 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37893c-047a-47ff-8a69-7f7e45b209af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:52.448607 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37893c-047a-47ff-8a69-7f7e45b209af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:52.448943 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37893c-047a-47ff-8a69-7f7e45b209af admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:52.449223 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37893c-047a-47ff-8a69-7f7e45b209af admin admin] PATH_INFO: `/v3/users/3b5684df0e4d412b98571426fafd91b1` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:52.450472 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37893c-047a-47ff-8a69-7f7e45b209af admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b5684df0e4d412b98571426fafd91b1)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:52.452588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37893c-047a-47ff-8a69-7f7e45b209af admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:52.468364 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:52.697516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2a37893c-047a-47ff-8a69-7f7e45b209af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b5684df0e4d412b98571426fafd91b1'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:03:52.697925 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2a37893c-047a-47ff-8a69-7f7e45b209af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b5684df0e4d412b98571426fafd91b1'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:03:52.721580 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2a37893c-047a-47ff-8a69-7f7e45b209af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b5684df0e4d412b98571426fafd91b1'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:03:52.729849 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2a37893c-047a-47ff-8a69-7f7e45b209af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b5684df0e4d412b98571426fafd91b1'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:03:52.816584 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2a37893c-047a-47ff-8a69-7f7e45b209af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b5684df0e4d412b98571426fafd91b1'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:03:52.844344 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 828/1645] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:03:52 2022] DELETE /identity/v3/users/3b5684df0e4d412b98571426fafd91b1 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:03:52.846928 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9749d-ef1b-41e6-84d1-db610383d449 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:52.846928 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9749d-ef1b-41e6-84d1-db610383d449 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:52.846928 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9749d-ef1b-41e6-84d1-db610383d449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:52.909855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-49c9749d-ef1b-41e6-84d1-db610383d449 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:52.911837 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-49c9749d-ef1b-41e6-84d1-db610383d449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:53.075261 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 818/1646] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:53.087127 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37893c-047a-47ff-8a69-7f7e45b209af admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:53.089329 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2a37893c-047a-47ff-8a69-7f7e45b209af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:53.230251 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37893c-047a-47ff-8a69-7f7e45b209af admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:53.242361 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eab8d3-ee6d-4ae1-91df-13f45ec07513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:53.246388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eab8d3-ee6d-4ae1-91df-13f45ec07513 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:53.253022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eab8d3-ee6d-4ae1-91df-13f45ec07513 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:53.253022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eab8d3-ee6d-4ae1-91df-13f45ec07513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:53.272811 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eab8d3-ee6d-4ae1-91df-13f45ec07513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:53.274396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eab8d3-ee6d-4ae1-91df-13f45ec07513 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:53.311838 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 829/1647] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:03:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:03:54.034376 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9749d-ef1b-41e6-84d1-db610383d449 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:54.036629 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-49c9749d-ef1b-41e6-84d1-db610383d449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:54.075529 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9749d-ef1b-41e6-84d1-db610383d449 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:54.088145 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba01b9-0f6a-47d3-baeb-d49555773956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:54.089002 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba01b9-0f6a-47d3-baeb-d49555773956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:54.089619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba01b9-0f6a-47d3-baeb-d49555773956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:54.090027 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba01b9-0f6a-47d3-baeb-d49555773956 admin admin] PATH_INFO: `/v3/projects/99c0b4a0d52741708f6a666693cb2b17` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:54.093754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba01b9-0f6a-47d3-baeb-d49555773956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99c0b4a0d52741708f6a666693cb2b17)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:54.100616 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba01b9-0f6a-47d3-baeb-d49555773956 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:54.320429 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56ba01b9-0f6a-47d3-baeb-d49555773956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99c0b4a0d52741708f6a666693cb2b17', 'request_id': 'req-56ba01b9-0f6a-47d3-baeb-d49555773956'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:03:54.328988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56ba01b9-0f6a-47d3-baeb-d49555773956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99c0b4a0d52741708f6a666693cb2b17', 'request_id': 'req-56ba01b9-0f6a-47d3-baeb-d49555773956'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:03:54.331684 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:54.341449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56ba01b9-0f6a-47d3-baeb-d49555773956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99c0b4a0d52741708f6a666693cb2b17', 'request_id': 'req-56ba01b9-0f6a-47d3-baeb-d49555773956'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:03:54.491411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eab8d3-ee6d-4ae1-91df-13f45ec07513 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:54.495689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-58eab8d3-ee6d-4ae1-91df-13f45ec07513 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:54.539280 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56ba01b9-0f6a-47d3-baeb-d49555773956 admin admin] The token cache is being invalidate because project 99c0b4a0d52741708f6a666693cb2b17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:03:54.539750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56ba01b9-0f6a-47d3-baeb-d49555773956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:03:54.540921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56ba01b9-0f6a-47d3-baeb-d49555773956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:03:54.549174 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 819/1648] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:03:54 2022] DELETE /identity/v3/projects/99c0b4a0d52741708f6a666693cb2b17 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:03:54.553573 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee796d-6b09-4a9e-a09b-ab4faf22fd53 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:54.553910 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee796d-6b09-4a9e-a09b-ab4faf22fd53 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:54.554164 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee796d-6b09-4a9e-a09b-ab4faf22fd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:54.606676 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7dee796d-6b09-4a9e-a09b-ab4faf22fd53 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:54.608024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7dee796d-6b09-4a9e-a09b-ab4faf22fd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:54.684631 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eab8d3-ee6d-4ae1-91df-13f45ec07513 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:54.817141 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 820/1649] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:54.819307 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3823e-92f8-479d-afc4-326cdf1fd630 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:54.819612 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3823e-92f8-479d-afc4-326cdf1fd630 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:54.819892 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3823e-92f8-479d-afc4-326cdf1fd630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:54.839016 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:54.846246 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-04b3823e-92f8-479d-afc4-326cdf1fd630 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:54.847799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-04b3823e-92f8-479d-afc4-326cdf1fd630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:54.864529 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 821/1650] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:54.867996 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3823e-92f8-479d-afc4-326cdf1fd630 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:54.870123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff54b29-7aa8-4837-86dd-98d3e96be80b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:54.870768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff54b29-7aa8-4837-86dd-98d3e96be80b service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:54.871055 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff54b29-7aa8-4837-86dd-98d3e96be80b service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:54.871326 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff54b29-7aa8-4837-86dd-98d3e96be80b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:54.877897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0ff54b29-7aa8-4837-86dd-98d3e96be80b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:54.881953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3823e-92f8-479d-afc4-326cdf1fd630 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:54.894872 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501b9cf-4aed-4c86-9c2c-fb4a7c2e793b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:54.896640 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501b9cf-4aed-4c86-9c2c-fb4a7c2e793b admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:54.897241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501b9cf-4aed-4c86-9c2c-fb4a7c2e793b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:54.898038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501b9cf-4aed-4c86-9c2c-fb4a7c2e793b admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:54.904393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501b9cf-4aed-4c86-9c2c-fb4a7c2e793b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:03:54.905052 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501b9cf-4aed-4c86-9c2c-fb4a7c2e793b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:54.907104 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501b9cf-4aed-4c86-9c2c-fb4a7c2e793b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:54.942117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 822/1651] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:03:54.943563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501b9cf-4aed-4c86-9c2c-fb4a7c2e793b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:54.984368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501b9cf-4aed-4c86-9c2c-fb4a7c2e793b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:54.996918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cc693-bc69-4f67-ac1a-6c11068e6c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:54.997564 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cc693-bc69-4f67-ac1a-6c11068e6c5b admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:54.998167 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cc693-bc69-4f67-ac1a-6c11068e6c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:54.998454 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cc693-bc69-4f67-ac1a-6c11068e6c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:55.002467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cc693-bc69-4f67-ac1a-6c11068e6c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:55.011847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cc693-bc69-4f67-ac1a-6c11068e6c5b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:55.063541 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff54b29-7aa8-4837-86dd-98d3e96be80b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:55.063541 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff54b29-7aa8-4837-86dd-98d3e96be80b service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:55.126721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 830/1652] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:03:54 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:03:55.208208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 823/1653] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:03:54 2022] POST /identity/v3/projects => generated 405 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:55.209420 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff54b29-7aa8-4837-86dd-98d3e96be80b service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:55.225261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff54b29-7aa8-4837-86dd-98d3e96be80b service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:55.406876 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0823e-4753-4e54-b92e-13f236a389b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:55.408151 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0823e-4753-4e54-b92e-13f236a389b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:55.408747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0823e-4753-4e54-b92e-13f236a389b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:55.409043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0823e-4753-4e54-b92e-13f236a389b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:55.410706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0823e-4753-4e54-b92e-13f236a389b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:55.416230 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0823e-4753-4e54-b92e-13f236a389b8 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:55.584857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 831/1654] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:03:55 2022] POST /identity/v3/users => generated 303 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:03:55.589118 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cc693-bc69-4f67-ac1a-6c11068e6c5b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:55.609946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cc693-bc69-4f67-ac1a-6c11068e6c5b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:55.634993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdbe41-b804-4174-aa9e-dfab88048b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:55.635859 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdbe41-b804-4174-aa9e-dfab88048b04 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:55.637555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdbe41-b804-4174-aa9e-dfab88048b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:55.638676 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdbe41-b804-4174-aa9e-dfab88048b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:55.639597 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdbe41-b804-4174-aa9e-dfab88048b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:55.650748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdbe41-b804-4174-aa9e-dfab88048b04 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:55.695355 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 824/1655] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:55.702606 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0823e-4753-4e54-b92e-13f236a389b8 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:55.719098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0823e-4753-4e54-b92e-13f236a389b8 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:55.725649 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bb14e-fb88-41bc-ae86-e8ee09f01070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:55.726884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bb14e-fb88-41bc-ae86-e8ee09f01070 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:55.727411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bb14e-fb88-41bc-ae86-e8ee09f01070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:55.727952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bb14e-fb88-41bc-ae86-e8ee09f01070 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:55.730750 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bb14e-fb88-41bc-ae86-e8ee09f01070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:55.734572 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4bb14e-fb88-41bc-ae86-e8ee09f01070 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:55.777887 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 832/1656] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:03:55.782436 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdbe41-b804-4174-aa9e-dfab88048b04 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:55.805575 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdbe41-b804-4174-aa9e-dfab88048b04 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:55.851732 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cd71c-b96e-4234-85f3-5052522a0df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:55.852729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cd71c-b96e-4234-85f3-5052522a0df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:55.853159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cd71c-b96e-4234-85f3-5052522a0df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:55.854030 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cd71c-b96e-4234-85f3-5052522a0df3 admin admin] PATH_INFO: `/v3/projects/1429a9f28b43441fa650f1d46084d1e8/users/892f928ed891490f876f49ff52744850/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:55.905619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cd71c-b96e-4234-85f3-5052522a0df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1429a9f28b43441fa650f1d46084d1e8, user_id=892f928ed891490f876f49ff52744850, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:55.917440 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cd71c-b96e-4234-85f3-5052522a0df3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:56.036924 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 825/1657] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:03:55 2022] PUT /identity/v3/projects/1429a9f28b43441fa650f1d46084d1e8/users/892f928ed891490f876f49ff52744850/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:03:56.041729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa34bd-e0e9-4a60-9272-a6ec3e4ccd18 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:56.042283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa34bd-e0e9-4a60-9272-a6ec3e4ccd18 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:56.042798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa34bd-e0e9-4a60-9272-a6ec3e4ccd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:56.082774 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f9aa34bd-e0e9-4a60-9272-a6ec3e4ccd18 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:56.084243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f9aa34bd-e0e9-4a60-9272-a6ec3e4ccd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:56.177625 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 833/1658] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:56.194444 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cd71c-b96e-4234-85f3-5052522a0df3 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:56.196827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-427cd71c-b96e-4234-85f3-5052522a0df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:56.344308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cd71c-b96e-4234-85f3-5052522a0df3 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:56.369278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c46171-c226-4eb8-b29a-21d54c65af5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:56.369927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c46171-c226-4eb8-b29a-21d54c65af5e service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:56.370216 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c46171-c226-4eb8-b29a-21d54c65af5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:56.370496 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c46171-c226-4eb8-b29a-21d54c65af5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:56.385598 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c46171-c226-4eb8-b29a-21d54c65af5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:56.389051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c46171-c226-4eb8-b29a-21d54c65af5e service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:56.404857 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 826/1659] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:03:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:03:57.835121 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa34bd-e0e9-4a60-9272-a6ec3e4ccd18 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:57.838176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f9aa34bd-e0e9-4a60-9272-a6ec3e4ccd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:57.886923 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa34bd-e0e9-4a60-9272-a6ec3e4ccd18 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:57.926128 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0da25-f5b0-458d-9d1e-05c11ccdde8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:57.927144 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0da25-f5b0-458d-9d1e-05c11ccdde8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:57.931102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0da25-f5b0-458d-9d1e-05c11ccdde8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:57.932047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0da25-f5b0-458d-9d1e-05c11ccdde8b admin admin] PATH_INFO: `/v3/users/9c0c0e4aa1ed4e05ba07764160ad12e9` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:57.936601 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0da25-f5b0-458d-9d1e-05c11ccdde8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c0c0e4aa1ed4e05ba07764160ad12e9)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:57.947421 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0da25-f5b0-458d-9d1e-05c11ccdde8b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:57.998878 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:58.290815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-85d0da25-f5b0-458d-9d1e-05c11ccdde8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c0c0e4aa1ed4e05ba07764160ad12e9'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:03:58.292668 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-85d0da25-f5b0-458d-9d1e-05c11ccdde8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c0c0e4aa1ed4e05ba07764160ad12e9'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:03:58.343439 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-85d0da25-f5b0-458d-9d1e-05c11ccdde8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c0c0e4aa1ed4e05ba07764160ad12e9'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:03:58.367443 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-85d0da25-f5b0-458d-9d1e-05c11ccdde8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c0c0e4aa1ed4e05ba07764160ad12e9'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:03:58.483486 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-85d0da25-f5b0-458d-9d1e-05c11ccdde8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c0c0e4aa1ed4e05ba07764160ad12e9'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:03:58.491958 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 834/1660] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:03:57 2022] DELETE /identity/v3/users/9c0c0e4aa1ed4e05ba07764160ad12e9 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:03:58.496385 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92de4a-0f13-4493-aa14-7aced3208d7e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:58.496875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92de4a-0f13-4493-aa14-7aced3208d7e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:58.496982 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92de4a-0f13-4493-aa14-7aced3208d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:58.532808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0e92de4a-0f13-4493-aa14-7aced3208d7e None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:58.536193 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0e92de4a-0f13-4493-aa14-7aced3208d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:58.555532 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:58.679097 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 827/1661] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:03:58.689780 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0da25-f5b0-458d-9d1e-05c11ccdde8b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:58.691640 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-85d0da25-f5b0-458d-9d1e-05c11ccdde8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:58.779598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0da25-f5b0-458d-9d1e-05c11ccdde8b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:58.785344 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e426d-b91c-4dc7-a2a4-b0f6def080f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:58.786676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e426d-b91c-4dc7-a2a4-b0f6def080f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:58.787080 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e426d-b91c-4dc7-a2a4-b0f6def080f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:58.787605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e426d-b91c-4dc7-a2a4-b0f6def080f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:58.804210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e426d-b91c-4dc7-a2a4-b0f6def080f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:58.805945 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e426d-b91c-4dc7-a2a4-b0f6def080f1 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:58.817437 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 835/1662] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:03:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:03:59.693096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92de4a-0f13-4493-aa14-7aced3208d7e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:03:59.693096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0e92de4a-0f13-4493-aa14-7aced3208d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:03:59.718054 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92de4a-0f13-4493-aa14-7aced3208d7e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:03:59.729693 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e47474-0fd2-45b7-9896-f05f793e7ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:03:59.750569 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e47474-0fd2-45b7-9896-f05f793e7ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:59.751739 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e47474-0fd2-45b7-9896-f05f793e7ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:59.752981 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e47474-0fd2-45b7-9896-f05f793e7ad3 admin admin] PATH_INFO: `/v3/users/605a6db2971248ae8cffbc31f09115d1` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:59.757543 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e47474-0fd2-45b7-9896-f05f793e7ad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=605a6db2971248ae8cffbc31f09115d1)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:03:59.758795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: WARNING py.warnings [None req-b0e47474-0fd2-45b7-9896-f05f793e7ad3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 11:03:59.758795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: warnings.warn(msg) Aug 11 11:03:59.758795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: Aug 11 11:03:59.776030 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e47474-0fd2-45b7-9896-f05f793e7ad3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:03:59.873647 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc10282-0d8b-4197-9b0c-9b3abb383aaa None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:03:59.874121 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc10282-0d8b-4197-9b0c-9b3abb383aaa None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:03:59.874228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc10282-0d8b-4197-9b0c-9b3abb383aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:03:59.943242 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-7cc10282-0d8b-4197-9b0c-9b3abb383aaa None None] MFA Rules not processed for user `060fd4adbdce44dfbf65e21561bfa532`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:03:59.943242 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7cc10282-0d8b-4197-9b0c-9b3abb383aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:00.108720 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 836/1663] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:03:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:00.112110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc10282-0d8b-4197-9b0c-9b3abb383aaa None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:00.114179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7cc10282-0d8b-4197-9b0c-9b3abb383aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:00.137464 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc10282-0d8b-4197-9b0c-9b3abb383aaa None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:00.150293 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003af073-7273-4055-a681-ec934dd534b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:00.150401 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b0e47474-0fd2-45b7-9896-f05f793e7ad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '605a6db2971248ae8cffbc31f09115d1'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:00.150484 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003af073-7273-4055-a681-ec934dd534b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:00.150484 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003af073-7273-4055-a681-ec934dd534b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:00.150484 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003af073-7273-4055-a681-ec934dd534b5 admin admin] PATH_INFO: `/v3/projects/0dbaa50bdbe24375bc147900b041da52` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:00.150484 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003af073-7273-4055-a681-ec934dd534b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dbaa50bdbe24375bc147900b041da52)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:00.151509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: WARNING py.warnings [None req-003af073-7273-4055-a681-ec934dd534b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 11 11:04:00.151509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: warnings.warn(msg) Aug 11 11:04:00.151509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: Aug 11 11:04:00.153218 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003af073-7273-4055-a681-ec934dd534b5 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:00.200209 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:00.202955 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b0e47474-0fd2-45b7-9896-f05f793e7ad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '605a6db2971248ae8cffbc31f09115d1'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:00.206833 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b0e47474-0fd2-45b7-9896-f05f793e7ad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '605a6db2971248ae8cffbc31f09115d1'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:00.288686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b0e47474-0fd2-45b7-9896-f05f793e7ad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '605a6db2971248ae8cffbc31f09115d1'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:00.304319 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b0e47474-0fd2-45b7-9896-f05f793e7ad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '605a6db2971248ae8cffbc31f09115d1'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:00.350053 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 828/1664] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:03:59 2022] DELETE /identity/v3/users/605a6db2971248ae8cffbc31f09115d1 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:00.351095 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e47474-0fd2-45b7-9896-f05f793e7ad3 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:00.355083 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b0e47474-0fd2-45b7-9896-f05f793e7ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:00.404080 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-003af073-7273-4055-a681-ec934dd534b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dbaa50bdbe24375bc147900b041da52', 'request_id': 'req-003af073-7273-4055-a681-ec934dd534b5'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:00.439848 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-003af073-7273-4055-a681-ec934dd534b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dbaa50bdbe24375bc147900b041da52', 'request_id': 'req-003af073-7273-4055-a681-ec934dd534b5'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:00.591795 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-003af073-7273-4055-a681-ec934dd534b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dbaa50bdbe24375bc147900b041da52', 'request_id': 'req-003af073-7273-4055-a681-ec934dd534b5'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:00.649178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-003af073-7273-4055-a681-ec934dd534b5 admin admin] The token cache is being invalidate because project 0dbaa50bdbe24375bc147900b041da52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:00.649516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-003af073-7273-4055-a681-ec934dd534b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:00.651894 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-003af073-7273-4055-a681-ec934dd534b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:00.658224 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 837/1665] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:00 2022] DELETE /identity/v3/projects/0dbaa50bdbe24375bc147900b041da52 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:00.659779 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e47474-0fd2-45b7-9896-f05f793e7ad3 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:00.661793 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20969049-982b-4f23-8300-5bb93ac0e562 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:00.662079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20969049-982b-4f23-8300-5bb93ac0e562 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:00.662358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20969049-982b-4f23-8300-5bb93ac0e562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:00.710824 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:00.712512 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-20969049-982b-4f23-8300-5bb93ac0e562 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:00.714191 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-20969049-982b-4f23-8300-5bb93ac0e562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:00.812523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f04e5-1413-496e-97b9-95ea72c9ce5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:00.813162 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f04e5-1413-496e-97b9-95ea72c9ce5b service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:00.813764 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f04e5-1413-496e-97b9-95ea72c9ce5b service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:00.814465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f04e5-1413-496e-97b9-95ea72c9ce5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:00.829497 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-df4f04e5-1413-496e-97b9-95ea72c9ce5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:00.848371 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 838/1666] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:00.852694 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20969049-982b-4f23-8300-5bb93ac0e562 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:00.860772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-20969049-982b-4f23-8300-5bb93ac0e562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:00.881579 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20969049-982b-4f23-8300-5bb93ac0e562 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:00.898236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2765e3-4b8c-41bb-bd03-7adc04ed5245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:00.899055 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2765e3-4b8c-41bb-bd03-7adc04ed5245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:00.899339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2765e3-4b8c-41bb-bd03-7adc04ed5245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:00.899615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2765e3-4b8c-41bb-bd03-7adc04ed5245 admin admin] PATH_INFO: `/v3/users/83a94b013bbf45328a9fbc2f174187aa` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:00.902050 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2765e3-4b8c-41bb-bd03-7adc04ed5245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a94b013bbf45328a9fbc2f174187aa)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:00.912109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2765e3-4b8c-41bb-bd03-7adc04ed5245 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:00.965504 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f04e5-1413-496e-97b9-95ea72c9ce5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:00.967190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f04e5-1413-496e-97b9-95ea72c9ce5b service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:00.993897 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 829/1667] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:01.027805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f04e5-1413-496e-97b9-95ea72c9ce5b service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:01.032238 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-df4f04e5-1413-496e-97b9-95ea72c9ce5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:01.127993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f04e5-1413-496e-97b9-95ea72c9ce5b service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:01.132387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954aa9e-cad9-46d1-a7c1-951164640f1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:01.133564 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954aa9e-cad9-46d1-a7c1-951164640f1a service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:01.134048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954aa9e-cad9-46d1-a7c1-951164640f1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:01.134522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954aa9e-cad9-46d1-a7c1-951164640f1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:01.147529 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954aa9e-cad9-46d1-a7c1-951164640f1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:01.149314 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954aa9e-cad9-46d1-a7c1-951164640f1a service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:01.178359 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 830/1668] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:01.281685 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8a2765e3-4b8c-41bb-bd03-7adc04ed5245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a94b013bbf45328a9fbc2f174187aa'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:01.288363 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8a2765e3-4b8c-41bb-bd03-7adc04ed5245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a94b013bbf45328a9fbc2f174187aa'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:01.323279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8a2765e3-4b8c-41bb-bd03-7adc04ed5245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a94b013bbf45328a9fbc2f174187aa'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:01.341124 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8a2765e3-4b8c-41bb-bd03-7adc04ed5245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a94b013bbf45328a9fbc2f174187aa'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:01.472448 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8a2765e3-4b8c-41bb-bd03-7adc04ed5245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a94b013bbf45328a9fbc2f174187aa'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:01.480510 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 839/1669] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:00 2022] DELETE /identity/v3/users/83a94b013bbf45328a9fbc2f174187aa => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:02.155938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954aa9e-cad9-46d1-a7c1-951164640f1a service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:02.158395 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e954aa9e-cad9-46d1-a7c1-951164640f1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:02.173642 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954aa9e-cad9-46d1-a7c1-951164640f1a service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:02.256547 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94039348-5f0a-4d6b-89e1-29c85323943e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:02.258752 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94039348-5f0a-4d6b-89e1-29c85323943e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:02.259287 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94039348-5f0a-4d6b-89e1-29c85323943e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:02.259873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94039348-5f0a-4d6b-89e1-29c85323943e admin admin] PATH_INFO: `/v3/users/271696eb14674f20bd6855fa53f00380` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:02.261456 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94039348-5f0a-4d6b-89e1-29c85323943e admin admin] RBAC: Authorizing `identity:delete_user(user_id=271696eb14674f20bd6855fa53f00380)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:02.264128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94039348-5f0a-4d6b-89e1-29c85323943e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:02.373646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2765e3-4b8c-41bb-bd03-7adc04ed5245 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:02.376078 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8a2765e3-4b8c-41bb-bd03-7adc04ed5245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:02.401751 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2765e3-4b8c-41bb-bd03-7adc04ed5245 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:02.404707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d966079-bf63-4d7c-bc6e-3aeb4c7c93f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:02.405722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d966079-bf63-4d7c-bc6e-3aeb4c7c93f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:02.406194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d966079-bf63-4d7c-bc6e-3aeb4c7c93f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:02.406595 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d966079-bf63-4d7c-bc6e-3aeb4c7c93f6 admin admin] PATH_INFO: `/v3/projects/3ea056d66ab545998c1b6304d191eda7` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:02.415309 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d966079-bf63-4d7c-bc6e-3aeb4c7c93f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ea056d66ab545998c1b6304d191eda7)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:02.418821 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d966079-bf63-4d7c-bc6e-3aeb4c7c93f6 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:02.653948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9d966079-bf63-4d7c-bc6e-3aeb4c7c93f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ea056d66ab545998c1b6304d191eda7', 'request_id': 'req-9d966079-bf63-4d7c-bc6e-3aeb4c7c93f6'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:02.658743 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-94039348-5f0a-4d6b-89e1-29c85323943e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '271696eb14674f20bd6855fa53f00380'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:02.675384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9d966079-bf63-4d7c-bc6e-3aeb4c7c93f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ea056d66ab545998c1b6304d191eda7', 'request_id': 'req-9d966079-bf63-4d7c-bc6e-3aeb4c7c93f6'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:02.705207 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-94039348-5f0a-4d6b-89e1-29c85323943e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '271696eb14674f20bd6855fa53f00380'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:02.706263 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-94039348-5f0a-4d6b-89e1-29c85323943e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '271696eb14674f20bd6855fa53f00380'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:02.826241 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9d966079-bf63-4d7c-bc6e-3aeb4c7c93f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ea056d66ab545998c1b6304d191eda7', 'request_id': 'req-9d966079-bf63-4d7c-bc6e-3aeb4c7c93f6'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:02.850572 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9d966079-bf63-4d7c-bc6e-3aeb4c7c93f6 admin admin] The token cache is being invalidate because project 3ea056d66ab545998c1b6304d191eda7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:02.850892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9d966079-bf63-4d7c-bc6e-3aeb4c7c93f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:02.852274 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9d966079-bf63-4d7c-bc6e-3aeb4c7c93f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:02.858720 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 840/1670] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:02 2022] DELETE /identity/v3/projects/3ea056d66ab545998c1b6304d191eda7 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:02.858720 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d966079-bf63-4d7c-bc6e-3aeb4c7c93f6 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:02.858720 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9d966079-bf63-4d7c-bc6e-3aeb4c7c93f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:02.952739 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-94039348-5f0a-4d6b-89e1-29c85323943e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '271696eb14674f20bd6855fa53f00380'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:02.964555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-94039348-5f0a-4d6b-89e1-29c85323943e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '271696eb14674f20bd6855fa53f00380'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:02.978530 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 831/1671] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:02 2022] DELETE /identity/v3/users/271696eb14674f20bd6855fa53f00380 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:02.980331 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d559c-2615-49e3-82e3-a5fa1c928949 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:02.980826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d559c-2615-49e3-82e3-a5fa1c928949 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:02.981348 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d559c-2615-49e3-82e3-a5fa1c928949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:02.982909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d966079-bf63-4d7c-bc6e-3aeb4c7c93f6 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:03.054126 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-563d559c-2615-49e3-82e3-a5fa1c928949 None None] MFA Rules not processed for user `892f928ed891490f876f49ff52744850`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:03.056299 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-563d559c-2615-49e3-82e3-a5fa1c928949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:03.101072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:03.165165 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c29fd-eea5-4ef8-92c1-c3fe2a0f4117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:03.167361 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c29fd-eea5-4ef8-92c1-c3fe2a0f4117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:03.168877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c29fd-eea5-4ef8-92c1-c3fe2a0f4117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:03.169016 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c29fd-eea5-4ef8-92c1-c3fe2a0f4117 admin admin] PATH_INFO: `/v3/projects/948d978c3f2643eb850b7b54c1e7729e` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:03.170357 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c29fd-eea5-4ef8-92c1-c3fe2a0f4117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=948d978c3f2643eb850b7b54c1e7729e)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:03.176844 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c29fd-eea5-4ef8-92c1-c3fe2a0f4117 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:03.249458 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 832/1672] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:02 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:03.251551 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a033317-133a-486d-b76e-82526585c48f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:03.253020 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a033317-133a-486d-b76e-82526585c48f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:03.253457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a033317-133a-486d-b76e-82526585c48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:03.282860 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7a033317-133a-486d-b76e-82526585c48f None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:03.284359 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7a033317-133a-486d-b76e-82526585c48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:03.298859 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 833/1673] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:03.300419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c4a97-4780-43be-9072-e771b6cce40b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:03.300852 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c4a97-4780-43be-9072-e771b6cce40b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:03.301338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c4a97-4780-43be-9072-e771b6cce40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:03.329432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c89c4a97-4780-43be-9072-e771b6cce40b None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:03.330990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c89c4a97-4780-43be-9072-e771b6cce40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:03.343010 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 834/1674] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:03.352898 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c4a97-4780-43be-9072-e771b6cce40b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:03.355710 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c89c4a97-4780-43be-9072-e771b6cce40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:03.380687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c4a97-4780-43be-9072-e771b6cce40b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:03.401600 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ac1c29fd-eea5-4ef8-92c1-c3fe2a0f4117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '948d978c3f2643eb850b7b54c1e7729e', 'request_id': 'req-ac1c29fd-eea5-4ef8-92c1-c3fe2a0f4117'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:03.413558 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ac1c29fd-eea5-4ef8-92c1-c3fe2a0f4117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '948d978c3f2643eb850b7b54c1e7729e', 'request_id': 'req-ac1c29fd-eea5-4ef8-92c1-c3fe2a0f4117'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:03.528651 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e613b-7434-45e0-82f7-a99bbbc41ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:03.529219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e613b-7434-45e0-82f7-a99bbbc41ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:03.529505 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e613b-7434-45e0-82f7-a99bbbc41ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:03.529783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e613b-7434-45e0-82f7-a99bbbc41ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:03.530507 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e613b-7434-45e0-82f7-a99bbbc41ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:03.533650 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e613b-7434-45e0-82f7-a99bbbc41ca4 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:03.542049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ac1c29fd-eea5-4ef8-92c1-c3fe2a0f4117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '948d978c3f2643eb850b7b54c1e7729e', 'request_id': 'req-ac1c29fd-eea5-4ef8-92c1-c3fe2a0f4117'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:03.568059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ac1c29fd-eea5-4ef8-92c1-c3fe2a0f4117 admin admin] The token cache is being invalidate because project 948d978c3f2643eb850b7b54c1e7729e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:03.568696 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ac1c29fd-eea5-4ef8-92c1-c3fe2a0f4117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:03.569933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ac1c29fd-eea5-4ef8-92c1-c3fe2a0f4117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:03.573342 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 841/1675] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:02 2022] DELETE /identity/v3/projects/948d978c3f2643eb850b7b54c1e7729e => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:03.574913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94d04b-02b2-43e8-9bb6-1d1fc1e1a5df None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:03.575152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94d04b-02b2-43e8-9bb6-1d1fc1e1a5df None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:03.575428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94d04b-02b2-43e8-9bb6-1d1fc1e1a5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:03.622291 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-9d94d04b-02b2-43e8-9bb6-1d1fc1e1a5df None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:03.628053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9d94d04b-02b2-43e8-9bb6-1d1fc1e1a5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:03.641466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 842/1676] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:03.645052 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94d04b-02b2-43e8-9bb6-1d1fc1e1a5df None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:03.645052 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9d94d04b-02b2-43e8-9bb6-1d1fc1e1a5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:03.675383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 835/1677] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:03 2022] POST /identity/v3/projects => generated 405 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:03.677094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a0597-38e5-479e-9c83-687268e20c94 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:03.677382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a0597-38e5-479e-9c83-687268e20c94 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:03.677665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a0597-38e5-479e-9c83-687268e20c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:03.725988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-364a0597-38e5-479e-9c83-687268e20c94 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:03.728528 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-364a0597-38e5-479e-9c83-687268e20c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:03.780654 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94d04b-02b2-43e8-9bb6-1d1fc1e1a5df None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:03.861625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 836/1678] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:03.863838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a0597-38e5-479e-9c83-687268e20c94 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:03.885040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a0597-38e5-479e-9c83-687268e20c94 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:03.893367 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:03.924006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f856411-3b8d-4629-b5a2-189a708fe830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:03.929924 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f856411-3b8d-4629-b5a2-189a708fe830 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:03.930986 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f856411-3b8d-4629-b5a2-189a708fe830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:03.931268 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f856411-3b8d-4629-b5a2-189a708fe830 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:03.932015 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f856411-3b8d-4629-b5a2-189a708fe830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:04:03.932612 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f856411-3b8d-4629-b5a2-189a708fe830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:03.936846 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f856411-3b8d-4629-b5a2-189a708fe830 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:03.941690 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175db89-931c-4e31-9be5-abc3b6e7a242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:03.942328 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175db89-931c-4e31-9be5-abc3b6e7a242 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:03.942615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175db89-931c-4e31-9be5-abc3b6e7a242 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:03.942917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175db89-931c-4e31-9be5-abc3b6e7a242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:03.947611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0175db89-931c-4e31-9be5-abc3b6e7a242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:03.975369 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 837/1679] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:04:03.975369 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f856411-3b8d-4629-b5a2-189a708fe830 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:03.975369 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8f856411-3b8d-4629-b5a2-189a708fe830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:03.981536 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175db89-931c-4e31-9be5-abc3b6e7a242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:03.983083 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175db89-931c-4e31-9be5-abc3b6e7a242 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:03.986514 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f856411-3b8d-4629-b5a2-189a708fe830 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:03.996331 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224e18f-612a-4e53-a0f4-2065ba91187a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:03.997025 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224e18f-612a-4e53-a0f4-2065ba91187a admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:03.997315 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224e18f-612a-4e53-a0f4-2065ba91187a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:03.997595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224e18f-612a-4e53-a0f4-2065ba91187a admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:03.998222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7224e18f-612a-4e53-a0f4-2065ba91187a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:04.001344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7224e18f-612a-4e53-a0f4-2065ba91187a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:04.024221 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 843/1680] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:04.024221 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f2c53-8e54-436d-ac7c-2042cd17e000 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:04.027063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f2c53-8e54-436d-ac7c-2042cd17e000 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:04.027063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f2c53-8e54-436d-ac7c-2042cd17e000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:04.083985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ed2f2c53-8e54-436d-ac7c-2042cd17e000 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:04.085245 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ed2f2c53-8e54-436d-ac7c-2042cd17e000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:04.097690 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 844/1681] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:04.099098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21b6cf-4696-47d8-983c-7a437eb55ea2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:04.099387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21b6cf-4696-47d8-983c-7a437eb55ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:04.099663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21b6cf-4696-47d8-983c-7a437eb55ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:04.155753 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 838/1682] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:03 2022] POST /identity/v3/users => generated 309 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:04.155753 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc6890-172c-415c-81e4-43eb934b1d23 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:04.155753 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc6890-172c-415c-81e4-43eb934b1d23 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:04.156739 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc6890-172c-415c-81e4-43eb934b1d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:04.167162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5e21b6cf-4696-47d8-983c-7a437eb55ea2 None None] MFA Rules not processed for user `38e8806e8adc4d2cbdfdd06442834571`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:04.168411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5e21b6cf-4696-47d8-983c-7a437eb55ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:04.224552 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-04fc6890-172c-415c-81e4-43eb934b1d23 None None] MFA Rules not processed for user `950e6ba9e8ed4e00843657869bc3a26d`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:04.226063 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-04fc6890-172c-415c-81e4-43eb934b1d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:04.325281 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 839/1683] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:04.326063 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc6890-172c-415c-81e4-43eb934b1d23 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:04.328086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 845/1684] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:04.333502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21b6cf-4696-47d8-983c-7a437eb55ea2 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:04.339534 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc6890-172c-415c-81e4-43eb934b1d23 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:04.352108 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2446b-f754-4dc3-a81a-31ba3acd1d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:04.353145 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2446b-f754-4dc3-a81a-31ba3acd1d21 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:04.353583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21b6cf-4696-47d8-983c-7a437eb55ea2 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:04.353816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2446b-f754-4dc3-a81a-31ba3acd1d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:04.354194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2446b-f754-4dc3-a81a-31ba3acd1d21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:04.355085 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2446b-f754-4dc3-a81a-31ba3acd1d21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:04.357834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2446b-f754-4dc3-a81a-31ba3acd1d21 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:04.370961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52058b96-418d-4e6a-b14b-80b3708b4ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:04.371594 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52058b96-418d-4e6a-b14b-80b3708b4ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:04.371877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52058b96-418d-4e6a-b14b-80b3708b4ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:04.372152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52058b96-418d-4e6a-b14b-80b3708b4ee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:04.372817 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52058b96-418d-4e6a-b14b-80b3708b4ee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:04:04.373125 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52058b96-418d-4e6a-b14b-80b3708b4ee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:04.374787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52058b96-418d-4e6a-b14b-80b3708b4ee2 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:04.401960 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 846/1685] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:04:04.402868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52058b96-418d-4e6a-b14b-80b3708b4ee2 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:04.427599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52058b96-418d-4e6a-b14b-80b3708b4ee2 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:04.443809 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e10a7c-63b9-46fd-804e-79170d9da1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:04.444448 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e10a7c-63b9-46fd-804e-79170d9da1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:04.445242 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e10a7c-63b9-46fd-804e-79170d9da1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:04.445522 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e10a7c-63b9-46fd-804e-79170d9da1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:04.446191 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e10a7c-63b9-46fd-804e-79170d9da1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:04.450021 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e10a7c-63b9-46fd-804e-79170d9da1c4 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:04.479922 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 847/1686] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:04.481954 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64f396-509b-45c1-b180-91ef15d8b06e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:04.483021 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64f396-509b-45c1-b180-91ef15d8b06e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:04.483527 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64f396-509b-45c1-b180-91ef15d8b06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:04.501034 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 840/1687] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:04 2022] POST /identity/v3/projects => generated 381 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:04.502185 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2446b-f754-4dc3-a81a-31ba3acd1d21 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:04.504936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-02f2446b-f754-4dc3-a81a-31ba3acd1d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:04.512331 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-be64f396-509b-45c1-b180-91ef15d8b06e None None] MFA Rules not processed for user `38e8806e8adc4d2cbdfdd06442834571`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:04.514575 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-be64f396-509b-45c1-b180-91ef15d8b06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:04.527955 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:04.608025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 848/1688] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:04.609148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64f396-509b-45c1-b180-91ef15d8b06e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:04.710177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2446b-f754-4dc3-a81a-31ba3acd1d21 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:04.717935 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64f396-509b-45c1-b180-91ef15d8b06e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:04.718112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d615b-fe04-4327-b3dc-efa7241692b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:04.719147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d615b-fe04-4327-b3dc-efa7241692b3 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:04.719346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d615b-fe04-4327-b3dc-efa7241692b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:04.719982 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d615b-fe04-4327-b3dc-efa7241692b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:04.724277 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97594ee8-f49f-4953-b33a-2a4dc2fe8dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:04.725113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97594ee8-f49f-4953-b33a-2a4dc2fe8dcb admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:04.725561 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97594ee8-f49f-4953-b33a-2a4dc2fe8dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:04.726263 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97594ee8-f49f-4953-b33a-2a4dc2fe8dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:04.727147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97594ee8-f49f-4953-b33a-2a4dc2fe8dcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:04.729264 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97594ee8-f49f-4953-b33a-2a4dc2fe8dcb admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:04.826572 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d615b-fe04-4327-b3dc-efa7241692b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:04.842170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d615b-fe04-4327-b3dc-efa7241692b3 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:04.857396 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 841/1689] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:04.858466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d615b-fe04-4327-b3dc-efa7241692b3 service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:04.881734 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 849/1690] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:04 2022] POST /identity/v3/projects => generated 379 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:04.882998 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97594ee8-f49f-4953-b33a-2a4dc2fe8dcb admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:04.885543 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d615b-fe04-4327-b3dc-efa7241692b3 service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:05.021593 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986eef4-5b01-494e-8de0-e9d1136ece06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:05.021795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986eef4-5b01-494e-8de0-e9d1136ece06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:05.022407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986eef4-5b01-494e-8de0-e9d1136ece06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:05.022704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986eef4-5b01-494e-8de0-e9d1136ece06 admin admin] PATH_INFO: `/v3/projects/a410a4503fc347a6838fd6eb2d37ddd3/users/905e6067c72e4a7a9b7a73051ee8e16b/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:05.059266 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986eef4-5b01-494e-8de0-e9d1136ece06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a410a4503fc347a6838fd6eb2d37ddd3, user_id=905e6067c72e4a7a9b7a73051ee8e16b, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:05.061862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986eef4-5b01-494e-8de0-e9d1136ece06 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:05.071559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97594ee8-f49f-4953-b33a-2a4dc2fe8dcb admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:05.083322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e189f-0819-4942-a9cf-e0a22e721b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:05.084243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e189f-0819-4942-a9cf-e0a22e721b63 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:05.085029 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e189f-0819-4942-a9cf-e0a22e721b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:05.087472 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e189f-0819-4942-a9cf-e0a22e721b63 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:05.087472 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e189f-0819-4942-a9cf-e0a22e721b63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:05.090571 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e189f-0819-4942-a9cf-e0a22e721b63 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:05.206836 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 842/1691] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:04 2022] PUT /identity/v3/projects/a410a4503fc347a6838fd6eb2d37ddd3/users/905e6067c72e4a7a9b7a73051ee8e16b/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:05.214745 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986eef4-5b01-494e-8de0-e9d1136ece06 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:05.214745 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a986eef4-5b01-494e-8de0-e9d1136ece06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:05.245831 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 850/1692] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:04 2022] POST /identity/v3/users => generated 291 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:05.246677 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e189f-0819-4942-a9cf-e0a22e721b63 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:05.279669 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e189f-0819-4942-a9cf-e0a22e721b63 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:05.376150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa4c9c-21dd-4ca0-bbb6-113ba34478c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:05.376892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa4c9c-21dd-4ca0-bbb6-113ba34478c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:05.378782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa4c9c-21dd-4ca0-bbb6-113ba34478c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:05.379086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa4c9c-21dd-4ca0-bbb6-113ba34478c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:05.379765 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa4c9c-21dd-4ca0-bbb6-113ba34478c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:05.381798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa4c9c-21dd-4ca0-bbb6-113ba34478c2 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:05.389438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986eef4-5b01-494e-8de0-e9d1136ece06 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:05.397111 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef571b-666d-4a87-9cbe-e8f3ad630815 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:05.397777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef571b-666d-4a87-9cbe-e8f3ad630815 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:05.398062 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef571b-666d-4a87-9cbe-e8f3ad630815 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:05.398337 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef571b-666d-4a87-9cbe-e8f3ad630815 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:05.483903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef571b-666d-4a87-9cbe-e8f3ad630815 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:05.485897 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef571b-666d-4a87-9cbe-e8f3ad630815 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:05.498615 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 843/1693] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:05.499606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef571b-666d-4a87-9cbe-e8f3ad630815 service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:05.523857 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef571b-666d-4a87-9cbe-e8f3ad630815 service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:05.530285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4e4ff-d947-4d51-9f9d-4b1c4173bfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:05.531421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4e4ff-d947-4d51-9f9d-4b1c4173bfa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:05.531421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4e4ff-d947-4d51-9f9d-4b1c4173bfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:05.531673 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4e4ff-d947-4d51-9f9d-4b1c4173bfa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:05.533374 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4e4ff-d947-4d51-9f9d-4b1c4173bfa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:05.535786 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4e4ff-d947-4d51-9f9d-4b1c4173bfa5 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:05.545450 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 851/1694] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:05 2022] POST /identity/v3/users => generated 290 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:05.546316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa4c9c-21dd-4ca0-bbb6-113ba34478c2 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:05.556556 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 844/1695] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:05.556556 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4e4ff-d947-4d51-9f9d-4b1c4173bfa5 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:05.556842 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1ed4e4ff-d947-4d51-9f9d-4b1c4173bfa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:05.572972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa4c9c-21dd-4ca0-bbb6-113ba34478c2 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:05.576661 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4e4ff-d947-4d51-9f9d-4b1c4173bfa5 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:05.578085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c31498-c53a-426a-99d1-c8da2ab19e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:05.579369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c31498-c53a-426a-99d1-c8da2ab19e87 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:05.579728 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c31498-c53a-426a-99d1-c8da2ab19e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:05.580001 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c31498-c53a-426a-99d1-c8da2ab19e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:05.580667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c31498-c53a-426a-99d1-c8da2ab19e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:05.582290 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c31498-c53a-426a-99d1-c8da2ab19e87 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:05.588659 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc01ba9-13af-42a0-a2ae-4f9a7e7b93d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:05.588659 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc01ba9-13af-42a0-a2ae-4f9a7e7b93d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:05.588659 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc01ba9-13af-42a0-a2ae-4f9a7e7b93d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:05.588659 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc01ba9-13af-42a0-a2ae-4f9a7e7b93d3 admin admin] PATH_INFO: `/v3/projects/633e05cf8c4d4977aa15c3a7cad34ed3` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:05.590587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc01ba9-13af-42a0-a2ae-4f9a7e7b93d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=633e05cf8c4d4977aa15c3a7cad34ed3)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:05.592760 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc01ba9-13af-42a0-a2ae-4f9a7e7b93d3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:05.610512 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 852/1696] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:05.610512 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c31498-c53a-426a-99d1-c8da2ab19e87 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:05.636609 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c31498-c53a-426a-99d1-c8da2ab19e87 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:05.646887 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed38d38-c325-4a14-8584-35f8bb0737f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:05.647848 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed38d38-c325-4a14-8584-35f8bb0737f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:05.648142 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed38d38-c325-4a14-8584-35f8bb0737f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:05.648418 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed38d38-c325-4a14-8584-35f8bb0737f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:05.649680 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed38d38-c325-4a14-8584-35f8bb0737f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:05.654944 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed38d38-c325-4a14-8584-35f8bb0737f9 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:05.678299 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 853/1697] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:05.679320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed38d38-c325-4a14-8584-35f8bb0737f9 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:05.696981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed38d38-c325-4a14-8584-35f8bb0737f9 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:05.713890 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5337ec9-2594-4995-ba96-db58155fde69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:05.714579 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5337ec9-2594-4995-ba96-db58155fde69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:05.714889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5337ec9-2594-4995-ba96-db58155fde69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:05.720598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5337ec9-2594-4995-ba96-db58155fde69 admin admin] PATH_INFO: `/v3/projects/a410a4503fc347a6838fd6eb2d37ddd3/users/905e6067c72e4a7a9b7a73051ee8e16b/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:05.724721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5337ec9-2594-4995-ba96-db58155fde69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a410a4503fc347a6838fd6eb2d37ddd3, user_id=905e6067c72e4a7a9b7a73051ee8e16b, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:05.730777 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5337ec9-2594-4995-ba96-db58155fde69 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:05.757892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 854/1698] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:05 2022] PUT /identity/v3/projects/a410a4503fc347a6838fd6eb2d37ddd3/users/905e6067c72e4a7a9b7a73051ee8e16b/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:05.757892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5337ec9-2594-4995-ba96-db58155fde69 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:05.846240 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8cc01ba9-13af-42a0-a2ae-4f9a7e7b93d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633e05cf8c4d4977aa15c3a7cad34ed3', 'request_id': 'req-8cc01ba9-13af-42a0-a2ae-4f9a7e7b93d3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:05.856186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8cc01ba9-13af-42a0-a2ae-4f9a7e7b93d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633e05cf8c4d4977aa15c3a7cad34ed3', 'request_id': 'req-8cc01ba9-13af-42a0-a2ae-4f9a7e7b93d3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:05.867574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8cc01ba9-13af-42a0-a2ae-4f9a7e7b93d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633e05cf8c4d4977aa15c3a7cad34ed3', 'request_id': 'req-8cc01ba9-13af-42a0-a2ae-4f9a7e7b93d3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:05.891572 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5337ec9-2594-4995-ba96-db58155fde69 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:05.976950 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9c2b8-f374-4779-bd51-6a5eb0f94689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:05.977593 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9c2b8-f374-4779-bd51-6a5eb0f94689 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:05.977897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9c2b8-f374-4779-bd51-6a5eb0f94689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:05.978177 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9c2b8-f374-4779-bd51-6a5eb0f94689 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:05.979046 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9c2b8-f374-4779-bd51-6a5eb0f94689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:05.982750 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9c2b8-f374-4779-bd51-6a5eb0f94689 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:06.001393 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 855/1699] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:06.003416 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9c2b8-f374-4779-bd51-6a5eb0f94689 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:06.022658 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9c2b8-f374-4779-bd51-6a5eb0f94689 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:06.046145 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8cc01ba9-13af-42a0-a2ae-4f9a7e7b93d3 admin admin] The token cache is being invalidate because project 633e05cf8c4d4977aa15c3a7cad34ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:06.046570 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8cc01ba9-13af-42a0-a2ae-4f9a7e7b93d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:06.048007 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8cc01ba9-13af-42a0-a2ae-4f9a7e7b93d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:06.050051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 845/1700] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:05 2022] DELETE /identity/v3/projects/633e05cf8c4d4977aa15c3a7cad34ed3 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:06.055329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc01ba9-13af-42a0-a2ae-4f9a7e7b93d3 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:06.056007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ca3af-cf27-4d83-8101-de29ec35a2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:06.056657 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ca3af-cf27-4d83-8101-de29ec35a2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:06.057527 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ca3af-cf27-4d83-8101-de29ec35a2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:06.057842 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ca3af-cf27-4d83-8101-de29ec35a2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:06.058513 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ca3af-cf27-4d83-8101-de29ec35a2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:06.059997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8cc01ba9-13af-42a0-a2ae-4f9a7e7b93d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:06.065160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ca3af-cf27-4d83-8101-de29ec35a2e9 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:06.093332 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc01ba9-13af-42a0-a2ae-4f9a7e7b93d3 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:06.097838 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 856/1701] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:06.098857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ca3af-cf27-4d83-8101-de29ec35a2e9 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:06.105983 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b83ca3af-cf27-4d83-8101-de29ec35a2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:06.107567 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e94bc-3f86-4a74-8f4a-66749af376ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:06.108670 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e94bc-3f86-4a74-8f4a-66749af376ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:06.108670 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e94bc-3f86-4a74-8f4a-66749af376ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:06.109141 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e94bc-3f86-4a74-8f4a-66749af376ff admin admin] PATH_INFO: `/v3/users/9422fb93cd6749a9a8a24a48d886bdc1` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:06.114109 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e94bc-3f86-4a74-8f4a-66749af376ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9422fb93cd6749a9a8a24a48d886bdc1)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:06.116284 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e94bc-3f86-4a74-8f4a-66749af376ff admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:06.121471 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ca3af-cf27-4d83-8101-de29ec35a2e9 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:06.134440 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e3426-4a8e-4c82-8249-5131e392c8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:06.136507 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e3426-4a8e-4c82-8249-5131e392c8e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:06.139589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e3426-4a8e-4c82-8249-5131e392c8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:06.140173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e3426-4a8e-4c82-8249-5131e392c8e7 admin admin] PATH_INFO: `/v3/projects/6ee6784c58a944f08f61df4156dd961b/users/f5edd486741b4a1f99ba1c33f645bd56/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:06.174800 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e3426-4a8e-4c82-8249-5131e392c8e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee6784c58a944f08f61df4156dd961b, user_id=f5edd486741b4a1f99ba1c33f645bd56, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:06.178728 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e3426-4a8e-4c82-8249-5131e392c8e7 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:06.330902 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:06.340873 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 857/1702] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:06 2022] PUT /identity/v3/projects/6ee6784c58a944f08f61df4156dd961b/users/f5edd486741b4a1f99ba1c33f645bd56/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:06.341706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e3426-4a8e-4c82-8249-5131e392c8e7 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:06.353560 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-271e3426-4a8e-4c82-8249-5131e392c8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:06.431445 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e3426-4a8e-4c82-8249-5131e392c8e7 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:06.437699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecdae1-32b4-483b-9d39-042c941af588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:06.439176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecdae1-32b4-483b-9d39-042c941af588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:06.439632 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecdae1-32b4-483b-9d39-042c941af588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:06.440231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecdae1-32b4-483b-9d39-042c941af588 admin admin] PATH_INFO: `/v3/users/237360fcd4a8400aa15022214d7293a2` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:06.445393 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecdae1-32b4-483b-9d39-042c941af588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=237360fcd4a8400aa15022214d7293a2)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:06.445393 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecdae1-32b4-483b-9d39-042c941af588 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:06.463515 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-df5e94bc-3f86-4a74-8f4a-66749af376ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9422fb93cd6749a9a8a24a48d886bdc1'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:06.490975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-df5e94bc-3f86-4a74-8f4a-66749af376ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9422fb93cd6749a9a8a24a48d886bdc1'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:06.491257 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-df5e94bc-3f86-4a74-8f4a-66749af376ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9422fb93cd6749a9a8a24a48d886bdc1'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:06.564696 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-df5e94bc-3f86-4a74-8f4a-66749af376ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9422fb93cd6749a9a8a24a48d886bdc1'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:06.587409 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-df5e94bc-3f86-4a74-8f4a-66749af376ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9422fb93cd6749a9a8a24a48d886bdc1'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:06.594913 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 846/1703] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:06 2022] DELETE /identity/v3/users/9422fb93cd6749a9a8a24a48d886bdc1 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:06.601774 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e94bc-3f86-4a74-8f4a-66749af376ff admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:06.601774 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-df5e94bc-3f86-4a74-8f4a-66749af376ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:06.671621 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-54ecdae1-32b4-483b-9d39-042c941af588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '237360fcd4a8400aa15022214d7293a2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:06.673215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-54ecdae1-32b4-483b-9d39-042c941af588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '237360fcd4a8400aa15022214d7293a2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:06.680560 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e94bc-3f86-4a74-8f4a-66749af376ff admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:06.690998 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc7720-8bc1-434d-8c35-879e5838bdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:06.691702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc7720-8bc1-434d-8c35-879e5838bdd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:06.691999 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc7720-8bc1-434d-8c35-879e5838bdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:06.692262 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc7720-8bc1-434d-8c35-879e5838bdd1 admin admin] PATH_INFO: `/v3/projects/f1526fe1946a4ff2828630bd2d7a7522/users/1a140ca004524760ab37dc11cb3fd1f7/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:06.694948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-54ecdae1-32b4-483b-9d39-042c941af588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '237360fcd4a8400aa15022214d7293a2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:06.703301 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-54ecdae1-32b4-483b-9d39-042c941af588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '237360fcd4a8400aa15022214d7293a2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:06.711095 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc7720-8bc1-434d-8c35-879e5838bdd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1526fe1946a4ff2828630bd2d7a7522, user_id=1a140ca004524760ab37dc11cb3fd1f7, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:06.714922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc7720-8bc1-434d-8c35-879e5838bdd1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:06.847565 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-54ecdae1-32b4-483b-9d39-042c941af588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '237360fcd4a8400aa15022214d7293a2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:06.865251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 847/1704] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:06 2022] PUT /identity/v3/projects/f1526fe1946a4ff2828630bd2d7a7522/users/1a140ca004524760ab37dc11cb3fd1f7/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:06.865251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1836806-ce52-4bf8-bea4-03dd5ade5b44 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:06.865251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1836806-ce52-4bf8-bea4-03dd5ade5b44 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:06.865251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1836806-ce52-4bf8-bea4-03dd5ade5b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:06.881873 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 858/1705] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:06 2022] DELETE /identity/v3/users/237360fcd4a8400aa15022214d7293a2 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:06.882251 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9808b3-1e64-40e3-89ab-e15c35a20994 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:06.882532 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9808b3-1e64-40e3-89ab-e15c35a20994 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:06.885835 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9808b3-1e64-40e3-89ab-e15c35a20994 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:06.887456 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 859/1706] 10.222.0.43 () {54 vars in 912 bytes} [Thu Aug 11 11:04:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:04:06.888662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01832bbc-988f-48e2-bb7d-815b42143b22 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:06.900409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01832bbc-988f-48e2-bb7d-815b42143b22 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:06.901987 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01832bbc-988f-48e2-bb7d-815b42143b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:06.936696 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d1836806-ce52-4bf8-bea4-03dd5ade5b44 None None] MFA Rules not processed for user `f5edd486741b4a1f99ba1c33f645bd56`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:06.938163 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d1836806-ce52-4bf8-bea4-03dd5ade5b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:06.946473 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-01832bbc-988f-48e2-bb7d-815b42143b22 None None] MFA Rules not processed for user `060fd4adbdce44dfbf65e21561bfa532`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:06.947729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-01832bbc-988f-48e2-bb7d-815b42143b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:07.010148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 860/1707] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:07.011627 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab96708-4d6d-43a3-b284-10507812b67c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:07.011919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab96708-4d6d-43a3-b284-10507812b67c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:07.012460 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab96708-4d6d-43a3-b284-10507812b67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:07.026534 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 848/1708] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:07.027934 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bf832-43e3-4b06-8d30-7d496b5eab74 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:07.028268 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bf832-43e3-4b06-8d30-7d496b5eab74 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:07.028551 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bf832-43e3-4b06-8d30-7d496b5eab74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:07.049415 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-eab96708-4d6d-43a3-b284-10507812b67c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:07.051113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-eab96708-4d6d-43a3-b284-10507812b67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:07.067459 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-cc9bf832-43e3-4b06-8d30-7d496b5eab74 None None] MFA Rules not processed for user `1a140ca004524760ab37dc11cb3fd1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:07.068948 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cc9bf832-43e3-4b06-8d30-7d496b5eab74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:07.152623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 861/1709] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:07.152623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c610b87-ccfd-4f7f-aa41-89b3948183f7 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:07.152623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c610b87-ccfd-4f7f-aa41-89b3948183f7 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:07.152623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c610b87-ccfd-4f7f-aa41-89b3948183f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:07.165948 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 849/1710] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:07.166895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9bf832-43e3-4b06-8d30-7d496b5eab74 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:07.168595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cc9bf832-43e3-4b06-8d30-7d496b5eab74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:07.190653 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9bf832-43e3-4b06-8d30-7d496b5eab74 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:07.218795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38d10c-9604-4285-9921-bb4cf85080e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:07.218795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38d10c-9604-4285-9921-bb4cf85080e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:07.218795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38d10c-9604-4285-9921-bb4cf85080e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:07.218795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38d10c-9604-4285-9921-bb4cf85080e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:07.219758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38d10c-9604-4285-9921-bb4cf85080e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:07.221964 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38d10c-9604-4285-9921-bb4cf85080e5 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:07.244963 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5c610b87-ccfd-4f7f-aa41-89b3948183f7 None None] MFA Rules not processed for user `6302b1f98544470a8986055a68bcd948`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:07.246560 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5c610b87-ccfd-4f7f-aa41-89b3948183f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:07.341508 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 862/1711] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Aug 11 11:04:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:07.342627 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c610b87-ccfd-4f7f-aa41-89b3948183f7 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:07.344976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5c610b87-ccfd-4f7f-aa41-89b3948183f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:07.359947 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c610b87-ccfd-4f7f-aa41-89b3948183f7 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:07.366464 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba3c62-8b6c-42ce-aebc-19d0ec90f523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:07.368063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba3c62-8b6c-42ce-aebc-19d0ec90f523 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:07.368347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba3c62-8b6c-42ce-aebc-19d0ec90f523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:07.368620 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba3c62-8b6c-42ce-aebc-19d0ec90f523 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:07.369391 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba3c62-8b6c-42ce-aebc-19d0ec90f523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:07.371627 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba3c62-8b6c-42ce-aebc-19d0ec90f523 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:07.393511 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 850/1712] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:07 2022] POST /identity/v3/projects => generated 381 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:07.399031 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38d10c-9604-4285-9921-bb4cf85080e5 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:07.401469 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cd38d10c-9604-4285-9921-bb4cf85080e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:07.525779 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38d10c-9604-4285-9921-bb4cf85080e5 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:07.532817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8a436-25fa-4c32-8ab0-0e9e9d668861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:07.533920 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8a436-25fa-4c32-8ab0-0e9e9d668861 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:07.534353 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8a436-25fa-4c32-8ab0-0e9e9d668861 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:07.535881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8a436-25fa-4c32-8ab0-0e9e9d668861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:07.538415 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 863/1713] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:07 2022] POST /identity/v3/projects => generated 381 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:07.539343 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba3c62-8b6c-42ce-aebc-19d0ec90f523 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:07.551925 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e3ba3c62-8b6c-42ce-aebc-19d0ec90f523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:07.637635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8a436-25fa-4c32-8ab0-0e9e9d668861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:07.639238 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8a436-25fa-4c32-8ab0-0e9e9d668861 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:07.653784 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 851/1714] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:07.654752 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8a436-25fa-4c32-8ab0-0e9e9d668861 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:07.665916 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8a436-25fa-4c32-8ab0-0e9e9d668861 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:07.670559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba3c62-8b6c-42ce-aebc-19d0ec90f523 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:07.677572 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188ebdd-931f-4b45-8955-5b263adf2dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:07.678996 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188ebdd-931f-4b45-8955-5b263adf2dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:07.679401 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188ebdd-931f-4b45-8955-5b263adf2dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:07.679796 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188ebdd-931f-4b45-8955-5b263adf2dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:07.691565 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188ebdd-931f-4b45-8955-5b263adf2dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:07.711982 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188ebdd-931f-4b45-8955-5b263adf2dd7 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:07.748488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 864/1715] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:07.750995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188ebdd-931f-4b45-8955-5b263adf2dd7 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:07.870254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab6503-4e00-4a0b-94e4-49f2128fce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:07.871478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab6503-4e00-4a0b-94e4-49f2128fce4f admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:07.871478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab6503-4e00-4a0b-94e4-49f2128fce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:07.871656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab6503-4e00-4a0b-94e4-49f2128fce4f admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:07.872216 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab6503-4e00-4a0b-94e4-49f2128fce4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:07.874596 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab6503-4e00-4a0b-94e4-49f2128fce4f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:07.900161 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188ebdd-931f-4b45-8955-5b263adf2dd7 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:07.905284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae971b4-974b-49fc-b5d1-be81b78037f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:07.905960 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae971b4-974b-49fc-b5d1-be81b78037f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:07.906308 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae971b4-974b-49fc-b5d1-be81b78037f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:07.906690 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae971b4-974b-49fc-b5d1-be81b78037f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:07.907374 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae971b4-974b-49fc-b5d1-be81b78037f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:07.922600 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae971b4-974b-49fc-b5d1-be81b78037f6 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:07.979571 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 852/1716] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:07 2022] POST /identity/v3/users => generated 297 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:07.980045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b657d-b348-4349-b92b-487f36b613c9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:07.980325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b657d-b348-4349-b92b-487f36b613c9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:07.980665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b657d-b348-4349-b92b-487f36b613c9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:07.982285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 853/1717] 10.222.0.43 () {54 vars in 912 bytes} [Thu Aug 11 11:04:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:04:07.982984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b657d-b348-4349-b92b-487f36b613c9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:08.001703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b657d-b348-4349-b92b-487f36b613c9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:08.008711 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca846f75-158c-4e19-a3ce-7192ba736732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:08.009853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca846f75-158c-4e19-a3ce-7192ba736732 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:08.010559 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca846f75-158c-4e19-a3ce-7192ba736732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:08.011523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca846f75-158c-4e19-a3ce-7192ba736732 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:08.012513 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca846f75-158c-4e19-a3ce-7192ba736732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:08.015987 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca846f75-158c-4e19-a3ce-7192ba736732 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:08.053316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 854/1718] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:08.053316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c274db-c906-43ba-92da-9fc3e4cdba67 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:08.053316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c274db-c906-43ba-92da-9fc3e4cdba67 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:08.053316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c274db-c906-43ba-92da-9fc3e4cdba67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:08.082793 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 865/1719] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:07 2022] POST /identity/v3/users => generated 297 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:08.083582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae971b4-974b-49fc-b5d1-be81b78037f6 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:08.101885 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-78c274db-c906-43ba-92da-9fc3e4cdba67 None None] MFA Rules not processed for user `6302b1f98544470a8986055a68bcd948`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:08.104899 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-78c274db-c906-43ba-92da-9fc3e4cdba67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:08.113680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 855/1720] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Aug 11 11:04:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:08.115317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c274db-c906-43ba-92da-9fc3e4cdba67 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:08.126820 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae971b4-974b-49fc-b5d1-be81b78037f6 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:08.133543 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c274db-c906-43ba-92da-9fc3e4cdba67 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:08.139066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0f062-cbfc-4eb9-9afe-cb951dbf72d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:08.140211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0f062-cbfc-4eb9-9afe-cb951dbf72d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:08.140849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0f062-cbfc-4eb9-9afe-cb951dbf72d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:08.141339 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0f062-cbfc-4eb9-9afe-cb951dbf72d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:08.142250 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0f062-cbfc-4eb9-9afe-cb951dbf72d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:08.145200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0f062-cbfc-4eb9-9afe-cb951dbf72d6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:08.145661 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cabdb-a210-42da-aea0-a2e70c7de489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:08.146353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cabdb-a210-42da-aea0-a2e70c7de489 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:08.146630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cabdb-a210-42da-aea0-a2e70c7de489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:08.146933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cabdb-a210-42da-aea0-a2e70c7de489 admin admin] PATH_INFO: `/v3/projects/9eea33a21127474094e93aaf5530b306/users/4ff3870777184bd8afe37260747e75e3/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:08.160531 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 856/1721] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:08.166287 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0f062-cbfc-4eb9-9afe-cb951dbf72d6 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:08.189106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7cabdb-a210-42da-aea0-a2e70c7de489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eea33a21127474094e93aaf5530b306, user_id=4ff3870777184bd8afe37260747e75e3, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:08.191938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:08.192220 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7cabdb-a210-42da-aea0-a2e70c7de489 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:08.196377 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0f062-cbfc-4eb9-9afe-cb951dbf72d6 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:08.206849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838abfa0-25eb-4a97-b1cc-e5b41470a88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:08.210167 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838abfa0-25eb-4a97-b1cc-e5b41470a88c admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:08.217647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838abfa0-25eb-4a97-b1cc-e5b41470a88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:08.217647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838abfa0-25eb-4a97-b1cc-e5b41470a88c admin admin] PATH_INFO: `/v3/projects/f38704f67d5a4574bcf1e46d2c3217df/users/1515d99518584c52b46af2cd379e3f89/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:08.260893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838abfa0-25eb-4a97-b1cc-e5b41470a88c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f38704f67d5a4574bcf1e46d2c3217df, user_id=1515d99518584c52b46af2cd379e3f89, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:08.266010 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838abfa0-25eb-4a97-b1cc-e5b41470a88c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:08.289831 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 866/1722] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:08 2022] PUT /identity/v3/projects/9eea33a21127474094e93aaf5530b306/users/4ff3870777184bd8afe37260747e75e3/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:08.290684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cabdb-a210-42da-aea0-a2e70c7de489 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:08.364412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 857/1723] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:08 2022] PUT /identity/v3/projects/f38704f67d5a4574bcf1e46d2c3217df/users/1515d99518584c52b46af2cd379e3f89/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:08.364412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838abfa0-25eb-4a97-b1cc-e5b41470a88c admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:08.386820 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cabdb-a210-42da-aea0-a2e70c7de489 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:08.462228 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838abfa0-25eb-4a97-b1cc-e5b41470a88c admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:08.467120 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce042388-5a17-4752-a267-bac8bd6bdd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:08.467737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce042388-5a17-4752-a267-bac8bd6bdd85 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:08.468016 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce042388-5a17-4752-a267-bac8bd6bdd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:08.468329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce042388-5a17-4752-a267-bac8bd6bdd85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:08.469051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce042388-5a17-4752-a267-bac8bd6bdd85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:08.471416 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce042388-5a17-4752-a267-bac8bd6bdd85 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:08.483722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 858/1724] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:08.485488 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce042388-5a17-4752-a267-bac8bd6bdd85 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:08.500078 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21ac03-32d6-4e19-9333-6fc975333612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:08.501184 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21ac03-32d6-4e19-9333-6fc975333612 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:08.501533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21ac03-32d6-4e19-9333-6fc975333612 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:08.501816 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21ac03-32d6-4e19-9333-6fc975333612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:08.514136 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce042388-5a17-4752-a267-bac8bd6bdd85 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:08.517508 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21ac03-32d6-4e19-9333-6fc975333612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:08.519043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21ac03-32d6-4e19-9333-6fc975333612 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:08.522038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24c900-9334-460a-a5e3-f1fdb0329047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:08.523005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24c900-9334-460a-a5e3-f1fdb0329047 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:08.523687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24c900-9334-460a-a5e3-f1fdb0329047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:08.523967 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24c900-9334-460a-a5e3-f1fdb0329047 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:08.524602 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24c900-9334-460a-a5e3-f1fdb0329047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:08.526209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24c900-9334-460a-a5e3-f1fdb0329047 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:08.529315 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 867/1725] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:08.530350 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21ac03-32d6-4e19-9333-6fc975333612 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:08.545374 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21ac03-32d6-4e19-9333-6fc975333612 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:08.558799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e7371-86f7-4147-9233-3e0dbe358fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:08.559713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e7371-86f7-4147-9233-3e0dbe358fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:08.560144 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e7371-86f7-4147-9233-3e0dbe358fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:08.560622 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 859/1726] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:08.560841 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e7371-86f7-4147-9233-3e0dbe358fc0 admin admin] PATH_INFO: `/v3/projects/9eea33a21127474094e93aaf5530b306/users/4ff3870777184bd8afe37260747e75e3/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:08.565485 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24c900-9334-460a-a5e3-f1fdb0329047 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:08.565715 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e7371-86f7-4147-9233-3e0dbe358fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eea33a21127474094e93aaf5530b306, user_id=4ff3870777184bd8afe37260747e75e3, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:08.570167 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e7371-86f7-4147-9233-3e0dbe358fc0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:08.586616 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24c900-9334-460a-a5e3-f1fdb0329047 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:08.593046 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 868/1727] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:08 2022] PUT /identity/v3/projects/9eea33a21127474094e93aaf5530b306/users/4ff3870777184bd8afe37260747e75e3/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:08.599865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e7371-86f7-4147-9233-3e0dbe358fc0 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:08.606526 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-334e7371-86f7-4147-9233-3e0dbe358fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:08.712477 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabe050-9bae-4861-8f66-28f9eaa198aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:08.714281 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabe050-9bae-4861-8f66-28f9eaa198aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:08.714737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabe050-9bae-4861-8f66-28f9eaa198aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:08.717468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabe050-9bae-4861-8f66-28f9eaa198aa admin admin] PATH_INFO: `/v3/projects/f38704f67d5a4574bcf1e46d2c3217df/users/1515d99518584c52b46af2cd379e3f89/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:08.721547 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabe050-9bae-4861-8f66-28f9eaa198aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f38704f67d5a4574bcf1e46d2c3217df, user_id=1515d99518584c52b46af2cd379e3f89, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:08.726840 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabe050-9bae-4861-8f66-28f9eaa198aa admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:08.741988 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e7371-86f7-4147-9233-3e0dbe358fc0 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:08.761228 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 860/1728] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:08 2022] PUT /identity/v3/projects/f38704f67d5a4574bcf1e46d2c3217df/users/1515d99518584c52b46af2cd379e3f89/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:08.761228 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b720e-65fb-4c02-bb80-ce32329f577f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:08.761228 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b720e-65fb-4c02-bb80-ce32329f577f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:08.761228 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b720e-65fb-4c02-bb80-ce32329f577f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:08.827251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f17b720e-65fb-4c02-bb80-ce32329f577f None None] MFA Rules not processed for user `4ff3870777184bd8afe37260747e75e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:08.828977 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f17b720e-65fb-4c02-bb80-ce32329f577f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:08.910791 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf730b93-413d-4e0c-a9a2-2477c133882d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:08.911785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf730b93-413d-4e0c-a9a2-2477c133882d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:08.912246 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf730b93-413d-4e0c-a9a2-2477c133882d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:08.912728 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf730b93-413d-4e0c-a9a2-2477c133882d admin admin] PATH_INFO: `/v3/projects/4782ac6b79db46fc897c6d51488e8578` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:08.915568 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf730b93-413d-4e0c-a9a2-2477c133882d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4782ac6b79db46fc897c6d51488e8578)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:08.920406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf730b93-413d-4e0c-a9a2-2477c133882d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:08.970276 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 861/1729] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:08.971895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b720e-65fb-4c02-bb80-ce32329f577f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:08.983429 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f17b720e-65fb-4c02-bb80-ce32329f577f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:09.008489 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b720e-65fb-4c02-bb80-ce32329f577f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:09.061517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d89e2-0c7d-4aec-b89b-37c57009b9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:09.062101 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d89e2-0c7d-4aec-b89b-37c57009b9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:09.063746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d89e2-0c7d-4aec-b89b-37c57009b9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:09.064112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d89e2-0c7d-4aec-b89b-37c57009b9a1 admin admin] PATH_INFO: `/v3/projects/8b5ff4798c4648deba2f90d8abeb9c5b` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:09.067195 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d89e2-0c7d-4aec-b89b-37c57009b9a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5ff4798c4648deba2f90d8abeb9c5b)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:09.069798 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d89e2-0c7d-4aec-b89b-37c57009b9a1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:09.150636 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cf730b93-413d-4e0c-a9a2-2477c133882d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4782ac6b79db46fc897c6d51488e8578', 'request_id': 'req-cf730b93-413d-4e0c-a9a2-2477c133882d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:09.165267 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cf730b93-413d-4e0c-a9a2-2477c133882d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4782ac6b79db46fc897c6d51488e8578', 'request_id': 'req-cf730b93-413d-4e0c-a9a2-2477c133882d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:09.295349 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:09.296785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cf730b93-413d-4e0c-a9a2-2477c133882d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4782ac6b79db46fc897c6d51488e8578', 'request_id': 'req-cf730b93-413d-4e0c-a9a2-2477c133882d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:09.299931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1e2d89e2-0c7d-4aec-b89b-37c57009b9a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5ff4798c4648deba2f90d8abeb9c5b', 'request_id': 'req-1e2d89e2-0c7d-4aec-b89b-37c57009b9a1'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:09.309193 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cf730b93-413d-4e0c-a9a2-2477c133882d admin admin] The token cache is being invalidate because project 4782ac6b79db46fc897c6d51488e8578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:09.309647 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cf730b93-413d-4e0c-a9a2-2477c133882d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:09.310787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cf730b93-413d-4e0c-a9a2-2477c133882d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:09.313124 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 869/1730] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:08 2022] DELETE /identity/v3/projects/4782ac6b79db46fc897c6d51488e8578 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:09.314637 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb69ac-8036-4a53-a901-9b425f11514a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:09.314963 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb69ac-8036-4a53-a901-9b425f11514a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:09.315239 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb69ac-8036-4a53-a901-9b425f11514a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:09.325207 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1e2d89e2-0c7d-4aec-b89b-37c57009b9a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5ff4798c4648deba2f90d8abeb9c5b', 'request_id': 'req-1e2d89e2-0c7d-4aec-b89b-37c57009b9a1'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:09.342465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1e2d89e2-0c7d-4aec-b89b-37c57009b9a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5ff4798c4648deba2f90d8abeb9c5b', 'request_id': 'req-1e2d89e2-0c7d-4aec-b89b-37c57009b9a1'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:09.349751 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-9aeb69ac-8036-4a53-a901-9b425f11514a None None] MFA Rules not processed for user `1515d99518584c52b46af2cd379e3f89`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:09.351017 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9aeb69ac-8036-4a53-a901-9b425f11514a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:09.419933 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1e2d89e2-0c7d-4aec-b89b-37c57009b9a1 admin admin] The token cache is being invalidate because project 8b5ff4798c4648deba2f90d8abeb9c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:09.420373 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1e2d89e2-0c7d-4aec-b89b-37c57009b9a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:09.424269 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1e2d89e2-0c7d-4aec-b89b-37c57009b9a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:09.425880 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 862/1731] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:08 2022] DELETE /identity/v3/projects/8b5ff4798c4648deba2f90d8abeb9c5b => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:09.426697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d89e2-0c7d-4aec-b89b-37c57009b9a1 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:09.429897 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1e2d89e2-0c7d-4aec-b89b-37c57009b9a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:09.511188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:09.518151 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 870/1732] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:09.519413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84d4e2-4616-49a8-9be9-1eff7cda8353 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:09.519707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84d4e2-4616-49a8-9be9-1eff7cda8353 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:09.520136 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84d4e2-4616-49a8-9be9-1eff7cda8353 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:09.522339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 871/1733] 10.222.0.43 () {54 vars in 961 bytes} [Thu Aug 11 11:04:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:04:09.523562 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15da56-2866-4239-b45e-fd927bdd2f73 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:09.523845 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15da56-2866-4239-b45e-fd927bdd2f73 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:09.524119 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e15da56-2866-4239-b45e-fd927bdd2f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:09.569609 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3e15da56-2866-4239-b45e-fd927bdd2f73 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:09.571178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3e15da56-2866-4239-b45e-fd927bdd2f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:09.582405 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d89e2-0c7d-4aec-b89b-37c57009b9a1 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:09.599315 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7adb5-9a74-41f7-b6e5-b7ee62d234ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:09.599973 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7adb5-9a74-41f7-b6e5-b7ee62d234ca service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:09.600250 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7adb5-9a74-41f7-b6e5-b7ee62d234ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:09.600519 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7adb5-9a74-41f7-b6e5-b7ee62d234ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:09.624941 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-08f7adb5-9a74-41f7-b6e5-b7ee62d234ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:09.649078 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 872/1734] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:09.650387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a8c69-d15e-4a7e-a6a7-708080841319 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:09.650698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a8c69-d15e-4a7e-a6a7-708080841319 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:09.651143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a8c69-d15e-4a7e-a6a7-708080841319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:09.684671 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-783a8c69-d15e-4a7e-a6a7-708080841319 None None] MFA Rules not processed for user `905e6067c72e4a7a9b7a73051ee8e16b`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:09.685850 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-783a8c69-d15e-4a7e-a6a7-708080841319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:09.695719 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7adb5-9a74-41f7-b6e5-b7ee62d234ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:09.697174 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7adb5-9a74-41f7-b6e5-b7ee62d234ca service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:09.708212 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 863/1735] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:09.709701 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca772a-7031-442d-93b9-5bf2dc947aac None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:09.710122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca772a-7031-442d-93b9-5bf2dc947aac None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:09.710303 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca772a-7031-442d-93b9-5bf2dc947aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:09.736255 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-52ca772a-7031-442d-93b9-5bf2dc947aac None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:09.737844 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-52ca772a-7031-442d-93b9-5bf2dc947aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:09.749272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 864/1736] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:09.751158 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c334fe-115b-4392-8bbe-a9d0ba42f25b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:09.751624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c334fe-115b-4392-8bbe-a9d0ba42f25b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:09.752095 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c334fe-115b-4392-8bbe-a9d0ba42f25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:09.770608 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 873/1737] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:09 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:09.771905 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a8c69-d15e-4a7e-a6a7-708080841319 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:09.778248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e3c334fe-115b-4392-8bbe-a9d0ba42f25b None None] MFA Rules not processed for user `4db99589bb504e8fa4068925badf3942`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:09.779758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e3c334fe-115b-4392-8bbe-a9d0ba42f25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:09.792912 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-783a8c69-d15e-4a7e-a6a7-708080841319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:09.810076 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a8c69-d15e-4a7e-a6a7-708080841319 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:09.813925 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb11b8f-1f1c-4cfe-8071-80485e2effea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:09.814610 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb11b8f-1f1c-4cfe-8071-80485e2effea service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:09.815002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb11b8f-1f1c-4cfe-8071-80485e2effea service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:09.815430 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb11b8f-1f1c-4cfe-8071-80485e2effea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:09.828608 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb11b8f-1f1c-4cfe-8071-80485e2effea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:09.831037 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb11b8f-1f1c-4cfe-8071-80485e2effea service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:09.845120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 874/1738] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:09.846261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb11b8f-1f1c-4cfe-8071-80485e2effea service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:09.849229 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8cb11b8f-1f1c-4cfe-8071-80485e2effea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:09.950746 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb11b8f-1f1c-4cfe-8071-80485e2effea service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:09.963741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ef338-7734-44e8-91e8-be5a29d5c67e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db99589bb504e8fa4068925badf3942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:09.965002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ef338-7734-44e8-91e8-be5a29d5c67e service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:09.965685 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ef338-7734-44e8-91e8-be5a29d5c67e service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:09.966200 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ef338-7734-44e8-91e8-be5a29d5c67e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:09.968635 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-051ef338-7734-44e8-91e8-be5a29d5c67e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:09.978696 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 865/1739] 10.222.0.43 () {58 vars in 1058 bytes} [Thu Aug 11 11:04:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:09.989235 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ef338-7734-44e8-91e8-be5a29d5c67e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:09.990040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f7dcb-a034-4740-a4f9-57b52c992e12 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:09.990351 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f7dcb-a034-4740-a4f9-57b52c992e12 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:09.991012 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f7dcb-a034-4740-a4f9-57b52c992e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:09.993572 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ef338-7734-44e8-91e8-be5a29d5c67e service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:10.013548 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 875/1740] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:10.016628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4994f3e-0733-4553-873e-fc3e3e3165ef None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:10.016980 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4994f3e-0733-4553-873e-fc3e3e3165ef None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:10.017749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4994f3e-0733-4553-873e-fc3e3e3165ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:10.042516 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c70f7dcb-a034-4740-a4f9-57b52c992e12 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:10.044171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c70f7dcb-a034-4740-a4f9-57b52c992e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:10.057378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 866/1741] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:10.065065 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f7dcb-a034-4740-a4f9-57b52c992e12 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:10.086131 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f7dcb-a034-4740-a4f9-57b52c992e12 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:10.098510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0034e29-9166-4bbb-885b-870134a1ba56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db99589bb504e8fa4068925badf3942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:10.099119 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0034e29-9166-4bbb-885b-870134a1ba56 service placement] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:10.099445 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0034e29-9166-4bbb-885b-870134a1ba56 service placement] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:10.100038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0034e29-9166-4bbb-885b-870134a1ba56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:10.111289 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-b4994f3e-0733-4553-873e-fc3e3e3165ef None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:10.114864 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b4994f3e-0733-4553-873e-fc3e3e3165ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:10.127153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0034e29-9166-4bbb-885b-870134a1ba56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:10.133257 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0034e29-9166-4bbb-885b-870134a1ba56 service placement] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:10.138243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 876/1742] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:10.140346 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4994f3e-0733-4553-873e-fc3e3e3165ef None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:10.150063 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 867/1743] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:10.151192 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0034e29-9166-4bbb-885b-870134a1ba56 service placement] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:10.162525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0034e29-9166-4bbb-885b-870134a1ba56 service placement] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:10.163779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4994f3e-0733-4553-873e-fc3e3e3165ef None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:10.166635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8465f-d6c7-4304-8ebc-2415748861de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:10.172972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8465f-d6c7-4304-8ebc-2415748861de service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:10.172972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8465f-d6c7-4304-8ebc-2415748861de service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:10.172972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8465f-d6c7-4304-8ebc-2415748861de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:10.172972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4dd8465f-d6c7-4304-8ebc-2415748861de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:10.173441 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f366dc3-2841-42e6-8bb6-9878a585440e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:10.173441 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f366dc3-2841-42e6-8bb6-9878a585440e admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:10.173777 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f366dc3-2841-42e6-8bb6-9878a585440e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:10.174043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f366dc3-2841-42e6-8bb6-9878a585440e admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:10.174879 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f366dc3-2841-42e6-8bb6-9878a585440e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:04:10.175192 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f366dc3-2841-42e6-8bb6-9878a585440e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:10.177115 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f366dc3-2841-42e6-8bb6-9878a585440e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:10.209331 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 877/1744] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:04:10.211051 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f366dc3-2841-42e6-8bb6-9878a585440e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:10.240157 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f366dc3-2841-42e6-8bb6-9878a585440e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:10.250639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed8417-4a27-45b0-8c51-f320b347ee97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:10.251653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed8417-4a27-45b0-8c51-f320b347ee97 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:10.252071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed8417-4a27-45b0-8c51-f320b347ee97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:10.252444 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed8417-4a27-45b0-8c51-f320b347ee97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:10.253394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed8417-4a27-45b0-8c51-f320b347ee97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:04:10.253827 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed8417-4a27-45b0-8c51-f320b347ee97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:10.256695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed8417-4a27-45b0-8c51-f320b347ee97 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:10.306220 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 878/1745] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:04:10.307280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed8417-4a27-45b0-8c51-f320b347ee97 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:10.349209 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed8417-4a27-45b0-8c51-f320b347ee97 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:10.355784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973487b4-c6c2-401a-b676-4a5ed1bcc33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:10.356617 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973487b4-c6c2-401a-b676-4a5ed1bcc33c admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:10.357033 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973487b4-c6c2-401a-b676-4a5ed1bcc33c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:10.357485 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973487b4-c6c2-401a-b676-4a5ed1bcc33c admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:10.358269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973487b4-c6c2-401a-b676-4a5ed1bcc33c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:10.361564 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973487b4-c6c2-401a-b676-4a5ed1bcc33c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:10.386235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8465f-d6c7-4304-8ebc-2415748861de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:10.388112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8465f-d6c7-4304-8ebc-2415748861de service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:10.432195 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 868/1746] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:10.433268 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8465f-d6c7-4304-8ebc-2415748861de service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:10.457329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8465f-d6c7-4304-8ebc-2415748861de service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:10.469638 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd5d47-d3a3-4933-a315-d0bb3da9f748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:10.469638 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd5d47-d3a3-4933-a315-d0bb3da9f748 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:10.470161 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd5d47-d3a3-4933-a315-d0bb3da9f748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:10.470459 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd5d47-d3a3-4933-a315-d0bb3da9f748 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:10.471172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd5d47-d3a3-4933-a315-d0bb3da9f748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:10.473138 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd5d47-d3a3-4933-a315-d0bb3da9f748 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:10.504687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 879/1747] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:10 2022] POST /identity/v3/projects => generated 387 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:10.506109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ad2f1-136b-4567-8295-c004f7e0da28 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:10.506905 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ad2f1-136b-4567-8295-c004f7e0da28 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:10.506905 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ad2f1-136b-4567-8295-c004f7e0da28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:10.542189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e77ad2f1-136b-4567-8295-c004f7e0da28 None None] MFA Rules not processed for user `950e6ba9e8ed4e00843657869bc3a26d`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:10.543440 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e77ad2f1-136b-4567-8295-c004f7e0da28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:10.627136 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 869/1748] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:10 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:10.629618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd5d47-d3a3-4933-a315-d0bb3da9f748 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:10.667391 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 880/1749] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:10.668408 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ad2f1-136b-4567-8295-c004f7e0da28 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:10.747975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd5d47-d3a3-4933-a315-d0bb3da9f748 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:10.753701 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051d4da-11ce-44cc-a8a7-09870e9811e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:10.754449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051d4da-11ce-44cc-a8a7-09870e9811e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:10.754853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051d4da-11ce-44cc-a8a7-09870e9811e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:10.755313 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051d4da-11ce-44cc-a8a7-09870e9811e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:10.756014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051d4da-11ce-44cc-a8a7-09870e9811e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:10.758003 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051d4da-11ce-44cc-a8a7-09870e9811e3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:10.772500 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ad2f1-136b-4567-8295-c004f7e0da28 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:10.778408 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb3d74-77fa-4a5d-b40b-1b0e150cc702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:10.779217 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb3d74-77fa-4a5d-b40b-1b0e150cc702 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:10.779488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb3d74-77fa-4a5d-b40b-1b0e150cc702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:10.779756 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb3d74-77fa-4a5d-b40b-1b0e150cc702 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:10.780415 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb3d74-77fa-4a5d-b40b-1b0e150cc702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:10.782891 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb3d74-77fa-4a5d-b40b-1b0e150cc702 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:10.904437 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 881/1750] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:10 2022] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:10.904689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 870/1751] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:10 2022] POST /identity/v3/users => generated 294 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:10.908671 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb3d74-77fa-4a5d-b40b-1b0e150cc702 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:10.909033 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051d4da-11ce-44cc-a8a7-09870e9811e3 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:10.918357 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb3d74-77fa-4a5d-b40b-1b0e150cc702 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:10.919581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051d4da-11ce-44cc-a8a7-09870e9811e3 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:10.923944 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a65af-4e0c-4ed0-86e9-2ab68dda6fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:10.924546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a65af-4e0c-4ed0-86e9-2ab68dda6fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:10.924826 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a65af-4e0c-4ed0-86e9-2ab68dda6fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:10.925028 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1c989-e5ec-4d40-af3c-2d532e5d839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:10.925153 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a65af-4e0c-4ed0-86e9-2ab68dda6fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:10.925725 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a65af-4e0c-4ed0-86e9-2ab68dda6fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:10.925823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1c989-e5ec-4d40-af3c-2d532e5d839a admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:10.926016 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1c989-e5ec-4d40-af3c-2d532e5d839a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:10.926291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1c989-e5ec-4d40-af3c-2d532e5d839a admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:10.926966 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1c989-e5ec-4d40-af3c-2d532e5d839a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:10.927355 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a65af-4e0c-4ed0-86e9-2ab68dda6fb5 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:10.928734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1c989-e5ec-4d40-af3c-2d532e5d839a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:10.947747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 882/1752] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:10.956708 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a65af-4e0c-4ed0-86e9-2ab68dda6fb5 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:10.979868 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 871/1753] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:04:10.979868 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1c989-e5ec-4d40-af3c-2d532e5d839a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:10.986576 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1c989-e5ec-4d40-af3c-2d532e5d839a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:10.991955 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d0694-7e1e-46f6-942d-7ff0e11bd474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:10.992585 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d0694-7e1e-46f6-942d-7ff0e11bd474 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:10.992847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d0694-7e1e-46f6-942d-7ff0e11bd474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:10.993233 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d0694-7e1e-46f6-942d-7ff0e11bd474 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:10.993362 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a65af-4e0c-4ed0-86e9-2ab68dda6fb5 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:10.993884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d0694-7e1e-46f6-942d-7ff0e11bd474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:10.996305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d0694-7e1e-46f6-942d-7ff0e11bd474 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:11.003517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee1662-f979-46de-8b3c-83a788bffd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:11.004216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee1662-f979-46de-8b3c-83a788bffd57 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:11.004481 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee1662-f979-46de-8b3c-83a788bffd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:11.004776 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee1662-f979-46de-8b3c-83a788bffd57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:11.005517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee1662-f979-46de-8b3c-83a788bffd57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:11.007265 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee1662-f979-46de-8b3c-83a788bffd57 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:11.026522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 872/1754] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:04:11.027809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d0694-7e1e-46f6-942d-7ff0e11bd474 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:11.037201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 883/1755] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:11.038580 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee1662-f979-46de-8b3c-83a788bffd57 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:11.050904 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d0694-7e1e-46f6-942d-7ff0e11bd474 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:11.053797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee1662-f979-46de-8b3c-83a788bffd57 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:11.056855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8609cd-65c9-4d6e-8b13-d7223b4aeee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:11.058255 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8609cd-65c9-4d6e-8b13-d7223b4aeee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:11.058806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8609cd-65c9-4d6e-8b13-d7223b4aeee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:11.059506 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8609cd-65c9-4d6e-8b13-d7223b4aeee4 admin admin] PATH_INFO: `/v3/projects/cadbea2cdcc74bdca36c78f05be3c040/users/b1c158b9dbe44e27a2a681001b4cd248/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:11.061007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6c597-5717-4ff4-b515-6da7edf2f196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:11.061750 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6c597-5717-4ff4-b515-6da7edf2f196 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:11.062101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6c597-5717-4ff4-b515-6da7edf2f196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:11.064590 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6c597-5717-4ff4-b515-6da7edf2f196 admin admin] PATH_INFO: `/v3/projects/d09fdc1517b34b80b40b44e531770ca8/users/50c9b38471c94fa09fc7587cff7600e5/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:11.065172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:11.079707 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8609cd-65c9-4d6e-8b13-d7223b4aeee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cadbea2cdcc74bdca36c78f05be3c040, user_id=b1c158b9dbe44e27a2a681001b4cd248, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:11.082646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8609cd-65c9-4d6e-8b13-d7223b4aeee4 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:11.083928 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6c597-5717-4ff4-b515-6da7edf2f196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09fdc1517b34b80b40b44e531770ca8, user_id=50c9b38471c94fa09fc7587cff7600e5, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:11.086984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6c597-5717-4ff4-b515-6da7edf2f196 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:11.256701 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 884/1756] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:11 2022] PUT /identity/v3/projects/d09fdc1517b34b80b40b44e531770ca8/users/50c9b38471c94fa09fc7587cff7600e5/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:11.256701 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d391c16-4b6a-4d6a-818c-de2a944c718c None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:11.256701 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d391c16-4b6a-4d6a-818c-de2a944c718c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:11.256701 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d391c16-4b6a-4d6a-818c-de2a944c718c None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:11.258110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 885/1757] 10.222.0.43 () {54 vars in 921 bytes} [Thu Aug 11 11:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:04:11.265041 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a2b20-a149-40b8-9f1d-d7526c8b5dd6 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:11.265324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a2b20-a149-40b8-9f1d-d7526c8b5dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:11.265605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a2b20-a149-40b8-9f1d-d7526c8b5dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:11.266793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 873/1758] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:11 2022] PUT /identity/v3/projects/cadbea2cdcc74bdca36c78f05be3c040/users/b1c158b9dbe44e27a2a681001b4cd248/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:11.279165 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9dd774-a258-4996-a6a8-aef065464399 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:11.280082 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9dd774-a258-4996-a6a8-aef065464399 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:11.280462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9dd774-a258-4996-a6a8-aef065464399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:11.315642 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f27a2b20-a149-40b8-9f1d-d7526c8b5dd6 None None] MFA Rules not processed for user `50c9b38471c94fa09fc7587cff7600e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:11.316958 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f27a2b20-a149-40b8-9f1d-d7526c8b5dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:11.328377 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9f9dd774-a258-4996-a6a8-aef065464399 None None] MFA Rules not processed for user `b1c158b9dbe44e27a2a681001b4cd248`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:11.329939 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9f9dd774-a258-4996-a6a8-aef065464399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:11.408194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 886/1759] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:04:11.413154 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a2b20-a149-40b8-9f1d-d7526c8b5dd6 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:11.439960 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 874/1760] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:04:11.441502 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd127ca-2084-4b72-9111-89ea2ec503a9 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:11.441890 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd127ca-2084-4b72-9111-89ea2ec503a9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:11.442067 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd127ca-2084-4b72-9111-89ea2ec503a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:11.470396 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9cd127ca-2084-4b72-9111-89ea2ec503a9 None None] MFA Rules not processed for user `4db99589bb504e8fa4068925badf3942`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:11.471999 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9cd127ca-2084-4b72-9111-89ea2ec503a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:11.552541 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a2b20-a149-40b8-9f1d-d7526c8b5dd6 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:11.560160 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 875/1761] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Aug 11 11:04:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:11.561186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd127ca-2084-4b72-9111-89ea2ec503a9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:11.567173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa383b-445b-4081-9e90-f768302885c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:11.567500 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa383b-445b-4081-9e90-f768302885c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:11.567780 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa383b-445b-4081-9e90-f768302885c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:11.568050 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa383b-445b-4081-9e90-f768302885c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:11.568688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa383b-445b-4081-9e90-f768302885c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:11.570788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa383b-445b-4081-9e90-f768302885c0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:11.577682 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd127ca-2084-4b72-9111-89ea2ec503a9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:11.583025 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1337e-818f-45a2-af0d-5ba601562af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:11.583644 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1337e-818f-45a2-af0d-5ba601562af7 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:11.583927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1337e-818f-45a2-af0d-5ba601562af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:11.584202 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f1337e-818f-45a2-af0d-5ba601562af7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:11.584831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1337e-818f-45a2-af0d-5ba601562af7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:11.586781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f1337e-818f-45a2-af0d-5ba601562af7 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:11.703042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 887/1762] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:11 2022] POST /identity/v3/projects => generated 387 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:04:11.707514 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa383b-445b-4081-9e90-f768302885c0 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:11.776131 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 876/1763] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:11 2022] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:11.776131 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1337e-818f-45a2-af0d-5ba601562af7 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:11.872216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:11.908263 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f1337e-818f-45a2-af0d-5ba601562af7 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:11.916099 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35359ea8-94f4-40d6-8a7c-97b8645c1513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:11.917383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35359ea8-94f4-40d6-8a7c-97b8645c1513 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:11.917743 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35359ea8-94f4-40d6-8a7c-97b8645c1513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:11.918258 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35359ea8-94f4-40d6-8a7c-97b8645c1513 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:11.919022 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35359ea8-94f4-40d6-8a7c-97b8645c1513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:11.920583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa383b-445b-4081-9e90-f768302885c0 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:11.922748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35359ea8-94f4-40d6-8a7c-97b8645c1513 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:11.991726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb399a60-5e57-487b-aa85-067275420bf0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db99589bb504e8fa4068925badf3942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:11.992106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb399a60-5e57-487b-aa85-067275420bf0 service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:11.992395 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb399a60-5e57-487b-aa85-067275420bf0 service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:11.992967 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb399a60-5e57-487b-aa85-067275420bf0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:12.008956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb399a60-5e57-487b-aa85-067275420bf0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:12.010681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb399a60-5e57-487b-aa85-067275420bf0 service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:12.022732 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 888/1764] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:12.035428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb399a60-5e57-487b-aa85-067275420bf0 service placement] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:12.085029 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 877/1765] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:11 2022] POST /identity/v3/users => generated 294 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:12.085029 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35359ea8-94f4-40d6-8a7c-97b8645c1513 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:12.091871 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35359ea8-94f4-40d6-8a7c-97b8645c1513 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:12.097688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0c792-0024-4474-8943-690834491083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:12.106678 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0c792-0024-4474-8943-690834491083 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:12.107227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0c792-0024-4474-8943-690834491083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:12.107333 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0c792-0024-4474-8943-690834491083 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:12.107898 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0c792-0024-4474-8943-690834491083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:12.120471 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0c792-0024-4474-8943-690834491083 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:12.138115 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb399a60-5e57-487b-aa85-067275420bf0 service placement] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:12.148309 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5e4cd-ab8d-44e7-890b-d1d436a6273d tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1515d99518584c52b46af2cd379e3f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f38704f67d5a4574bcf1e46d2c3217df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:12.148960 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5e4cd-ab8d-44e7-890b-d1d436a6273d tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:12.149248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5e4cd-ab8d-44e7-890b-d1d436a6273d tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:12.149524 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5e4cd-ab8d-44e7-890b-d1d436a6273d tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:12.154173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5e4cd-ab8d-44e7-890b-d1d436a6273d tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:04:12.154173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5e4cd-ab8d-44e7-890b-d1d436a6273d tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:12.154173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5e4cd-ab8d-44e7-890b-d1d436a6273d tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:12.165587 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 889/1766] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:04:12.166486 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5e4cd-ab8d-44e7-890b-d1d436a6273d tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:12.178339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5e4cd-ab8d-44e7-890b-d1d436a6273d tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:12.182939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aca205-72f2-4dd0-b745-510b120fc0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:12.188763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aca205-72f2-4dd0-b745-510b120fc0bc admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:12.188763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aca205-72f2-4dd0-b745-510b120fc0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:12.188763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aca205-72f2-4dd0-b745-510b120fc0bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:12.188763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aca205-72f2-4dd0-b745-510b120fc0bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:12.188763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aca205-72f2-4dd0-b745-510b120fc0bc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:12.199953 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 890/1767] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:12.201197 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aca205-72f2-4dd0-b745-510b120fc0bc admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:12.211992 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aca205-72f2-4dd0-b745-510b120fc0bc admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:12.217731 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d83d9-4f10-4440-8af2-ff17b4a7c349 tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1515d99518584c52b46af2cd379e3f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f38704f67d5a4574bcf1e46d2c3217df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:12.218360 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d83d9-4f10-4440-8af2-ff17b4a7c349 tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:12.218637 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d83d9-4f10-4440-8af2-ff17b4a7c349 tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:12.219900 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d83d9-4f10-4440-8af2-ff17b4a7c349 tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:12.220346 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d83d9-4f10-4440-8af2-ff17b4a7c349 tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:12.222299 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d83d9-4f10-4440-8af2-ff17b4a7c349 tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:12.269904 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 878/1768] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:12 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:12.270869 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0c792-0024-4474-8943-690834491083 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:12.282469 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0c792-0024-4474-8943-690834491083 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:12.287473 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2db00a-0637-47ca-b988-3ebf3814b27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:12.288489 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2db00a-0637-47ca-b988-3ebf3814b27f admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:12.288489 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2db00a-0637-47ca-b988-3ebf3814b27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:12.288971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2db00a-0637-47ca-b988-3ebf3814b27f admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:12.289440 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2db00a-0637-47ca-b988-3ebf3814b27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:12.291258 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2db00a-0637-47ca-b988-3ebf3814b27f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:12.309658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 879/1769] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:12.309658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2db00a-0637-47ca-b988-3ebf3814b27f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:12.327030 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2db00a-0637-47ca-b988-3ebf3814b27f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:12.327414 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c16c5f-de70-47ed-9b2e-1aff6427a034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:12.328030 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c16c5f-de70-47ed-9b2e-1aff6427a034 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:12.328892 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c16c5f-de70-47ed-9b2e-1aff6427a034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:12.329468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c16c5f-de70-47ed-9b2e-1aff6427a034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:12.331299 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c16c5f-de70-47ed-9b2e-1aff6427a034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:12.333285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c16c5f-de70-47ed-9b2e-1aff6427a034 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:12.347164 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 880/1770] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:12.347164 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c16c5f-de70-47ed-9b2e-1aff6427a034 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:12.360394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c16c5f-de70-47ed-9b2e-1aff6427a034 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:12.366523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc832e6f-843e-4281-9fb9-5c6d3fd42ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:12.367333 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc832e6f-843e-4281-9fb9-5c6d3fd42ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:12.367641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc832e6f-843e-4281-9fb9-5c6d3fd42ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:12.367979 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc832e6f-843e-4281-9fb9-5c6d3fd42ac6 admin admin] PATH_INFO: `/v3/projects/3e2f436a878945baa6a798a7b0775c47/users/f96b207edddd4d8b8c4b2fc297efc4c1/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:12.393687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 891/1771] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:12 2022] POST /identity/v3/projects => generated 353 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:12.394645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d83d9-4f10-4440-8af2-ff17b4a7c349 tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:12.407488 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc832e6f-843e-4281-9fb9-5c6d3fd42ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2f436a878945baa6a798a7b0775c47, user_id=f96b207edddd4d8b8c4b2fc297efc4c1, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:12.412348 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc832e6f-843e-4281-9fb9-5c6d3fd42ac6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:12.491235 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d83d9-4f10-4440-8af2-ff17b4a7c349 tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:12.504771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc04f2f-8a83-437a-b461-003a6a530732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:12.505741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc04f2f-8a83-437a-b461-003a6a530732 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:12.505850 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc04f2f-8a83-437a-b461-003a6a530732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:12.506064 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc04f2f-8a83-437a-b461-003a6a530732 admin admin] PATH_INFO: `/v3/projects/a40f9f7b355347238e1c69f5839dd93c/users/999ff9e9db994494973486c936de9a03/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:12.533348 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc04f2f-8a83-437a-b461-003a6a530732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40f9f7b355347238e1c69f5839dd93c, user_id=999ff9e9db994494973486c936de9a03, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:12.536291 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc04f2f-8a83-437a-b461-003a6a530732 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:12.545835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 881/1772] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:12 2022] PUT /identity/v3/projects/3e2f436a878945baa6a798a7b0775c47/users/f96b207edddd4d8b8c4b2fc297efc4c1/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:12.546920 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc832e6f-843e-4281-9fb9-5c6d3fd42ac6 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:12.626632 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 892/1773] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:12 2022] PUT /identity/v3/projects/a40f9f7b355347238e1c69f5839dd93c/users/999ff9e9db994494973486c936de9a03/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:12.628642 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf3bac-0c85-4044-8ee3-214b7221a079 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:12.630163 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf3bac-0c85-4044-8ee3-214b7221a079 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:12.630593 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf3bac-0c85-4044-8ee3-214b7221a079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:12.649903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc832e6f-843e-4281-9fb9-5c6d3fd42ac6 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:12.701962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-33bf3bac-0c85-4044-8ee3-214b7221a079 None None] MFA Rules not processed for user `f96b207edddd4d8b8c4b2fc297efc4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:12.704767 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-33bf3bac-0c85-4044-8ee3-214b7221a079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:12.738136 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511f0b0-98e9-4494-85e4-4e3ddf58f1d9 tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1515d99518584c52b46af2cd379e3f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f38704f67d5a4574bcf1e46d2c3217df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:12.738730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511f0b0-98e9-4494-85e4-4e3ddf58f1d9 tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:12.739044 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511f0b0-98e9-4494-85e4-4e3ddf58f1d9 tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:12.739383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511f0b0-98e9-4494-85e4-4e3ddf58f1d9 tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:12.740031 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511f0b0-98e9-4494-85e4-4e3ddf58f1d9 tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:04:12.740402 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511f0b0-98e9-4494-85e4-4e3ddf58f1d9 tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:12.742142 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511f0b0-98e9-4494-85e4-4e3ddf58f1d9 tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:12.792738 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 882/1774] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:04:12.794732 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511f0b0-98e9-4494-85e4-4e3ddf58f1d9 tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:12.814136 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 893/1775] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:12.818578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf3bac-0c85-4044-8ee3-214b7221a079 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:12.895635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511f0b0-98e9-4494-85e4-4e3ddf58f1d9 tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:12.900917 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1e632-b5a8-4635-a327-1ccf94ef262f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:12.901548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1e632-b5a8-4635-a327-1ccf94ef262f admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:12.903079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1e632-b5a8-4635-a327-1ccf94ef262f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:12.903560 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1e632-b5a8-4635-a327-1ccf94ef262f admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:12.904229 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1e632-b5a8-4635-a327-1ccf94ef262f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:12.906456 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da1e632-b5a8-4635-a327-1ccf94ef262f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:12.938642 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 883/1776] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:12.941147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1e632-b5a8-4635-a327-1ccf94ef262f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:12.944012 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bf3bac-0c85-4044-8ee3-214b7221a079 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:12.955321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1e632-b5a8-4635-a327-1ccf94ef262f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:12.961472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e2e05-1763-4e8b-96c7-58912233aaff tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1515d99518584c52b46af2cd379e3f89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f38704f67d5a4574bcf1e46d2c3217df', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:12.962347 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e2e05-1763-4e8b-96c7-58912233aaff tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:12.962641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e2e05-1763-4e8b-96c7-58912233aaff tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:12.962943 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e2e05-1763-4e8b-96c7-58912233aaff tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] PATH_INFO: `/v3/projects/3d2392696be242239d8e506115806584` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:12.964167 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e2e05-1763-4e8b-96c7-58912233aaff tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3d2392696be242239d8e506115806584)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:12.965069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bf5cc-5154-405d-b37a-a0aa953b0130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:12.966203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e2e05-1763-4e8b-96c7-58912233aaff tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:12.967032 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bf5cc-5154-405d-b37a-a0aa953b0130 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:12.969320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bf5cc-5154-405d-b37a-a0aa953b0130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:12.972856 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bf5cc-5154-405d-b37a-a0aa953b0130 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:12.975227 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bf5cc-5154-405d-b37a-a0aa953b0130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:12.982749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bf5cc-5154-405d-b37a-a0aa953b0130 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:13.220402 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f61e2e05-1763-4e8b-96c7-58912233aaff tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d2392696be242239d8e506115806584', 'request_id': 'req-f61e2e05-1763-4e8b-96c7-58912233aaff'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:13.227870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f61e2e05-1763-4e8b-96c7-58912233aaff tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d2392696be242239d8e506115806584', 'request_id': 'req-f61e2e05-1763-4e8b-96c7-58912233aaff'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:13.245211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f61e2e05-1763-4e8b-96c7-58912233aaff tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d2392696be242239d8e506115806584', 'request_id': 'req-f61e2e05-1763-4e8b-96c7-58912233aaff'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:13.337046 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 894/1777] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:12 2022] POST /identity/v3/projects => generated 387 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:13.338183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bf5cc-5154-405d-b37a-a0aa953b0130 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:13.388055 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f61e2e05-1763-4e8b-96c7-58912233aaff tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] The token cache is being invalidate because project 3d2392696be242239d8e506115806584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:13.388453 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f61e2e05-1763-4e8b-96c7-58912233aaff tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:13.389167 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f61e2e05-1763-4e8b-96c7-58912233aaff tempest-VolumeQuotaClassesTest-1321632801 tempest-VolumeQuotaClassesTest-1321632801-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:13.394819 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 884/1778] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:12 2022] DELETE /identity/v3/projects/3d2392696be242239d8e506115806584 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:13.394819 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f263a4-14b4-46d5-9d72-265cb543f347 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:13.394819 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f263a4-14b4-46d5-9d72-265cb543f347 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:13.394819 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f263a4-14b4-46d5-9d72-265cb543f347 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:13.396465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 885/1779] 10.222.0.43 () {54 vars in 921 bytes} [Thu Aug 11 11:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:04:13.397230 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f263a4-14b4-46d5-9d72-265cb543f347 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:13.399040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-62f263a4-14b4-46d5-9d72-265cb543f347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:13.426924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bf5cc-5154-405d-b37a-a0aa953b0130 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:13.432087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c74e3b-1488-49f3-98eb-9af887436272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:13.432991 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c74e3b-1488-49f3-98eb-9af887436272 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:13.433194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c74e3b-1488-49f3-98eb-9af887436272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:13.433459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c74e3b-1488-49f3-98eb-9af887436272 admin admin] PATH_INFO: `/v3/projects/a40f9f7b355347238e1c69f5839dd93c/users/999ff9e9db994494973486c936de9a03/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:13.435611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c74e3b-1488-49f3-98eb-9af887436272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a40f9f7b355347238e1c69f5839dd93c, user_id=999ff9e9db994494973486c936de9a03, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:13.439891 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c74e3b-1488-49f3-98eb-9af887436272 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:13.451971 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 895/1780] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:13 2022] PUT /identity/v3/projects/a40f9f7b355347238e1c69f5839dd93c/users/999ff9e9db994494973486c936de9a03/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:13.452921 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c74e3b-1488-49f3-98eb-9af887436272 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:13.455520 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f4c74e3b-1488-49f3-98eb-9af887436272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:13.474788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f263a4-14b4-46d5-9d72-265cb543f347 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:13.536639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c74e3b-1488-49f3-98eb-9af887436272 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:13.542263 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb4ed1-2ffe-4aa2-bbb5-cf3c04478103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:13.543060 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb4ed1-2ffe-4aa2-bbb5-cf3c04478103 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:13.543343 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb4ed1-2ffe-4aa2-bbb5-cf3c04478103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:13.543622 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb4ed1-2ffe-4aa2-bbb5-cf3c04478103 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:13.544507 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb4ed1-2ffe-4aa2-bbb5-cf3c04478103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:13.547001 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb4ed1-2ffe-4aa2-bbb5-cf3c04478103 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:13.550264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c2553-a2d2-46e4-ae57-3433c65cb79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:13.550996 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c2553-a2d2-46e4-ae57-3433c65cb79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:13.551280 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c2553-a2d2-46e4-ae57-3433c65cb79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:13.551549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c2553-a2d2-46e4-ae57-3433c65cb79a admin admin] PATH_INFO: `/v3/users/892f928ed891490f876f49ff52744850` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:13.552666 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c2553-a2d2-46e4-ae57-3433c65cb79a admin admin] RBAC: Authorizing `identity:delete_user(user_id=892f928ed891490f876f49ff52744850)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:13.554585 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c2553-a2d2-46e4-ae57-3433c65cb79a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:13.644262 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 896/1781] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:13 2022] POST /identity/v3/users => generated 300 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:13.646127 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b428a9-eb74-4a3a-818f-9382bb7fbfc6 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:13.646621 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b428a9-eb74-4a3a-818f-9382bb7fbfc6 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:13.647275 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b428a9-eb74-4a3a-818f-9382bb7fbfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:13.669478 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-21b428a9-eb74-4a3a-818f-9382bb7fbfc6 None None] MFA Rules not processed for user `4db99589bb504e8fa4068925badf3942`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:13.670787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-21b428a9-eb74-4a3a-818f-9382bb7fbfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:13.738946 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 897/1782] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Aug 11 11:04:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:13.740196 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60092a2-67a8-49a1-909b-070b1fe5dff3 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:13.740479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60092a2-67a8-49a1-909b-070b1fe5dff3 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:13.740752 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60092a2-67a8-49a1-909b-070b1fe5dff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:13.769996 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a60092a2-67a8-49a1-909b-070b1fe5dff3 None None] MFA Rules not processed for user `999ff9e9db994494973486c936de9a03`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:13.771230 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a60092a2-67a8-49a1-909b-070b1fe5dff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:13.829141 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7c8c2553-a2d2-46e4-ae57-3433c65cb79a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '892f928ed891490f876f49ff52744850'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:13.841111 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7c8c2553-a2d2-46e4-ae57-3433c65cb79a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '892f928ed891490f876f49ff52744850'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:13.841249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 898/1783] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:13.841804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7c8c2553-a2d2-46e4-ae57-3433c65cb79a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '892f928ed891490f876f49ff52744850'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:13.842745 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60092a2-67a8-49a1-909b-070b1fe5dff3 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:13.853931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60092a2-67a8-49a1-909b-070b1fe5dff3 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:13.858737 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c774e89-3038-4017-a773-130c4c55fb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:13.859542 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c774e89-3038-4017-a773-130c4c55fb0f admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:13.859775 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c774e89-3038-4017-a773-130c4c55fb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:13.860048 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c774e89-3038-4017-a773-130c4c55fb0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:13.860695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c774e89-3038-4017-a773-130c4c55fb0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:13.862560 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c774e89-3038-4017-a773-130c4c55fb0f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:13.872171 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 899/1784] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:13.872942 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c774e89-3038-4017-a773-130c4c55fb0f admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:13.874487 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1c774e89-3038-4017-a773-130c4c55fb0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:13.888210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c774e89-3038-4017-a773-130c4c55fb0f admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:13.893870 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff9c6e-43d2-4bfb-8d98-5e911d872b5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db99589bb504e8fa4068925badf3942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:13.894437 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff9c6e-43d2-4bfb-8d98-5e911d872b5e service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:13.894727 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff9c6e-43d2-4bfb-8d98-5e911d872b5e service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:13.895014 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff9c6e-43d2-4bfb-8d98-5e911d872b5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:13.903650 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff9c6e-43d2-4bfb-8d98-5e911d872b5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:13.905212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff9c6e-43d2-4bfb-8d98-5e911d872b5e service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:13.915119 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 900/1785] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:13.915871 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff9c6e-43d2-4bfb-8d98-5e911d872b5e service placement] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:13.917098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3eff9c6e-43d2-4bfb-8d98-5e911d872b5e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:13.962591 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7c8c2553-a2d2-46e4-ae57-3433c65cb79a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '892f928ed891490f876f49ff52744850'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:13.971899 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7c8c2553-a2d2-46e4-ae57-3433c65cb79a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '892f928ed891490f876f49ff52744850'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:13.982353 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 886/1786] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:13 2022] DELETE /identity/v3/users/892f928ed891490f876f49ff52744850 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:13.982522 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff9c6e-43d2-4bfb-8d98-5e911d872b5e service placement] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:13.983024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c2553-a2d2-46e4-ae57-3433c65cb79a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:13.983024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7c8c2553-a2d2-46e4-ae57-3433c65cb79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:14.065924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a07d35-39d5-441e-a047-450cd832aa7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:14.066863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a07d35-39d5-441e-a047-450cd832aa7e service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:14.067036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a07d35-39d5-441e-a047-450cd832aa7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:14.067424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a07d35-39d5-441e-a047-450cd832aa7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:14.069615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-90a07d35-39d5-441e-a047-450cd832aa7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:14.108781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c2553-a2d2-46e4-ae57-3433c65cb79a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:14.117058 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef30e2-837c-4b69-9dc7-2e1eee6543b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:14.117859 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef30e2-837c-4b69-9dc7-2e1eee6543b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:14.118210 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef30e2-837c-4b69-9dc7-2e1eee6543b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:14.119317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef30e2-837c-4b69-9dc7-2e1eee6543b1 admin admin] PATH_INFO: `/v3/projects/02ef7617ee694b41bb23095799ceba7c/users/20b07390b6ce4082a54eb3c1b24c58ef/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:14.138577 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef30e2-837c-4b69-9dc7-2e1eee6543b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ef7617ee694b41bb23095799ceba7c, user_id=20b07390b6ce4082a54eb3c1b24c58ef, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:14.141723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef30e2-837c-4b69-9dc7-2e1eee6543b1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:14.148632 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a07d35-39d5-441e-a047-450cd832aa7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:14.150081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a07d35-39d5-441e-a047-450cd832aa7e service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:14.161180 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 901/1787] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:14.287216 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 887/1788] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:13 2022] PUT /identity/v3/projects/02ef7617ee694b41bb23095799ceba7c/users/20b07390b6ce4082a54eb3c1b24c58ef/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:14.290974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a07d35-39d5-441e-a047-450cd832aa7e service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:14.306131 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a07d35-39d5-441e-a047-450cd832aa7e service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:14.399577 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c266127-09d8-4ea9-9401-533fd6d530bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:14.399984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c266127-09d8-4ea9-9401-533fd6d530bc admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:14.400269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c266127-09d8-4ea9-9401-533fd6d530bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:14.400543 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c266127-09d8-4ea9-9401-533fd6d530bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:14.401194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c266127-09d8-4ea9-9401-533fd6d530bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:14.403186 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c266127-09d8-4ea9-9401-533fd6d530bc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:14.418822 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 902/1789] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:14.420127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef30e2-837c-4b69-9dc7-2e1eee6543b1 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:14.447217 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef30e2-837c-4b69-9dc7-2e1eee6543b1 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:14.458446 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403db14-d21b-477c-8d3f-183a01cb1888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:14.459349 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403db14-d21b-477c-8d3f-183a01cb1888 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:14.459634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403db14-d21b-477c-8d3f-183a01cb1888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:14.459912 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6403db14-d21b-477c-8d3f-183a01cb1888 admin admin] PATH_INFO: `/v3/projects/02ef7617ee694b41bb23095799ceba7c/users/20b07390b6ce4082a54eb3c1b24c58ef/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:14.464633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403db14-d21b-477c-8d3f-183a01cb1888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02ef7617ee694b41bb23095799ceba7c, user_id=20b07390b6ce4082a54eb3c1b24c58ef, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:14.467338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6403db14-d21b-477c-8d3f-183a01cb1888 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:14.480537 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 888/1790] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:14 2022] PUT /identity/v3/projects/02ef7617ee694b41bb23095799ceba7c/users/20b07390b6ce4082a54eb3c1b24c58ef/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:14.493530 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3a67d-ce01-4b00-a5f2-659e2523e8da None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:14.502852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3a67d-ce01-4b00-a5f2-659e2523e8da None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:14.502852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3a67d-ce01-4b00-a5f2-659e2523e8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:14.525988 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-87c3a67d-ce01-4b00-a5f2-659e2523e8da None None] MFA Rules not processed for user `20b07390b6ce4082a54eb3c1b24c58ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:14.527248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-87c3a67d-ce01-4b00-a5f2-659e2523e8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:14.605777 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 903/1791] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:14.606604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403db14-d21b-477c-8d3f-183a01cb1888 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:14.611606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6403db14-d21b-477c-8d3f-183a01cb1888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:14.629097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3a67d-ce01-4b00-a5f2-659e2523e8da None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:14.629097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-87c3a67d-ce01-4b00-a5f2-659e2523e8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:14.656618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:14.750546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3a67d-ce01-4b00-a5f2-659e2523e8da None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:14.761120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece888d-6aea-4492-b021-b156066d5eb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:14.762546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece888d-6aea-4492-b021-b156066d5eb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:14.763524 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece888d-6aea-4492-b021-b156066d5eb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:14.763857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece888d-6aea-4492-b021-b156066d5eb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:14.766708 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7ece888d-6aea-4492-b021-b156066d5eb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:14.776487 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6403db14-d21b-477c-8d3f-183a01cb1888 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:14.790339 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018f89c-6466-4523-9cbd-d524fb84ab50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:14.791027 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018f89c-6466-4523-9cbd-d524fb84ab50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:14.791306 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018f89c-6466-4523-9cbd-d524fb84ab50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:14.791584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018f89c-6466-4523-9cbd-d524fb84ab50 admin admin] PATH_INFO: `/v3/projects/1429a9f28b43441fa650f1d46084d1e8` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:14.795889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018f89c-6466-4523-9cbd-d524fb84ab50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1429a9f28b43441fa650f1d46084d1e8)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:14.797896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018f89c-6466-4523-9cbd-d524fb84ab50 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:14.870657 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece888d-6aea-4492-b021-b156066d5eb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:14.872271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece888d-6aea-4492-b021-b156066d5eb3 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:14.886478 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 904/1792] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:04:14.934503 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:14.985347 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-9018f89c-6466-4523-9cbd-d524fb84ab50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1429a9f28b43441fa650f1d46084d1e8', 'request_id': 'req-9018f89c-6466-4523-9cbd-d524fb84ab50'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:14.991850 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-9018f89c-6466-4523-9cbd-d524fb84ab50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1429a9f28b43441fa650f1d46084d1e8', 'request_id': 'req-9018f89c-6466-4523-9cbd-d524fb84ab50'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:14.998564 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-9018f89c-6466-4523-9cbd-d524fb84ab50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1429a9f28b43441fa650f1d46084d1e8', 'request_id': 'req-9018f89c-6466-4523-9cbd-d524fb84ab50'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:15.155148 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-9018f89c-6466-4523-9cbd-d524fb84ab50 admin admin] The token cache is being invalidate because project 1429a9f28b43441fa650f1d46084d1e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:15.155674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-9018f89c-6466-4523-9cbd-d524fb84ab50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:15.156937 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-9018f89c-6466-4523-9cbd-d524fb84ab50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:15.158621 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 889/1793] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:14 2022] DELETE /identity/v3/projects/1429a9f28b43441fa650f1d46084d1e8 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:15.163059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece888d-6aea-4492-b021-b156066d5eb3 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:15.174161 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece888d-6aea-4492-b021-b156066d5eb3 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:15.232343 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad24a8-8a4a-4fc2-8bf8-0a67846992fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:15.233147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad24a8-8a4a-4fc2-8bf8-0a67846992fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:15.233495 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad24a8-8a4a-4fc2-8bf8-0a67846992fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:15.233800 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad24a8-8a4a-4fc2-8bf8-0a67846992fd admin admin] PATH_INFO: `/v3/users/905e6067c72e4a7a9b7a73051ee8e16b` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:15.235257 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad24a8-8a4a-4fc2-8bf8-0a67846992fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=905e6067c72e4a7a9b7a73051ee8e16b)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:15.247314 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad24a8-8a4a-4fc2-8bf8-0a67846992fd admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:15.475875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018f89c-6466-4523-9cbd-d524fb84ab50 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:15.477506 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9018f89c-6466-4523-9cbd-d524fb84ab50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:15.543767 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018f89c-6466-4523-9cbd-d524fb84ab50 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:15.548179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad92d5-b790-40fb-9c0b-3dcc3625a1d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:15.549829 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad92d5-b790-40fb-9c0b-3dcc3625a1d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:15.549829 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad92d5-b790-40fb-9c0b-3dcc3625a1d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:15.549829 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad92d5-b790-40fb-9c0b-3dcc3625a1d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:15.552680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-08ad92d5-b790-40fb-9c0b-3dcc3625a1d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:15.611689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-78ad24a8-8a4a-4fc2-8bf8-0a67846992fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '905e6067c72e4a7a9b7a73051ee8e16b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:15.611925 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-78ad24a8-8a4a-4fc2-8bf8-0a67846992fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '905e6067c72e4a7a9b7a73051ee8e16b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:15.644160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-78ad24a8-8a4a-4fc2-8bf8-0a67846992fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '905e6067c72e4a7a9b7a73051ee8e16b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:15.650816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad92d5-b790-40fb-9c0b-3dcc3625a1d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:15.653004 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad92d5-b790-40fb-9c0b-3dcc3625a1d0 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:15.655594 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-78ad24a8-8a4a-4fc2-8bf8-0a67846992fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '905e6067c72e4a7a9b7a73051ee8e16b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:15.678114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 890/1794] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:04:15.688148 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad92d5-b790-40fb-9c0b-3dcc3625a1d0 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:15.692218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-08ad92d5-b790-40fb-9c0b-3dcc3625a1d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:15.708671 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad92d5-b790-40fb-9c0b-3dcc3625a1d0 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:15.714327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae6ace-ebb2-4c92-9838-8f81c258526c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:15.720424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae6ace-ebb2-4c92-9838-8f81c258526c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:15.720424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae6ace-ebb2-4c92-9838-8f81c258526c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:15.720424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae6ace-ebb2-4c92-9838-8f81c258526c admin admin] PATH_INFO: `/v3/users/1a140ca004524760ab37dc11cb3fd1f7` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:15.720424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae6ace-ebb2-4c92-9838-8f81c258526c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a140ca004524760ab37dc11cb3fd1f7)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:15.720424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae6ace-ebb2-4c92-9838-8f81c258526c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:15.797057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-78ad24a8-8a4a-4fc2-8bf8-0a67846992fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '905e6067c72e4a7a9b7a73051ee8e16b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:15.805052 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 905/1795] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:15 2022] DELETE /identity/v3/users/905e6067c72e4a7a9b7a73051ee8e16b => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:15.833237 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d0b0e-59b7-4d90-aaf4-131a53f84931 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:15.833556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d0b0e-59b7-4d90-aaf4-131a53f84931 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:15.833843 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d0b0e-59b7-4d90-aaf4-131a53f84931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:15.913285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-964d0b0e-59b7-4d90-aaf4-131a53f84931 None None] MFA Rules not processed for user `9751264123914c27b961009f75067660`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:15.915007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-964d0b0e-59b7-4d90-aaf4-131a53f84931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:16.027262 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 906/1796] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Aug 11 11:04:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:16.071628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-37ae6ace-ebb2-4c92-9838-8f81c258526c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a140ca004524760ab37dc11cb3fd1f7'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:16.086678 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-37ae6ace-ebb2-4c92-9838-8f81c258526c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a140ca004524760ab37dc11cb3fd1f7'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:16.087955 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-37ae6ace-ebb2-4c92-9838-8f81c258526c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a140ca004524760ab37dc11cb3fd1f7'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:16.115455 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d1fd7-89d4-4562-95aa-95b348ffe480 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:16.115729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d1fd7-89d4-4562-95aa-95b348ffe480 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:16.116798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d1fd7-89d4-4562-95aa-95b348ffe480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:16.141365 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-9d6d1fd7-89d4-4562-95aa-95b348ffe480 None None] MFA Rules not processed for user `6302b1f98544470a8986055a68bcd948`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:16.142867 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9d6d1fd7-89d4-4562-95aa-95b348ffe480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:16.195689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-37ae6ace-ebb2-4c92-9838-8f81c258526c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a140ca004524760ab37dc11cb3fd1f7'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:16.201611 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-37ae6ace-ebb2-4c92-9838-8f81c258526c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a140ca004524760ab37dc11cb3fd1f7'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:16.216222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 891/1797] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:15 2022] DELETE /identity/v3/users/1a140ca004524760ab37dc11cb3fd1f7 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:16.217856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a471c1-4105-460d-b800-6680f68f9d6c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:16.218150 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a471c1-4105-460d-b800-6680f68f9d6c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:16.218430 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a471c1-4105-460d-b800-6680f68f9d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:16.243511 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b0a471c1-4105-460d-b800-6680f68f9d6c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:16.244811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b0a471c1-4105-460d-b800-6680f68f9d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:16.297474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 907/1798] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Aug 11 11:04:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:04:16.329714 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d1fd7-89d4-4562-95aa-95b348ffe480 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:16.331865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9d6d1fd7-89d4-4562-95aa-95b348ffe480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:16.351123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d1fd7-89d4-4562-95aa-95b348ffe480 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:16.384428 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 892/1799] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:16.391489 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a471c1-4105-460d-b800-6680f68f9d6c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:16.394744 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b0a471c1-4105-460d-b800-6680f68f9d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:16.473270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5b94b-cab7-4dfc-b743-c83949162a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:16.473840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5b94b-cab7-4dfc-b743-c83949162a6c service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:16.474121 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5b94b-cab7-4dfc-b743-c83949162a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:16.474389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5b94b-cab7-4dfc-b743-c83949162a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:16.482441 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5b94b-cab7-4dfc-b743-c83949162a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:16.483922 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5b94b-cab7-4dfc-b743-c83949162a6c service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:16.493617 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 908/1800] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:04:16.509532 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a471c1-4105-460d-b800-6680f68f9d6c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:16.513769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b8740-053c-4596-a37d-5eaba73fb0e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:16.515329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b8740-053c-4596-a37d-5eaba73fb0e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:16.516181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b8740-053c-4596-a37d-5eaba73fb0e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:16.518423 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b8740-053c-4596-a37d-5eaba73fb0e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:16.530174 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b8740-053c-4596-a37d-5eaba73fb0e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:16.531864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b8740-053c-4596-a37d-5eaba73fb0e4 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:16.542275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 893/1801] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:16.592932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5b94b-cab7-4dfc-b743-c83949162a6c service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:16.596596 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-56b5b94b-cab7-4dfc-b743-c83949162a6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:16.614203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b8740-053c-4596-a37d-5eaba73fb0e4 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:16.616367 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c59b8740-053c-4596-a37d-5eaba73fb0e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:16.662071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5b94b-cab7-4dfc-b743-c83949162a6c service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:16.679201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f9785-0839-44a1-a4b1-24a1350ec7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:16.679872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f9785-0839-44a1-a4b1-24a1350ec7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:16.680152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f9785-0839-44a1-a4b1-24a1350ec7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:16.680425 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f9785-0839-44a1-a4b1-24a1350ec7c6 admin admin] PATH_INFO: `/v3/projects/a410a4503fc347a6838fd6eb2d37ddd3` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:16.689739 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:16.703806 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f9785-0839-44a1-a4b1-24a1350ec7c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a410a4503fc347a6838fd6eb2d37ddd3)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:16.724714 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f9785-0839-44a1-a4b1-24a1350ec7c6 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:16.848958 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b8740-053c-4596-a37d-5eaba73fb0e4 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:16.855522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cf9df-5bff-43c6-958d-e39ec62ca57c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd25d1bde0c4703b61e0edaf5b658d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:16.856479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cf9df-5bff-43c6-958d-e39ec62ca57c service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:16.857023 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cf9df-5bff-43c6-958d-e39ec62ca57c service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:16.857371 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cf9df-5bff-43c6-958d-e39ec62ca57c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:16.862071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f61cf9df-5bff-43c6-958d-e39ec62ca57c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:16.937657 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cf9df-5bff-43c6-958d-e39ec62ca57c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:16.939898 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cf9df-5bff-43c6-958d-e39ec62ca57c service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:16.963760 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 894/1802] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Aug 11 11:04:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 11:04:16.965226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7c1f9785-0839-44a1-a4b1-24a1350ec7c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a410a4503fc347a6838fd6eb2d37ddd3', 'request_id': 'req-7c1f9785-0839-44a1-a4b1-24a1350ec7c6'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:16.966482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cf9df-5bff-43c6-958d-e39ec62ca57c service swift] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:16.972741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7c1f9785-0839-44a1-a4b1-24a1350ec7c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a410a4503fc347a6838fd6eb2d37ddd3', 'request_id': 'req-7c1f9785-0839-44a1-a4b1-24a1350ec7c6'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:16.991882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cf9df-5bff-43c6-958d-e39ec62ca57c service swift] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:17.114175 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7c1f9785-0839-44a1-a4b1-24a1350ec7c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a410a4503fc347a6838fd6eb2d37ddd3', 'request_id': 'req-7c1f9785-0839-44a1-a4b1-24a1350ec7c6'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:17.122907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99749f27-8294-4cdf-a24d-523c2e4d024e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:17.124200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99749f27-8294-4cdf-a24d-523c2e4d024e service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:17.125269 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99749f27-8294-4cdf-a24d-523c2e4d024e service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:17.126029 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99749f27-8294-4cdf-a24d-523c2e4d024e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:17.138380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99749f27-8294-4cdf-a24d-523c2e4d024e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:17.142443 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99749f27-8294-4cdf-a24d-523c2e4d024e service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:17.154663 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 895/1803] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:17.155069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7c1f9785-0839-44a1-a4b1-24a1350ec7c6 admin admin] The token cache is being invalidate because project a410a4503fc347a6838fd6eb2d37ddd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:17.155524 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7c1f9785-0839-44a1-a4b1-24a1350ec7c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:17.159189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-7c1f9785-0839-44a1-a4b1-24a1350ec7c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:17.163964 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 909/1804] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:16 2022] DELETE /identity/v3/projects/a410a4503fc347a6838fd6eb2d37ddd3 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:17.171901 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0e220-02f2-477c-827f-f20e6ac08ac9 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:17.172588 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0e220-02f2-477c-827f-f20e6ac08ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:17.175245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0e220-02f2-477c-827f-f20e6ac08ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:17.251303 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e4c0e220-02f2-477c-827f-f20e6ac08ac9 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:17.252727 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e4c0e220-02f2-477c-827f-f20e6ac08ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:17.413274 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 896/1805] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:17.421395 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b4087-86d4-4a7f-8bed-18669a0ff9b3 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:17.421395 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b4087-86d4-4a7f-8bed-18669a0ff9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:17.422734 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b4087-86d4-4a7f-8bed-18669a0ff9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:17.458096 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-327b4087-86d4-4a7f-8bed-18669a0ff9b3 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:17.459417 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-327b4087-86d4-4a7f-8bed-18669a0ff9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:17.486221 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0e220-02f2-477c-827f-f20e6ac08ac9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:17.486612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 910/1806] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:17.506931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0e220-02f2-477c-827f-f20e6ac08ac9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:17.536579 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafe0c1-c26a-4c73-8e35-d1d5dc74a950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:17.542917 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafe0c1-c26a-4c73-8e35-d1d5dc74a950 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:17.546273 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafe0c1-c26a-4c73-8e35-d1d5dc74a950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:17.550683 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafe0c1-c26a-4c73-8e35-d1d5dc74a950 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:17.553244 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaafe0c1-c26a-4c73-8e35-d1d5dc74a950 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:04:17.553624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaafe0c1-c26a-4c73-8e35-d1d5dc74a950 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:17.561361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaafe0c1-c26a-4c73-8e35-d1d5dc74a950 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:17.605165 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 897/1807] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:04:17.611284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b4087-86d4-4a7f-8bed-18669a0ff9b3 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:17.626445 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b4087-86d4-4a7f-8bed-18669a0ff9b3 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:17.638645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb14b6-8fb3-4c8b-8fa9-a9c3cc4c47ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:17.642227 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb14b6-8fb3-4c8b-8fa9-a9c3cc4c47ef admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:17.642547 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb14b6-8fb3-4c8b-8fa9-a9c3cc4c47ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:17.643504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb14b6-8fb3-4c8b-8fa9-a9c3cc4c47ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:17.646340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb14b6-8fb3-4c8b-8fa9-a9c3cc4c47ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:17.658950 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb14b6-8fb3-4c8b-8fa9-a9c3cc4c47ef admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:17.834039 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:17.842725 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 911/1808] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:17 2022] POST /identity/v3/projects => generated 371 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:17.844320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafe0c1-c26a-4c73-8e35-d1d5dc74a950 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:17.862592 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafe0c1-c26a-4c73-8e35-d1d5dc74a950 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:18.127152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb14b6-8fb3-4c8b-8fa9-a9c3cc4c47ef admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:18.129260 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e1fb14b6-8fb3-4c8b-8fa9-a9c3cc4c47ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:18.144629 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c331726-5881-43a3-a3b9-7e2f19e158d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:18.145260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c331726-5881-43a3-a3b9-7e2f19e158d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:18.145560 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c331726-5881-43a3-a3b9-7e2f19e158d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:18.145868 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c331726-5881-43a3-a3b9-7e2f19e158d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:18.157835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c331726-5881-43a3-a3b9-7e2f19e158d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:18.165557 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c331726-5881-43a3-a3b9-7e2f19e158d6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:18.349170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb14b6-8fb3-4c8b-8fa9-a9c3cc4c47ef admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:18.356155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129f45c-050e-402e-b8c3-79dca68accb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:18.357728 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129f45c-050e-402e-b8c3-79dca68accb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:18.358492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129f45c-050e-402e-b8c3-79dca68accb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:18.358948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129f45c-050e-402e-b8c3-79dca68accb4 admin admin] PATH_INFO: `/v3/projects/f1526fe1946a4ff2828630bd2d7a7522` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:18.361742 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129f45c-050e-402e-b8c3-79dca68accb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1526fe1946a4ff2828630bd2d7a7522)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:18.364804 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129f45c-050e-402e-b8c3-79dca68accb4 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:18.462909 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 898/1809] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:17 2022] POST /identity/v3/users => generated 286 bytes in 620 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:18.463894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c331726-5881-43a3-a3b9-7e2f19e158d6 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:18.467578 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3c331726-5881-43a3-a3b9-7e2f19e158d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:18.809346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c331726-5881-43a3-a3b9-7e2f19e158d6 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:18.809346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294acd01-31d4-44b7-8236-c5ae246cab8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:18.809346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294acd01-31d4-44b7-8236-c5ae246cab8f service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:18.809346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294acd01-31d4-44b7-8236-c5ae246cab8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:18.811207 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294acd01-31d4-44b7-8236-c5ae246cab8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:18.811207 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-294acd01-31d4-44b7-8236-c5ae246cab8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:18.811207 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294acd01-31d4-44b7-8236-c5ae246cab8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:18.811207 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294acd01-31d4-44b7-8236-c5ae246cab8f service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:18.811207 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 899/1810] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:18.811207 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294acd01-31d4-44b7-8236-c5ae246cab8f service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:18.813353 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294acd01-31d4-44b7-8236-c5ae246cab8f service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:18.813353 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15a337-c90d-4a70-b7ed-8d4978463aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:18.813353 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15a337-c90d-4a70-b7ed-8d4978463aeb admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:18.813353 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15a337-c90d-4a70-b7ed-8d4978463aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:18.815295 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15a337-c90d-4a70-b7ed-8d4978463aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:18.815295 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15a337-c90d-4a70-b7ed-8d4978463aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:18.815295 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15a337-c90d-4a70-b7ed-8d4978463aeb admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:18.815295 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 900/1811] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:18.815295 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15a337-c90d-4a70-b7ed-8d4978463aeb admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:18.826840 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15a337-c90d-4a70-b7ed-8d4978463aeb admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:18.885839 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a49e8c-a567-4419-aff2-cc511a7d63f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:18.885839 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a49e8c-a567-4419-aff2-cc511a7d63f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:18.885839 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a49e8c-a567-4419-aff2-cc511a7d63f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:18.885839 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a49e8c-a567-4419-aff2-cc511a7d63f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:18.886380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a49e8c-a567-4419-aff2-cc511a7d63f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:18.886380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a49e8c-a567-4419-aff2-cc511a7d63f9 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:18.886380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 901/1812] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:04:18.886380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a49e8c-a567-4419-aff2-cc511a7d63f9 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:18.892727 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a49e8c-a567-4419-aff2-cc511a7d63f9 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:18.897936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5c226-29e4-4e5c-9e9a-32010825636b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:18.898744 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5c226-29e4-4e5c-9e9a-32010825636b admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:18.899134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5c226-29e4-4e5c-9e9a-32010825636b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:18.899464 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5c226-29e4-4e5c-9e9a-32010825636b admin admin] PATH_INFO: `/v3/projects/d8aa3e9671194034adddaa6f853445b2/users/9d14dbbf1ac243bd919811aa7ae63f50/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:18.923388 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5c226-29e4-4e5c-9e9a-32010825636b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8aa3e9671194034adddaa6f853445b2, user_id=9d14dbbf1ac243bd919811aa7ae63f50, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:18.931747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5c226-29e4-4e5c-9e9a-32010825636b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:18.933840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c129f45c-050e-402e-b8c3-79dca68accb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1526fe1946a4ff2828630bd2d7a7522', 'request_id': 'req-c129f45c-050e-402e-b8c3-79dca68accb4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:18.942643 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c129f45c-050e-402e-b8c3-79dca68accb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1526fe1946a4ff2828630bd2d7a7522', 'request_id': 'req-c129f45c-050e-402e-b8c3-79dca68accb4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:20.998409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c129f45c-050e-402e-b8c3-79dca68accb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1526fe1946a4ff2828630bd2d7a7522', 'request_id': 'req-c129f45c-050e-402e-b8c3-79dca68accb4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:21.007345 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 902/1813] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:18 2022] PUT /identity/v3/projects/d8aa3e9671194034adddaa6f853445b2/users/9d14dbbf1ac243bd919811aa7ae63f50/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 2125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:21.008695 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710299a-3936-487d-b191-614f87c70c8c None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:21.008991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710299a-3936-487d-b191-614f87c70c8c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:21.009272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710299a-3936-487d-b191-614f87c70c8c None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:21.010668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 903/1814] 10.222.0.43 () {54 vars in 921 bytes} [Thu Aug 11 11:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:04:21.019610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab578d7-68fa-4adb-832c-f8b94d80aafa None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:21.023731 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab578d7-68fa-4adb-832c-f8b94d80aafa None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:21.024142 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab578d7-68fa-4adb-832c-f8b94d80aafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:21.045778 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c129f45c-050e-402e-b8c3-79dca68accb4 admin admin] The token cache is being invalidate because project f1526fe1946a4ff2828630bd2d7a7522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:21.046094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c129f45c-050e-402e-b8c3-79dca68accb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:21.049318 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c129f45c-050e-402e-b8c3-79dca68accb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:21.056544 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 912/1815] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:18 2022] DELETE /identity/v3/projects/f1526fe1946a4ff2828630bd2d7a7522 => generated 0 bytes in 2930 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:21.064315 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-aab578d7-68fa-4adb-832c-f8b94d80aafa None None] MFA Rules not processed for user `9267752ac6724013bc1edcdecff48dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:21.067618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-aab578d7-68fa-4adb-832c-f8b94d80aafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:21.071898 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ea747-a3a7-4586-bfee-9ce5f20bfca4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:21.072609 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ea747-a3a7-4586-bfee-9ce5f20bfca4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:21.073076 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ea747-a3a7-4586-bfee-9ce5f20bfca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:21.177007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e63ea747-a3a7-4586-bfee-9ce5f20bfca4 None None] MFA Rules not processed for user `9d14dbbf1ac243bd919811aa7ae63f50`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:21.182018 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e63ea747-a3a7-4586-bfee-9ce5f20bfca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:21.246264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 904/1816] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Aug 11 11:04:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:21.246895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab578d7-68fa-4adb-832c-f8b94d80aafa None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:21.248214 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-aab578d7-68fa-4adb-832c-f8b94d80aafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:21.318888 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 913/1817] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:21.318888 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314c56a-3572-4615-9228-97ebf6caa126 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:21.318888 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314c56a-3572-4615-9228-97ebf6caa126 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:21.322291 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314c56a-3572-4615-9228-97ebf6caa126 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:21.326513 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 914/1818] 10.222.0.43 () {54 vars in 921 bytes} [Thu Aug 11 11:04:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:04:21.329302 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314c56a-3572-4615-9228-97ebf6caa126 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:21.334296 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9314c56a-3572-4615-9228-97ebf6caa126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:21.447877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab578d7-68fa-4adb-832c-f8b94d80aafa None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:21.454847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f8b00-fd23-4eeb-9ccc-960a099fa3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:21.456092 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f8b00-fd23-4eeb-9ccc-960a099fa3e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:21.456446 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f8b00-fd23-4eeb-9ccc-960a099fa3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:21.457233 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f8b00-fd23-4eeb-9ccc-960a099fa3e5 admin admin] PATH_INFO: `/v3/users/1515d99518584c52b46af2cd379e3f89` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:21.458550 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f8b00-fd23-4eeb-9ccc-960a099fa3e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1515d99518584c52b46af2cd379e3f89)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:21.460683 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f8b00-fd23-4eeb-9ccc-960a099fa3e5 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:21.471633 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314c56a-3572-4615-9228-97ebf6caa126 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:21.476550 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9291bd-5aa2-4295-b094-30bf62ede8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:21.477268 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9291bd-5aa2-4295-b094-30bf62ede8fa admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:21.477785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9291bd-5aa2-4295-b094-30bf62ede8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:21.478122 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9291bd-5aa2-4295-b094-30bf62ede8fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:21.478857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9291bd-5aa2-4295-b094-30bf62ede8fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:21.481544 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9291bd-5aa2-4295-b094-30bf62ede8fa admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:21.667725 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 915/1819] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:21 2022] POST /identity/v3/projects => generated 373 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:21.669691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32de80e-a4f7-43ec-b9bc-99ae478d3063 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:21.671363 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32de80e-a4f7-43ec-b9bc-99ae478d3063 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:21.671769 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32de80e-a4f7-43ec-b9bc-99ae478d3063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:21.761341 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:21.773634 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e32de80e-a4f7-43ec-b9bc-99ae478d3063 None None] MFA Rules not processed for user `9267752ac6724013bc1edcdecff48dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:21.775928 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e32de80e-a4f7-43ec-b9bc-99ae478d3063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:21.777994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e91f8b00-fd23-4eeb-9ccc-960a099fa3e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1515d99518584c52b46af2cd379e3f89'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:21.809597 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e91f8b00-fd23-4eeb-9ccc-960a099fa3e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1515d99518584c52b46af2cd379e3f89'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:21.811354 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e91f8b00-fd23-4eeb-9ccc-960a099fa3e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1515d99518584c52b46af2cd379e3f89'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:21.888392 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e91f8b00-fd23-4eeb-9ccc-960a099fa3e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1515d99518584c52b46af2cd379e3f89'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:21.896133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 916/1820] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Aug 11 11:04:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:21.898906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32de80e-a4f7-43ec-b9bc-99ae478d3063 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:21.899172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e91f8b00-fd23-4eeb-9ccc-960a099fa3e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1515d99518584c52b46af2cd379e3f89'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:21.900226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e32de80e-a4f7-43ec-b9bc-99ae478d3063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:21.914924 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 905/1821] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:21 2022] DELETE /identity/v3/users/1515d99518584c52b46af2cd379e3f89 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:21.916926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f8b00-fd23-4eeb-9ccc-960a099fa3e5 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:21.931844 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32de80e-a4f7-43ec-b9bc-99ae478d3063 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:21.933294 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e91f8b00-fd23-4eeb-9ccc-960a099fa3e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:22.055888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f8b00-fd23-4eeb-9ccc-960a099fa3e5 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:22.062656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7befd-33dc-4a7a-afac-b58ffa367eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:22.063449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7befd-33dc-4a7a-afac-b58ffa367eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:22.064053 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7befd-33dc-4a7a-afac-b58ffa367eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:22.064422 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7befd-33dc-4a7a-afac-b58ffa367eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:22.065215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7befd-33dc-4a7a-afac-b58ffa367eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:22.067327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7befd-33dc-4a7a-afac-b58ffa367eb6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:22.117921 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ba041-ef4a-4787-8d7a-4700298472cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:22.119620 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ba041-ef4a-4787-8d7a-4700298472cc service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:22.120023 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ba041-ef4a-4787-8d7a-4700298472cc service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:22.120307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ba041-ef4a-4787-8d7a-4700298472cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:22.122550 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ae2ba041-ef4a-4787-8d7a-4700298472cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:22.140851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ba041-ef4a-4787-8d7a-4700298472cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:22.143206 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ba041-ef4a-4787-8d7a-4700298472cc service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:22.154839 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 917/1822] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:22.155584 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ba041-ef4a-4787-8d7a-4700298472cc service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:22.158055 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ae2ba041-ef4a-4787-8d7a-4700298472cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:22.173422 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ba041-ef4a-4787-8d7a-4700298472cc service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:22.181840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec87c4-b976-47a2-bbf0-aec77497b168 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:22.182452 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec87c4-b976-47a2-bbf0-aec77497b168 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:22.182865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec87c4-b976-47a2-bbf0-aec77497b168 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:22.183025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec87c4-b976-47a2-bbf0-aec77497b168 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:22.188452 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-84ec87c4-b976-47a2-bbf0-aec77497b168 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:22.210127 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec87c4-b976-47a2-bbf0-aec77497b168 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:22.212898 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec87c4-b976-47a2-bbf0-aec77497b168 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:22.247884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 918/1823] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:22.277672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 906/1824] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:21 2022] POST /identity/v3/users => generated 293 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:22.282571 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec87c4-b976-47a2-bbf0-aec77497b168 service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:22.286022 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:22.295831 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec87c4-b976-47a2-bbf0-aec77497b168 service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:22.313708 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78561a09-6061-4d40-8188-3d23e3ac4b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:22.316430 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78561a09-6061-4d40-8188-3d23e3ac4b55 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:22.316430 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78561a09-6061-4d40-8188-3d23e3ac4b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:22.316430 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78561a09-6061-4d40-8188-3d23e3ac4b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:22.316690 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78561a09-6061-4d40-8188-3d23e3ac4b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:22.318562 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78561a09-6061-4d40-8188-3d23e3ac4b55 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:22.336853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7befd-33dc-4a7a-afac-b58ffa367eb6 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:22.342355 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 919/1825] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:04:22.348853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7befd-33dc-4a7a-afac-b58ffa367eb6 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:22.356267 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce1793-04f0-4319-b539-3bfed57c514b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:22.358020 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce1793-04f0-4319-b539-3bfed57c514b admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:22.358973 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce1793-04f0-4319-b539-3bfed57c514b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:22.359677 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce1793-04f0-4319-b539-3bfed57c514b admin admin] PATH_INFO: `/v3/projects/b1fef7eb4f4e4730a482ab020e7c7042/users/b635b94a5297457992ad3bde92db016c/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:22.386619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce1793-04f0-4319-b539-3bfed57c514b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1fef7eb4f4e4730a482ab020e7c7042, user_id=b635b94a5297457992ad3bde92db016c, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:22.389832 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce1793-04f0-4319-b539-3bfed57c514b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:22.548723 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78561a09-6061-4d40-8188-3d23e3ac4b55 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:22.549845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 907/1826] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:22 2022] PUT /identity/v3/projects/b1fef7eb4f4e4730a482ab020e7c7042/users/b635b94a5297457992ad3bde92db016c/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:22.566838 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78561a09-6061-4d40-8188-3d23e3ac4b55 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:22.675050 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce1793-04f0-4319-b539-3bfed57c514b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:22.677095 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-87ce1793-04f0-4319-b539-3bfed57c514b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:22.693174 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd31e7-6406-4b2e-a557-7fe02c4544e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:22.694085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd31e7-6406-4b2e-a557-7fe02c4544e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:22.694742 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd31e7-6406-4b2e-a557-7fe02c4544e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:22.695346 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd31e7-6406-4b2e-a557-7fe02c4544e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:22.696268 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd31e7-6406-4b2e-a557-7fe02c4544e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:22.698046 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd31e7-6406-4b2e-a557-7fe02c4544e0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:22.719098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 920/1827] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:22.730361 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd31e7-6406-4b2e-a557-7fe02c4544e0 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:22.742458 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd31e7-6406-4b2e-a557-7fe02c4544e0 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:22.760511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc56109-7438-4197-8eab-488d3f7e8572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:22.761422 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc56109-7438-4197-8eab-488d3f7e8572 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:22.761915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc56109-7438-4197-8eab-488d3f7e8572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:22.762276 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc56109-7438-4197-8eab-488d3f7e8572 admin admin] PATH_INFO: `/v3/projects/b1fef7eb4f4e4730a482ab020e7c7042/users/b635b94a5297457992ad3bde92db016c/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:22.764718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc56109-7438-4197-8eab-488d3f7e8572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1fef7eb4f4e4730a482ab020e7c7042, user_id=b635b94a5297457992ad3bde92db016c, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:22.769285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc56109-7438-4197-8eab-488d3f7e8572 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:22.788627 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 921/1828] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:22 2022] PUT /identity/v3/projects/b1fef7eb4f4e4730a482ab020e7c7042/users/b635b94a5297457992ad3bde92db016c/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:22.800464 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29736604-1e87-4f6b-ba98-e01cf42af717 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:22.800771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29736604-1e87-4f6b-ba98-e01cf42af717 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:22.801193 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29736604-1e87-4f6b-ba98-e01cf42af717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:22.854251 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-29736604-1e87-4f6b-ba98-e01cf42af717 None None] MFA Rules not processed for user `b635b94a5297457992ad3bde92db016c`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:22.857561 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-29736604-1e87-4f6b-ba98-e01cf42af717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:22.905460 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce1793-04f0-4319-b539-3bfed57c514b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:22.959619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 922/1829] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:04:22.987422 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29736604-1e87-4f6b-ba98-e01cf42af717 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:22.989070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-29736604-1e87-4f6b-ba98-e01cf42af717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:23.036469 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5a2dc-8e9e-45f5-8c24-59fd9b9ef64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:23.037383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5a2dc-8e9e-45f5-8c24-59fd9b9ef64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:23.037671 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5a2dc-8e9e-45f5-8c24-59fd9b9ef64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:23.037950 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5a2dc-8e9e-45f5-8c24-59fd9b9ef64c admin admin] PATH_INFO: `/v3/projects/f38704f67d5a4574bcf1e46d2c3217df` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:23.039429 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5a2dc-8e9e-45f5-8c24-59fd9b9ef64c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f38704f67d5a4574bcf1e46d2c3217df)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:23.041372 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5a2dc-8e9e-45f5-8c24-59fd9b9ef64c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:23.102506 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29736604-1e87-4f6b-ba98-e01cf42af717 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:23.110043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9a62e-9d6a-4984-9487-e7213987d13f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:23.110840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9a62e-9d6a-4984-9487-e7213987d13f service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:23.111814 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9a62e-9d6a-4984-9487-e7213987d13f service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:23.115153 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9a62e-9d6a-4984-9487-e7213987d13f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:23.129848 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9a62e-9d6a-4984-9487-e7213987d13f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:23.131648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9a62e-9d6a-4984-9487-e7213987d13f service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:23.145417 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 923/1830] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:23.323560 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c2f5a2dc-8e9e-45f5-8c24-59fd9b9ef64c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f38704f67d5a4574bcf1e46d2c3217df', 'request_id': 'req-c2f5a2dc-8e9e-45f5-8c24-59fd9b9ef64c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:23.334398 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c2f5a2dc-8e9e-45f5-8c24-59fd9b9ef64c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f38704f67d5a4574bcf1e46d2c3217df', 'request_id': 'req-c2f5a2dc-8e9e-45f5-8c24-59fd9b9ef64c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:23.351106 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c2f5a2dc-8e9e-45f5-8c24-59fd9b9ef64c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f38704f67d5a4574bcf1e46d2c3217df', 'request_id': 'req-c2f5a2dc-8e9e-45f5-8c24-59fd9b9ef64c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:23.431405 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c2f5a2dc-8e9e-45f5-8c24-59fd9b9ef64c admin admin] The token cache is being invalidate because project f38704f67d5a4574bcf1e46d2c3217df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:23.431726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c2f5a2dc-8e9e-45f5-8c24-59fd9b9ef64c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:23.432826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c2f5a2dc-8e9e-45f5-8c24-59fd9b9ef64c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:23.434366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 908/1831] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:22 2022] DELETE /identity/v3/projects/f38704f67d5a4574bcf1e46d2c3217df => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:23.440709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a15db-75a4-4601-a3f4-ed6190b0c7e8 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:23.441368 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a15db-75a4-4601-a3f4-ed6190b0c7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:23.441965 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a15db-75a4-4601-a3f4-ed6190b0c7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:23.489198 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-839a15db-75a4-4601-a3f4-ed6190b0c7e8 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:23.491268 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-839a15db-75a4-4601-a3f4-ed6190b0c7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:23.582322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 924/1832] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:23.592327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a66ca0-3a42-452f-a007-2e768f9e9f62 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:23.592611 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a66ca0-3a42-452f-a007-2e768f9e9f62 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:23.593441 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a66ca0-3a42-452f-a007-2e768f9e9f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:23.615698 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d3a66ca0-3a42-452f-a007-2e768f9e9f62 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:23.616998 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d3a66ca0-3a42-452f-a007-2e768f9e9f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:23.626890 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 909/1833] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:23.633763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a15db-75a4-4601-a3f4-ed6190b0c7e8 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:23.673679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a15db-75a4-4601-a3f4-ed6190b0c7e8 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:23.673679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a035c-4d32-4b1a-811e-eb0cb1bcfe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:23.673679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a035c-4d32-4b1a-811e-eb0cb1bcfe6f admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:23.673679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a035c-4d32-4b1a-811e-eb0cb1bcfe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:23.674320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a035c-4d32-4b1a-811e-eb0cb1bcfe6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:23.674320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a035c-4d32-4b1a-811e-eb0cb1bcfe6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:04:23.674320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a035c-4d32-4b1a-811e-eb0cb1bcfe6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:23.674320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a035c-4d32-4b1a-811e-eb0cb1bcfe6f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:23.696934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 925/1834] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:04:23.701626 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a66ca0-3a42-452f-a007-2e768f9e9f62 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:23.734997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a66ca0-3a42-452f-a007-2e768f9e9f62 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:23.734997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe52c7-be93-4b9f-9b09-755b4cd2ab68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:23.734997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe52c7-be93-4b9f-9b09-755b4cd2ab68 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:23.734997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe52c7-be93-4b9f-9b09-755b4cd2ab68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:23.735467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe52c7-be93-4b9f-9b09-755b4cd2ab68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:23.735467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe52c7-be93-4b9f-9b09-755b4cd2ab68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:23.735467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe52c7-be93-4b9f-9b09-755b4cd2ab68 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:24.052884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 910/1835] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:23 2022] POST /identity/v3/projects => generated 401 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:24.065872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a035c-4d32-4b1a-811e-eb0cb1bcfe6f admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:24.088210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a035c-4d32-4b1a-811e-eb0cb1bcfe6f admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:24.215798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd958e-c677-4586-923f-3a01cc32a260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:24.218354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd958e-c677-4586-923f-3a01cc32a260 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:24.218966 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd958e-c677-4586-923f-3a01cc32a260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:24.219645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd958e-c677-4586-923f-3a01cc32a260 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:24.220603 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd958e-c677-4586-923f-3a01cc32a260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:24.223068 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd958e-c677-4586-923f-3a01cc32a260 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:24.466305 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 926/1836] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:24 2022] POST /identity/v3/users => generated 301 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:24.471712 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe52c7-be93-4b9f-9b09-755b4cd2ab68 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:24.499808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe52c7-be93-4b9f-9b09-755b4cd2ab68 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:24.507187 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5457a-dfe0-42dc-b8d6-33216aee4f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:24.508221 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5457a-dfe0-42dc-b8d6-33216aee4f6a admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:24.508726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5457a-dfe0-42dc-b8d6-33216aee4f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:24.509535 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5457a-dfe0-42dc-b8d6-33216aee4f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:24.516436 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5457a-dfe0-42dc-b8d6-33216aee4f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:24.519246 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5457a-dfe0-42dc-b8d6-33216aee4f6a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:24.531275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 911/1837] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:24.535978 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd958e-c677-4586-923f-3a01cc32a260 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:24.549155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd958e-c677-4586-923f-3a01cc32a260 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:24.554915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a90e20-afe5-4198-a1ad-a5e280edd72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:24.555940 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a90e20-afe5-4198-a1ad-a5e280edd72d admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:24.556226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a90e20-afe5-4198-a1ad-a5e280edd72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:24.556495 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a90e20-afe5-4198-a1ad-a5e280edd72d admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:24.557199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a90e20-afe5-4198-a1ad-a5e280edd72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:24.559163 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a90e20-afe5-4198-a1ad-a5e280edd72d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:24.571992 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 927/1838] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:24.576407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5457a-dfe0-42dc-b8d6-33216aee4f6a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:24.590696 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5457a-dfe0-42dc-b8d6-33216aee4f6a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:24.606087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04fbbf-0186-4688-8388-ffa6fca0f76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:24.610533 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04fbbf-0186-4688-8388-ffa6fca0f76d admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:24.611159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04fbbf-0186-4688-8388-ffa6fca0f76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:24.611459 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04fbbf-0186-4688-8388-ffa6fca0f76d admin admin] PATH_INFO: `/v3/projects/52470354b5bc4625ab52003d9b7538a1/users/0c56e71ba7034ce2b6069166e4a522bf/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:24.624701 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:24.640126 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04fbbf-0186-4688-8388-ffa6fca0f76d admin admin] RBAC: Authorizing `identity:create_grant(project_id=52470354b5bc4625ab52003d9b7538a1, user_id=0c56e71ba7034ce2b6069166e4a522bf, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:24.647553 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04fbbf-0186-4688-8388-ffa6fca0f76d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:24.767599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 912/1839] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:24 2022] PUT /identity/v3/projects/52470354b5bc4625ab52003d9b7538a1/users/0c56e71ba7034ce2b6069166e4a522bf/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:24.780277 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef15fe-7df2-4ef1-a347-89065ec79601 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:24.781336 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef15fe-7df2-4ef1-a347-89065ec79601 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:24.781862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef15fe-7df2-4ef1-a347-89065ec79601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:24.866383 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-29ef15fe-7df2-4ef1-a347-89065ec79601 None None] MFA Rules not processed for user `0c56e71ba7034ce2b6069166e4a522bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:24.867772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-29ef15fe-7df2-4ef1-a347-89065ec79601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:24.962270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:25.012890 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 928/1840] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:24 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:25.018514 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04fbbf-0186-4688-8388-ffa6fca0f76d admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:25.147768 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04fbbf-0186-4688-8388-ffa6fca0f76d admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:25.155230 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531438a-e5d3-4a7c-94ef-5c49df56df93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:25.156580 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531438a-e5d3-4a7c-94ef-5c49df56df93 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:25.157155 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531438a-e5d3-4a7c-94ef-5c49df56df93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:25.157521 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531438a-e5d3-4a7c-94ef-5c49df56df93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:25.158609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531438a-e5d3-4a7c-94ef-5c49df56df93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:25.160574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531438a-e5d3-4a7c-94ef-5c49df56df93 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:25.367782 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 913/1841] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:25 2022] POST /identity/v3/projects => generated 401 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:25.372189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef15fe-7df2-4ef1-a347-89065ec79601 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:25.404724 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef15fe-7df2-4ef1-a347-89065ec79601 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:25.575352 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531438a-e5d3-4a7c-94ef-5c49df56df93 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:25.576334 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582f4fc-358d-4903-8c48-5dc61197e237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:25.579998 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6531438a-e5d3-4a7c-94ef-5c49df56df93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:25.580215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582f4fc-358d-4903-8c48-5dc61197e237 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:25.580215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582f4fc-358d-4903-8c48-5dc61197e237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:25.580215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582f4fc-358d-4903-8c48-5dc61197e237 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:25.580215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582f4fc-358d-4903-8c48-5dc61197e237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:25.581288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582f4fc-358d-4903-8c48-5dc61197e237 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:25.638406 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531438a-e5d3-4a7c-94ef-5c49df56df93 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:25.656164 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa72080-3789-45f7-92a1-1566cc88d2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:25.663006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa72080-3789-45f7-92a1-1566cc88d2fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:25.663386 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa72080-3789-45f7-92a1-1566cc88d2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:25.663629 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa72080-3789-45f7-92a1-1566cc88d2fd admin admin] PATH_INFO: `/v3/users/9d14dbbf1ac243bd919811aa7ae63f50` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:25.664957 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa72080-3789-45f7-92a1-1566cc88d2fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d14dbbf1ac243bd919811aa7ae63f50)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:25.667846 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa72080-3789-45f7-92a1-1566cc88d2fd admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:25.696201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 929/1842] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:25 2022] POST /identity/v3/users => generated 307 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:25.701349 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582f4fc-358d-4903-8c48-5dc61197e237 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:25.733535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582f4fc-358d-4903-8c48-5dc61197e237 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:25.748248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ba763-3a06-4af6-adae-7dea5a3354a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:25.752604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ba763-3a06-4af6-adae-7dea5a3354a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:25.752897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ba763-3a06-4af6-adae-7dea5a3354a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:25.753179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ba763-3a06-4af6-adae-7dea5a3354a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:25.756589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ba763-3a06-4af6-adae-7dea5a3354a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:25.760605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ba763-3a06-4af6-adae-7dea5a3354a3 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:25.787691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 930/1843] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:25.790371 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ba763-3a06-4af6-adae-7dea5a3354a3 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:25.819016 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ba763-3a06-4af6-adae-7dea5a3354a3 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:25.833931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51723e-339d-4a51-8dca-656d91bea93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:25.834625 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51723e-339d-4a51-8dca-656d91bea93d admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:25.834932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51723e-339d-4a51-8dca-656d91bea93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:25.837282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51723e-339d-4a51-8dca-656d91bea93d admin admin] PATH_INFO: `/v3/projects/6e4db72452a546f0bb32b4f91493506b/users/d470210029a0484ba30b7b1242d04c40/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:25.871528 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51723e-339d-4a51-8dca-656d91bea93d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4db72452a546f0bb32b4f91493506b, user_id=d470210029a0484ba30b7b1242d04c40, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:25.878719 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51723e-339d-4a51-8dca-656d91bea93d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:25.986258 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2fa72080-3789-45f7-92a1-1566cc88d2fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d14dbbf1ac243bd919811aa7ae63f50'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:26.013436 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2fa72080-3789-45f7-92a1-1566cc88d2fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d14dbbf1ac243bd919811aa7ae63f50'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:26.015006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2fa72080-3789-45f7-92a1-1566cc88d2fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d14dbbf1ac243bd919811aa7ae63f50'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:26.044409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 931/1844] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:25 2022] PUT /identity/v3/projects/6e4db72452a546f0bb32b4f91493506b/users/d470210029a0484ba30b7b1242d04c40/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:26.049529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51723e-339d-4a51-8dca-656d91bea93d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:26.170917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51723e-339d-4a51-8dca-656d91bea93d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:26.175987 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d56bea-a002-4bb4-a47a-7cb14eaac77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:26.176563 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d56bea-a002-4bb4-a47a-7cb14eaac77b admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:26.176868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d56bea-a002-4bb4-a47a-7cb14eaac77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:26.177115 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d56bea-a002-4bb4-a47a-7cb14eaac77b admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:26.177798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d56bea-a002-4bb4-a47a-7cb14eaac77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:26.179435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d56bea-a002-4bb4-a47a-7cb14eaac77b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:26.179540 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2fa72080-3789-45f7-92a1-1566cc88d2fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d14dbbf1ac243bd919811aa7ae63f50'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:26.189823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2fa72080-3789-45f7-92a1-1566cc88d2fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d14dbbf1ac243bd919811aa7ae63f50'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:26.193309 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 932/1845] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:26.197355 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d56bea-a002-4bb4-a47a-7cb14eaac77b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:26.198222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 914/1846] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:25 2022] DELETE /identity/v3/users/9d14dbbf1ac243bd919811aa7ae63f50 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:26.203269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d5d56bea-a002-4bb4-a47a-7cb14eaac77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:26.204857 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d34b6-80dc-41c8-b09d-be74ee6e8603 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:26.205326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d34b6-80dc-41c8-b09d-be74ee6e8603 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:26.205614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d34b6-80dc-41c8-b09d-be74ee6e8603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:26.232321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0e1d34b6-80dc-41c8-b09d-be74ee6e8603 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:26.233620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0e1d34b6-80dc-41c8-b09d-be74ee6e8603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:26.255065 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d56bea-a002-4bb4-a47a-7cb14eaac77b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:26.340083 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 915/1847] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:26.355106 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d34b6-80dc-41c8-b09d-be74ee6e8603 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:26.355624 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90472b-9513-4f22-ad27-7465c5fc8c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:26.356780 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90472b-9513-4f22-ad27-7465c5fc8c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:26.357125 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90472b-9513-4f22-ad27-7465c5fc8c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:26.357409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90472b-9513-4f22-ad27-7465c5fc8c7c admin admin] PATH_INFO: `/v3/projects/6e4db72452a546f0bb32b4f91493506b/users/d470210029a0484ba30b7b1242d04c40/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:26.358243 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0e1d34b6-80dc-41c8-b09d-be74ee6e8603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:26.365055 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90472b-9513-4f22-ad27-7465c5fc8c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4db72452a546f0bb32b4f91493506b, user_id=d470210029a0484ba30b7b1242d04c40, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:26.380321 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90472b-9513-4f22-ad27-7465c5fc8c7c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:26.409046 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 933/1848] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:26 2022] PUT /identity/v3/projects/6e4db72452a546f0bb32b4f91493506b/users/d470210029a0484ba30b7b1242d04c40/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:26.416249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375bc94-bb13-4759-99bf-c1565a81ac5c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:26.416551 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375bc94-bb13-4759-99bf-c1565a81ac5c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:26.418229 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375bc94-bb13-4759-99bf-c1565a81ac5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:26.464936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d34b6-80dc-41c8-b09d-be74ee6e8603 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:26.476667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-6375bc94-bb13-4759-99bf-c1565a81ac5c None None] MFA Rules not processed for user `d470210029a0484ba30b7b1242d04c40`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:26.478258 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6375bc94-bb13-4759-99bf-c1565a81ac5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:26.603820 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459996a-8c25-4f61-a1ae-e17d2dedc9b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:26.603820 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459996a-8c25-4f61-a1ae-e17d2dedc9b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:26.603820 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459996a-8c25-4f61-a1ae-e17d2dedc9b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:26.603820 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459996a-8c25-4f61-a1ae-e17d2dedc9b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:26.641207 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 934/1849] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:26 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:26.732105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375bc94-bb13-4759-99bf-c1565a81ac5c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:26.732508 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459996a-8c25-4f61-a1ae-e17d2dedc9b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:26.734642 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6375bc94-bb13-4759-99bf-c1565a81ac5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:26.735429 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459996a-8c25-4f61-a1ae-e17d2dedc9b4 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:26.754352 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 916/1850] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:04:26.864071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375bc94-bb13-4759-99bf-c1565a81ac5c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:26.867944 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9e1d1-3abf-4005-b2dc-4bb3eee68e80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:26.868568 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9e1d1-3abf-4005-b2dc-4bb3eee68e80 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:26.868849 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9e1d1-3abf-4005-b2dc-4bb3eee68e80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:26.869125 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9e1d1-3abf-4005-b2dc-4bb3eee68e80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:26.887625 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9e1d1-3abf-4005-b2dc-4bb3eee68e80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:26.888959 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9e1d1-3abf-4005-b2dc-4bb3eee68e80 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:26.906151 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 935/1851] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:26 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:04:27.353786 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459996a-8c25-4f61-a1ae-e17d2dedc9b4 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:27.355806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c459996a-8c25-4f61-a1ae-e17d2dedc9b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:27.376747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459996a-8c25-4f61-a1ae-e17d2dedc9b4 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:27.382052 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d5cbf-4eab-4a0f-bf97-7e6a6614e559 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:27.382341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d5cbf-4eab-4a0f-bf97-7e6a6614e559 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:27.382626 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d5cbf-4eab-4a0f-bf97-7e6a6614e559 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:27.382967 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d5cbf-4eab-4a0f-bf97-7e6a6614e559 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:27.385476 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4c6d5cbf-4eab-4a0f-bf97-7e6a6614e559 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:27.530650 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d5cbf-4eab-4a0f-bf97-7e6a6614e559 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:27.532507 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d5cbf-4eab-4a0f-bf97-7e6a6614e559 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:27.550226 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 917/1852] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:27 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:27.581854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9e1d1-3abf-4005-b2dc-4bb3eee68e80 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:27.583357 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-46a9e1d1-3abf-4005-b2dc-4bb3eee68e80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:27.598881 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9e1d1-3abf-4005-b2dc-4bb3eee68e80 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:27.605104 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31783636-a3aa-4807-88ea-e5074e283564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:27.606075 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31783636-a3aa-4807-88ea-e5074e283564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:27.606363 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31783636-a3aa-4807-88ea-e5074e283564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:27.606643 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31783636-a3aa-4807-88ea-e5074e283564 admin admin] PATH_INFO: `/v3/users/f5edd486741b4a1f99ba1c33f645bd56` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:27.608050 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31783636-a3aa-4807-88ea-e5074e283564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5edd486741b4a1f99ba1c33f645bd56)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:27.612414 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31783636-a3aa-4807-88ea-e5074e283564 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:27.743821 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d5cbf-4eab-4a0f-bf97-7e6a6614e559 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:27.745248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4c6d5cbf-4eab-4a0f-bf97-7e6a6614e559 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:27.759537 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d5cbf-4eab-4a0f-bf97-7e6a6614e559 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:27.765598 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0a866-2ea2-4e5c-b4ac-0bb2d9208391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:27.766444 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0a866-2ea2-4e5c-b4ac-0bb2d9208391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:27.766873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0a866-2ea2-4e5c-b4ac-0bb2d9208391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:27.767223 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0a866-2ea2-4e5c-b4ac-0bb2d9208391 admin admin] PATH_INFO: `/v3/projects/d8aa3e9671194034adddaa6f853445b2` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:27.768452 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0a866-2ea2-4e5c-b4ac-0bb2d9208391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8aa3e9671194034adddaa6f853445b2)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:27.770382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0a866-2ea2-4e5c-b4ac-0bb2d9208391 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:27.854925 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-31783636-a3aa-4807-88ea-e5074e283564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5edd486741b4a1f99ba1c33f645bd56'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:27.855680 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-31783636-a3aa-4807-88ea-e5074e283564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5edd486741b4a1f99ba1c33f645bd56'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:27.866380 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:27.870659 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-31783636-a3aa-4807-88ea-e5074e283564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5edd486741b4a1f99ba1c33f645bd56'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:27.879192 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-31783636-a3aa-4807-88ea-e5074e283564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5edd486741b4a1f99ba1c33f645bd56'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:27.884235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-07f0a866-2ea2-4e5c-b4ac-0bb2d9208391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8aa3e9671194034adddaa6f853445b2', 'request_id': 'req-07f0a866-2ea2-4e5c-b4ac-0bb2d9208391'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:27.890029 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-07f0a866-2ea2-4e5c-b4ac-0bb2d9208391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8aa3e9671194034adddaa6f853445b2', 'request_id': 'req-07f0a866-2ea2-4e5c-b4ac-0bb2d9208391'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:27.896454 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-07f0a866-2ea2-4e5c-b4ac-0bb2d9208391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8aa3e9671194034adddaa6f853445b2', 'request_id': 'req-07f0a866-2ea2-4e5c-b4ac-0bb2d9208391'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:27.990708 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-31783636-a3aa-4807-88ea-e5074e283564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5edd486741b4a1f99ba1c33f645bd56'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:27.997061 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 936/1853] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:27 2022] DELETE /identity/v3/users/f5edd486741b4a1f99ba1c33f645bd56 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:28.002356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4f531-5ef2-42c6-98cb-2d2668bfd54c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:28.002963 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4f531-5ef2-42c6-98cb-2d2668bfd54c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:28.003242 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4f531-5ef2-42c6-98cb-2d2668bfd54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:28.022732 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1ba4f531-5ef2-42c6-98cb-2d2668bfd54c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:28.023959 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1ba4f531-5ef2-42c6-98cb-2d2668bfd54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:28.082506 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 937/1854] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:04:28.092118 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4f531-5ef2-42c6-98cb-2d2668bfd54c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:28.093515 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1ba4f531-5ef2-42c6-98cb-2d2668bfd54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:28.147625 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4f531-5ef2-42c6-98cb-2d2668bfd54c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:28.154463 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71aefb-ce30-44a5-b460-378637f0d5c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:28.155143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71aefb-ce30-44a5-b460-378637f0d5c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:28.162636 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71aefb-ce30-44a5-b460-378637f0d5c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:28.162636 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71aefb-ce30-44a5-b460-378637f0d5c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:28.162880 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-07f0a866-2ea2-4e5c-b4ac-0bb2d9208391 admin admin] The token cache is being invalidate because project d8aa3e9671194034adddaa6f853445b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:28.162880 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-07f0a866-2ea2-4e5c-b4ac-0bb2d9208391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:28.162880 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-07f0a866-2ea2-4e5c-b4ac-0bb2d9208391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:28.162880 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 918/1855] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:27 2022] DELETE /identity/v3/projects/d8aa3e9671194034adddaa6f853445b2 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:28.163979 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0a866-2ea2-4e5c-b4ac-0bb2d9208391 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:28.165356 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-07f0a866-2ea2-4e5c-b4ac-0bb2d9208391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:28.166145 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71aefb-ce30-44a5-b460-378637f0d5c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:28.167696 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71aefb-ce30-44a5-b460-378637f0d5c0 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:28.182020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 938/1856] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:04:28.245995 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0a866-2ea2-4e5c-b4ac-0bb2d9208391 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:28.252613 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee15659-27cd-48e9-bfd1-339ea76fc8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:28.253387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee15659-27cd-48e9-bfd1-339ea76fc8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:28.254071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee15659-27cd-48e9-bfd1-339ea76fc8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:28.254615 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee15659-27cd-48e9-bfd1-339ea76fc8f1 admin admin] PATH_INFO: `/v3/users/b635b94a5297457992ad3bde92db016c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:28.256590 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee15659-27cd-48e9-bfd1-339ea76fc8f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b635b94a5297457992ad3bde92db016c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:28.259126 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee15659-27cd-48e9-bfd1-339ea76fc8f1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:28.551137 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71aefb-ce30-44a5-b460-378637f0d5c0 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:28.552874 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3a71aefb-ce30-44a5-b460-378637f0d5c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:28.584351 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6ee15659-27cd-48e9-bfd1-339ea76fc8f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b635b94a5297457992ad3bde92db016c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:28.600770 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6ee15659-27cd-48e9-bfd1-339ea76fc8f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b635b94a5297457992ad3bde92db016c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:28.601715 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6ee15659-27cd-48e9-bfd1-339ea76fc8f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b635b94a5297457992ad3bde92db016c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:28.666492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71aefb-ce30-44a5-b460-378637f0d5c0 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:28.671475 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a04aa-30ce-476c-8861-e2f3c400386f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:28.672303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a04aa-30ce-476c-8861-e2f3c400386f service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:28.672725 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a04aa-30ce-476c-8861-e2f3c400386f service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:28.673099 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a04aa-30ce-476c-8861-e2f3c400386f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:28.675274 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8b8a04aa-30ce-476c-8861-e2f3c400386f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:28.736795 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a04aa-30ce-476c-8861-e2f3c400386f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:28.738265 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a04aa-30ce-476c-8861-e2f3c400386f service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:28.745141 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6ee15659-27cd-48e9-bfd1-339ea76fc8f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b635b94a5297457992ad3bde92db016c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:28.747510 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 939/1857] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:04:28.753792 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6ee15659-27cd-48e9-bfd1-339ea76fc8f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b635b94a5297457992ad3bde92db016c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:28.760137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 919/1858] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:28 2022] DELETE /identity/v3/users/b635b94a5297457992ad3bde92db016c => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:28.856729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a04aa-30ce-476c-8861-e2f3c400386f service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:28.858336 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8b8a04aa-30ce-476c-8861-e2f3c400386f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:28.886150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a04aa-30ce-476c-8861-e2f3c400386f service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:28.950558 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecb3a0-8b42-4f63-8e3a-26de100e9938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:28.951246 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecb3a0-8b42-4f63-8e3a-26de100e9938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:28.951522 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecb3a0-8b42-4f63-8e3a-26de100e9938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:28.951954 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecb3a0-8b42-4f63-8e3a-26de100e9938 admin admin] PATH_INFO: `/v3/projects/6ee6784c58a944f08f61df4156dd961b` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:28.954021 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecb3a0-8b42-4f63-8e3a-26de100e9938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ee6784c58a944f08f61df4156dd961b)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:28.955972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecb3a0-8b42-4f63-8e3a-26de100e9938 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:29.136349 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cbecb3a0-8b42-4f63-8e3a-26de100e9938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ee6784c58a944f08f61df4156dd961b', 'request_id': 'req-cbecb3a0-8b42-4f63-8e3a-26de100e9938'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:29.143931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cbecb3a0-8b42-4f63-8e3a-26de100e9938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ee6784c58a944f08f61df4156dd961b', 'request_id': 'req-cbecb3a0-8b42-4f63-8e3a-26de100e9938'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:29.251932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cbecb3a0-8b42-4f63-8e3a-26de100e9938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ee6784c58a944f08f61df4156dd961b', 'request_id': 'req-cbecb3a0-8b42-4f63-8e3a-26de100e9938'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:29.264084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cbecb3a0-8b42-4f63-8e3a-26de100e9938 admin admin] The token cache is being invalidate because project 6ee6784c58a944f08f61df4156dd961b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:29.264378 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cbecb3a0-8b42-4f63-8e3a-26de100e9938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:29.265893 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cbecb3a0-8b42-4f63-8e3a-26de100e9938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:29.267592 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 940/1859] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:28 2022] DELETE /identity/v3/projects/6ee6784c58a944f08f61df4156dd961b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:29.271682 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee15659-27cd-48e9-bfd1-339ea76fc8f1 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:29.273260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6ee15659-27cd-48e9-bfd1-339ea76fc8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:29.288031 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee15659-27cd-48e9-bfd1-339ea76fc8f1 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:29.346963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b0106-c165-4d86-8636-5ba80b2903c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:29.347601 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b0106-c165-4d86-8636-5ba80b2903c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:29.347885 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b0106-c165-4d86-8636-5ba80b2903c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:29.348166 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b0106-c165-4d86-8636-5ba80b2903c2 admin admin] PATH_INFO: `/v3/users/4ff3870777184bd8afe37260747e75e3` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:29.349309 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b0106-c165-4d86-8636-5ba80b2903c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ff3870777184bd8afe37260747e75e3)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:29.351323 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b0106-c165-4d86-8636-5ba80b2903c2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:29.413931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecb3a0-8b42-4f63-8e3a-26de100e9938 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:29.415406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-cbecb3a0-8b42-4f63-8e3a-26de100e9938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:29.429017 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecb3a0-8b42-4f63-8e3a-26de100e9938 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:29.445862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4145e7-add5-4b93-b2c4-76c44881517d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:29.446516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4145e7-add5-4b93-b2c4-76c44881517d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:29.446908 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4145e7-add5-4b93-b2c4-76c44881517d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:29.447101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4145e7-add5-4b93-b2c4-76c44881517d admin admin] PATH_INFO: `/v3/projects/b1fef7eb4f4e4730a482ab020e7c7042` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:29.448295 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4145e7-add5-4b93-b2c4-76c44881517d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1fef7eb4f4e4730a482ab020e7c7042)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:29.450247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4145e7-add5-4b93-b2c4-76c44881517d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:29.646098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1f4145e7-add5-4b93-b2c4-76c44881517d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1fef7eb4f4e4730a482ab020e7c7042', 'request_id': 'req-1f4145e7-add5-4b93-b2c4-76c44881517d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:29.649552 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-198b0106-c165-4d86-8636-5ba80b2903c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ff3870777184bd8afe37260747e75e3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:29.651715 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1f4145e7-add5-4b93-b2c4-76c44881517d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1fef7eb4f4e4730a482ab020e7c7042', 'request_id': 'req-1f4145e7-add5-4b93-b2c4-76c44881517d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:29.670389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-198b0106-c165-4d86-8636-5ba80b2903c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ff3870777184bd8afe37260747e75e3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:29.670389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-198b0106-c165-4d86-8636-5ba80b2903c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ff3870777184bd8afe37260747e75e3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:29.777610 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1f4145e7-add5-4b93-b2c4-76c44881517d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1fef7eb4f4e4730a482ab020e7c7042', 'request_id': 'req-1f4145e7-add5-4b93-b2c4-76c44881517d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:29.790390 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1f4145e7-add5-4b93-b2c4-76c44881517d admin admin] The token cache is being invalidate because project b1fef7eb4f4e4730a482ab020e7c7042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:29.790683 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1f4145e7-add5-4b93-b2c4-76c44881517d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:29.791341 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1f4145e7-add5-4b93-b2c4-76c44881517d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:29.792835 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 941/1860] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:29 2022] DELETE /identity/v3/projects/b1fef7eb4f4e4730a482ab020e7c7042 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:29.797814 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9ad0f-4905-4f2c-ae19-6bff43a24064 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:29.798101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9ad0f-4905-4f2c-ae19-6bff43a24064 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:29.798422 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9ad0f-4905-4f2c-ae19-6bff43a24064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:29.818337 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a3c9ad0f-4905-4f2c-ae19-6bff43a24064 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:29.819610 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a3c9ad0f-4905-4f2c-ae19-6bff43a24064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:29.877279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 942/1861] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:04:29.885029 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa579a6-58f1-47d3-848c-3e0ff922ae9e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:29.885329 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa579a6-58f1-47d3-848c-3e0ff922ae9e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:29.885608 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa579a6-58f1-47d3-848c-3e0ff922ae9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:29.904981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-eaa579a6-58f1-47d3-848c-3e0ff922ae9e None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:29.906525 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-eaa579a6-58f1-47d3-848c-3e0ff922ae9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:29.914278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 943/1862] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:04:29.918300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa579a6-58f1-47d3-848c-3e0ff922ae9e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:29.927477 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-198b0106-c165-4d86-8636-5ba80b2903c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ff3870777184bd8afe37260747e75e3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:29.928490 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa579a6-58f1-47d3-848c-3e0ff922ae9e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:29.930269 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-198b0106-c165-4d86-8636-5ba80b2903c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ff3870777184bd8afe37260747e75e3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:29.933395 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed67b47-93b8-4b5c-ad7a-5384095fca30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:29.933998 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed67b47-93b8-4b5c-ad7a-5384095fca30 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:29.934285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed67b47-93b8-4b5c-ad7a-5384095fca30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:29.934564 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed67b47-93b8-4b5c-ad7a-5384095fca30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:29.935295 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed67b47-93b8-4b5c-ad7a-5384095fca30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:04:29.935605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed67b47-93b8-4b5c-ad7a-5384095fca30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:29.937563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 920/1863] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:29 2022] DELETE /identity/v3/users/4ff3870777184bd8afe37260747e75e3 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:29.938169 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed67b47-93b8-4b5c-ad7a-5384095fca30 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:29.955705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 944/1864] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 11:04:29.959278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b0106-c165-4d86-8636-5ba80b2903c2 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:29.960911 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-198b0106-c165-4d86-8636-5ba80b2903c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:30.029014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b0106-c165-4d86-8636-5ba80b2903c2 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:30.035873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db5ce0-d273-4b9c-9689-a3d864853f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:30.036718 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db5ce0-d273-4b9c-9689-a3d864853f2b admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:30.037015 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db5ce0-d273-4b9c-9689-a3d864853f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:30.037279 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db5ce0-d273-4b9c-9689-a3d864853f2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:30.037909 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db5ce0-d273-4b9c-9689-a3d864853f2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:30.039961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db5ce0-d273-4b9c-9689-a3d864853f2b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:30.150681 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 921/1865] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:29 2022] POST /identity/v3/projects => generated 389 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:30.151810 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed67b47-93b8-4b5c-ad7a-5384095fca30 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:30.163422 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed67b47-93b8-4b5c-ad7a-5384095fca30 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:30.228640 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f3c43-ca8f-47d6-9455-1da541496458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:30.229163 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f3c43-ca8f-47d6-9455-1da541496458 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:30.229443 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f3c43-ca8f-47d6-9455-1da541496458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:30.229710 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f3c43-ca8f-47d6-9455-1da541496458 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:30.230337 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f3c43-ca8f-47d6-9455-1da541496458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:30.232455 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f3c43-ca8f-47d6-9455-1da541496458 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:30.362642 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:30.368520 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 945/1866] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:30 2022] POST /identity/v3/users => generated 295 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:30.372645 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db5ce0-d273-4b9c-9689-a3d864853f2b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:30.384105 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db5ce0-d273-4b9c-9689-a3d864853f2b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:30.388907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7c346-7f79-4727-8819-480ce2e70fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:30.389887 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7c346-7f79-4727-8819-480ce2e70fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:30.390330 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7c346-7f79-4727-8819-480ce2e70fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:30.390441 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7c346-7f79-4727-8819-480ce2e70fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:30.391047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7c346-7f79-4727-8819-480ce2e70fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:30.392640 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7c346-7f79-4727-8819-480ce2e70fb6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:30.403247 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 922/1867] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:30.407389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f3c43-ca8f-47d6-9455-1da541496458 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:30.417428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f3c43-ca8f-47d6-9455-1da541496458 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:30.422582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886425c4-623a-45f8-9da6-6281e3f80425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:30.423201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886425c4-623a-45f8-9da6-6281e3f80425 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:30.423572 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886425c4-623a-45f8-9da6-6281e3f80425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:30.423782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886425c4-623a-45f8-9da6-6281e3f80425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:30.424445 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886425c4-623a-45f8-9da6-6281e3f80425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:30.426009 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886425c4-623a-45f8-9da6-6281e3f80425 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:30.436227 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 946/1868] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:30.441244 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7c346-7f79-4727-8819-480ce2e70fb6 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:30.451558 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7c346-7f79-4727-8819-480ce2e70fb6 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:30.456696 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27befa-5f8b-46a5-a8c9-3f6ff73b2ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:30.458984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27befa-5f8b-46a5-a8c9-3f6ff73b2ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:30.458984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27befa-5f8b-46a5-a8c9-3f6ff73b2ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:30.458984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27befa-5f8b-46a5-a8c9-3f6ff73b2ab5 admin admin] PATH_INFO: `/v3/projects/4d4421ea49b4472d9ee04a3cedb08365/users/8d707607f087405db85f8b0e3cce97b2/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:30.473806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27befa-5f8b-46a5-a8c9-3f6ff73b2ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d4421ea49b4472d9ee04a3cedb08365, user_id=8d707607f087405db85f8b0e3cce97b2, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:30.476894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27befa-5f8b-46a5-a8c9-3f6ff73b2ab5 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:30.485493 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886425c4-623a-45f8-9da6-6281e3f80425 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:30.487720 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-886425c4-623a-45f8-9da6-6281e3f80425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:30.502176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886425c4-623a-45f8-9da6-6281e3f80425 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:30.507035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33687b-19bb-43ef-88e8-4636079b156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:30.507659 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33687b-19bb-43ef-88e8-4636079b156a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:30.507937 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33687b-19bb-43ef-88e8-4636079b156a admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:30.511602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33687b-19bb-43ef-88e8-4636079b156a admin admin] PATH_INFO: `/v3/projects/9eea33a21127474094e93aaf5530b306` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:30.511602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33687b-19bb-43ef-88e8-4636079b156a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eea33a21127474094e93aaf5530b306)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:30.511602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33687b-19bb-43ef-88e8-4636079b156a admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:30.579487 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 923/1869] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:30 2022] PUT /identity/v3/projects/4d4421ea49b4472d9ee04a3cedb08365/users/8d707607f087405db85f8b0e3cce97b2/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:30.600398 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab676a15-d09c-4913-a5f3-de397c573f16 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:30.601354 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab676a15-d09c-4913-a5f3-de397c573f16 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:30.601807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab676a15-d09c-4913-a5f3-de397c573f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:30.634289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ab676a15-d09c-4913-a5f3-de397c573f16 None None] MFA Rules not processed for user `8d707607f087405db85f8b0e3cce97b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:30.635646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ab676a15-d09c-4913-a5f3-de397c573f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:30.677460 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2f33687b-19bb-43ef-88e8-4636079b156a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eea33a21127474094e93aaf5530b306', 'request_id': 'req-2f33687b-19bb-43ef-88e8-4636079b156a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:30.692804 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2f33687b-19bb-43ef-88e8-4636079b156a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eea33a21127474094e93aaf5530b306', 'request_id': 'req-2f33687b-19bb-43ef-88e8-4636079b156a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:30.739227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 924/1870] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:30.744221 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab676a15-d09c-4913-a5f3-de397c573f16 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:30.773092 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2f33687b-19bb-43ef-88e8-4636079b156a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eea33a21127474094e93aaf5530b306', 'request_id': 'req-2f33687b-19bb-43ef-88e8-4636079b156a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:30.799907 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2f33687b-19bb-43ef-88e8-4636079b156a admin admin] The token cache is being invalidate because project 9eea33a21127474094e93aaf5530b306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:30.799907 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2f33687b-19bb-43ef-88e8-4636079b156a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:30.799907 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2f33687b-19bb-43ef-88e8-4636079b156a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:30.802348 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 947/1871] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:30 2022] DELETE /identity/v3/projects/9eea33a21127474094e93aaf5530b306 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:30.807726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0c600-3cd9-48b9-8e50-9c59c8323f59 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:30.808366 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0c600-3cd9-48b9-8e50-9c59c8323f59 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:30.808576 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0c600-3cd9-48b9-8e50-9c59c8323f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:30.824814 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab676a15-d09c-4913-a5f3-de397c573f16 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:30.855942 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-56a0c600-3cd9-48b9-8e50-9c59c8323f59 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:30.857178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-56a0c600-3cd9-48b9-8e50-9c59c8323f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:30.909250 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667e973-5f1f-4c75-bbb9-e39a03ab0229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:30.909963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667e973-5f1f-4c75-bbb9-e39a03ab0229 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:30.910316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667e973-5f1f-4c75-bbb9-e39a03ab0229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:30.910661 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667e973-5f1f-4c75-bbb9-e39a03ab0229 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:30.911391 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667e973-5f1f-4c75-bbb9-e39a03ab0229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:30.913443 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667e973-5f1f-4c75-bbb9-e39a03ab0229 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:30.957802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 948/1872] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:30.970275 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f7843-21bf-4d48-9d57-d1b6e7793d2c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:30.970275 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f7843-21bf-4d48-9d57-d1b6e7793d2c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:30.970275 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f7843-21bf-4d48-9d57-d1b6e7793d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:30.988131 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-039f7843-21bf-4d48-9d57-d1b6e7793d2c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:30.989357 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-039f7843-21bf-4d48-9d57-d1b6e7793d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:30.997928 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 949/1873] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:04:31.001969 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f7843-21bf-4d48-9d57-d1b6e7793d2c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:31.011130 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f7843-21bf-4d48-9d57-d1b6e7793d2c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:31.017282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff89be-aa19-467a-89f4-f12407666fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:31.017893 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff89be-aa19-467a-89f4-f12407666fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:31.018170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff89be-aa19-467a-89f4-f12407666fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:31.018440 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff89be-aa19-467a-89f4-f12407666fb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:31.019188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff89be-aa19-467a-89f4-f12407666fb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:04:31.022946 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff89be-aa19-467a-89f4-f12407666fb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:31.024610 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff89be-aa19-467a-89f4-f12407666fb3 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:31.037795 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 950/1874] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 11:04:31.042078 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff89be-aa19-467a-89f4-f12407666fb3 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:31.052162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff89be-aa19-467a-89f4-f12407666fb3 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:31.056899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0ba09-b1c8-4f26-bbdc-8e5356c764e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:31.057472 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0ba09-b1c8-4f26-bbdc-8e5356c764e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:31.057749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0ba09-b1c8-4f26-bbdc-8e5356c764e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:31.058018 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0ba09-b1c8-4f26-bbdc-8e5356c764e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:31.058629 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0ba09-b1c8-4f26-bbdc-8e5356c764e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:31.060878 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0ba09-b1c8-4f26-bbdc-8e5356c764e7 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:31.073792 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 925/1875] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:30 2022] POST /identity/v3/projects => generated 387 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:04:31.079403 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667e973-5f1f-4c75-bbb9-e39a03ab0229 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:31.081045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5667e973-5f1f-4c75-bbb9-e39a03ab0229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:31.147106 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667e973-5f1f-4c75-bbb9-e39a03ab0229 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:31.151744 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614360b-5d00-491c-95d3-1315df17e287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:31.152351 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614360b-5d00-491c-95d3-1315df17e287 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:31.152637 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614360b-5d00-491c-95d3-1315df17e287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:31.152912 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614360b-5d00-491c-95d3-1315df17e287 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:31.153532 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614360b-5d00-491c-95d3-1315df17e287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:31.155751 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614360b-5d00-491c-95d3-1315df17e287 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:31.217125 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 951/1876] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:31 2022] POST /identity/v3/projects => generated 357 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:04:31.217125 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0ba09-b1c8-4f26-bbdc-8e5356c764e7 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:31.282244 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0ba09-b1c8-4f26-bbdc-8e5356c764e7 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:31.287023 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcde86-dcb5-4585-8b4b-0baed292bdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:31.287656 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcde86-dcb5-4585-8b4b-0baed292bdad admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:31.287938 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcde86-dcb5-4585-8b4b-0baed292bdad admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:31.288216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcde86-dcb5-4585-8b4b-0baed292bdad admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:31.288837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcde86-dcb5-4585-8b4b-0baed292bdad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:31.290838 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcde86-dcb5-4585-8b4b-0baed292bdad admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:31.305474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 926/1877] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:31 2022] POST /identity/v3/users => generated 300 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:31.314711 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614360b-5d00-491c-95d3-1315df17e287 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:31.320223 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614360b-5d00-491c-95d3-1315df17e287 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:31.325027 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28dce5d-7523-4535-99f9-93c271c16dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:31.325689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dce5d-7523-4535-99f9-93c271c16dfb admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:31.326032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dce5d-7523-4535-99f9-93c271c16dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:31.326437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dce5d-7523-4535-99f9-93c271c16dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:31.327162 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dce5d-7523-4535-99f9-93c271c16dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:31.328906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dce5d-7523-4535-99f9-93c271c16dfb admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:31.339812 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 927/1878] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:04:31.345776 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28dce5d-7523-4535-99f9-93c271c16dfb admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:31.357160 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28dce5d-7523-4535-99f9-93c271c16dfb admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:31.363296 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590874ba-c6da-4f25-97a1-2af8d859ae77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:31.364007 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590874ba-c6da-4f25-97a1-2af8d859ae77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:31.364300 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590874ba-c6da-4f25-97a1-2af8d859ae77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:31.364865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590874ba-c6da-4f25-97a1-2af8d859ae77 admin admin] PATH_INFO: `/v3/projects/00b912baa8e44b24a616e2d24f359ad9/users/0118038b430147e8b7dca33fc1ae9170/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:31.383020 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590874ba-c6da-4f25-97a1-2af8d859ae77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b912baa8e44b24a616e2d24f359ad9, user_id=0118038b430147e8b7dca33fc1ae9170, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:31.385846 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590874ba-c6da-4f25-97a1-2af8d859ae77 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:31.488995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 952/1879] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:31 2022] POST /identity/v3/users => generated 279 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:04:31.492768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcde86-dcb5-4585-8b4b-0baed292bdad admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:31.503017 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcde86-dcb5-4585-8b4b-0baed292bdad admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:31.507618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643af9c4-61a4-44ea-bf65-d583e6a9869a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:31.508204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643af9c4-61a4-44ea-bf65-d583e6a9869a admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:31.508485 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643af9c4-61a4-44ea-bf65-d583e6a9869a admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:31.508759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643af9c4-61a4-44ea-bf65-d583e6a9869a admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:31.509435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643af9c4-61a4-44ea-bf65-d583e6a9869a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:31.511146 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643af9c4-61a4-44ea-bf65-d583e6a9869a admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:31.517698 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 928/1880] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:31 2022] PUT /identity/v3/projects/00b912baa8e44b24a616e2d24f359ad9/users/0118038b430147e8b7dca33fc1ae9170/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:31.521764 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590874ba-c6da-4f25-97a1-2af8d859ae77 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:31.525852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 953/1881] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:04:31.529859 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643af9c4-61a4-44ea-bf65-d583e6a9869a admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:31.539664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643af9c4-61a4-44ea-bf65-d583e6a9869a admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:31.585484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590874ba-c6da-4f25-97a1-2af8d859ae77 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:31.590303 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a9688-a840-4f43-b1ee-4f187f2b44c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:31.590943 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a9688-a840-4f43-b1ee-4f187f2b44c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:31.591225 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a9688-a840-4f43-b1ee-4f187f2b44c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:31.591501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a9688-a840-4f43-b1ee-4f187f2b44c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:31.592179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a9688-a840-4f43-b1ee-4f187f2b44c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:31.593980 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a9688-a840-4f43-b1ee-4f187f2b44c2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:31.594554 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940b04d-6698-4d78-b704-efa9b8b95d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:31.595221 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940b04d-6698-4d78-b704-efa9b8b95d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:31.595579 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940b04d-6698-4d78-b704-efa9b8b95d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:31.600578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940b04d-6698-4d78-b704-efa9b8b95d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:31.600578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940b04d-6698-4d78-b704-efa9b8b95d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:31.600578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940b04d-6698-4d78-b704-efa9b8b95d1e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:31.604120 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 929/1882] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:04:31.608050 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 954/1883] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:04:31.608777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a9688-a840-4f43-b1ee-4f187f2b44c2 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:31.612744 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940b04d-6698-4d78-b704-efa9b8b95d1e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:31.620874 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a9688-a840-4f43-b1ee-4f187f2b44c2 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:31.622147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940b04d-6698-4d78-b704-efa9b8b95d1e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:31.625741 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead5f7b-de65-4720-830f-203fe0033906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:31.629315 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead5f7b-de65-4720-830f-203fe0033906 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:31.629315 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead5f7b-de65-4720-830f-203fe0033906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:31.629504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a82aa-daa5-4f43-b935-58b594435d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:31.629617 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead5f7b-de65-4720-830f-203fe0033906 admin admin] PATH_INFO: `/v3/projects/00b912baa8e44b24a616e2d24f359ad9/users/0118038b430147e8b7dca33fc1ae9170/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:31.629691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a82aa-daa5-4f43-b935-58b594435d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:31.629691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a82aa-daa5-4f43-b935-58b594435d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:31.629691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a82aa-daa5-4f43-b935-58b594435d70 admin admin] PATH_INFO: `/v3/projects/037a698c77a64ed3998f44e83c174ac8/users/8f79a38178724e47b983b3717447570c/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:31.629952 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead5f7b-de65-4720-830f-203fe0033906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b912baa8e44b24a616e2d24f359ad9, user_id=0118038b430147e8b7dca33fc1ae9170, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:31.631683 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead5f7b-de65-4720-830f-203fe0033906 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:31.642706 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 930/1884] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:31 2022] PUT /identity/v3/projects/00b912baa8e44b24a616e2d24f359ad9/users/0118038b430147e8b7dca33fc1ae9170/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:31.643147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a82aa-daa5-4f43-b935-58b594435d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=037a698c77a64ed3998f44e83c174ac8, user_id=8f79a38178724e47b983b3717447570c, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:31.646085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a82aa-daa5-4f43-b935-58b594435d70 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:31.652932 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e458e8-6d05-41fa-8b1b-88f1a54c110d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:31.653251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e458e8-6d05-41fa-8b1b-88f1a54c110d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:31.657969 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e458e8-6d05-41fa-8b1b-88f1a54c110d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:31.682012 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-33e458e8-6d05-41fa-8b1b-88f1a54c110d None None] MFA Rules not processed for user `0118038b430147e8b7dca33fc1ae9170`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:31.683289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-33e458e8-6d05-41fa-8b1b-88f1a54c110d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:31.752010 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 931/1885] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:04:31.761996 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 955/1886] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:31 2022] PUT /identity/v3/projects/037a698c77a64ed3998f44e83c174ac8/users/8f79a38178724e47b983b3717447570c/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:31.763150 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e458e8-6d05-41fa-8b1b-88f1a54c110d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:31.769680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-33e458e8-6d05-41fa-8b1b-88f1a54c110d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:31.779954 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8206a-9e28-4e69-aaf5-82e59b27bf1f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:31.780275 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8206a-9e28-4e69-aaf5-82e59b27bf1f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:31.780576 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8206a-9e28-4e69-aaf5-82e59b27bf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:31.809194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-83d8206a-9e28-4e69-aaf5-82e59b27bf1f None None] MFA Rules not processed for user `8f79a38178724e47b983b3717447570c`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:31.810377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-83d8206a-9e28-4e69-aaf5-82e59b27bf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:31.823883 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e458e8-6d05-41fa-8b1b-88f1a54c110d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:31.871937 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb9859-a6be-460f-b272-88176c5b4e93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:31.872926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb9859-a6be-460f-b272-88176c5b4e93 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:31.873224 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb9859-a6be-460f-b272-88176c5b4e93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:31.873510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb9859-a6be-460f-b272-88176c5b4e93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:31.876784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 956/1887] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:04:31.881152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8206a-9e28-4e69-aaf5-82e59b27bf1f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:31.953976 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb9859-a6be-460f-b272-88176c5b4e93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:31.955606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb9859-a6be-460f-b272-88176c5b4e93 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:31.956749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8206a-9e28-4e69-aaf5-82e59b27bf1f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:31.963305 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fdd3f-491e-41c7-b43c-990024ac1cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:31.964147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fdd3f-491e-41c7-b43c-990024ac1cdb admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:31.964648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fdd3f-491e-41c7-b43c-990024ac1cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:31.964994 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fdd3f-491e-41c7-b43c-990024ac1cdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:31.966051 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fdd3f-491e-41c7-b43c-990024ac1cdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:31.966908 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 932/1888] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:31.967631 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14fdd3f-491e-41c7-b43c-990024ac1cdb admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:32.088244 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:32.126742 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb9859-a6be-460f-b272-88176c5b4e93 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:32.140299 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb9859-a6be-460f-b272-88176c5b4e93 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:32.142065 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 957/1889] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:31 2022] POST /identity/v3/projects => generated 357 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:04:32.143719 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791bf2a-679a-4a27-b0ae-55460f4530ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:32.144381 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791bf2a-679a-4a27-b0ae-55460f4530ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:32.144665 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791bf2a-679a-4a27-b0ae-55460f4530ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:32.144969 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791bf2a-679a-4a27-b0ae-55460f4530ee admin admin] PATH_INFO: `/v3/users/8d707607f087405db85f8b0e3cce97b2` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:32.145886 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fdd3f-491e-41c7-b43c-990024ac1cdb admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:32.146112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791bf2a-679a-4a27-b0ae-55460f4530ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d707607f087405db85f8b0e3cce97b2)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:32.148092 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791bf2a-679a-4a27-b0ae-55460f4530ee admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:32.218684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fdd3f-491e-41c7-b43c-990024ac1cdb admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:32.223770 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98169f-8db2-4b5a-a789-0d40613c2fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:32.224726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98169f-8db2-4b5a-a789-0d40613c2fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:32.224726 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98169f-8db2-4b5a-a789-0d40613c2fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:32.224983 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98169f-8db2-4b5a-a789-0d40613c2fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:32.225633 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98169f-8db2-4b5a-a789-0d40613c2fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:32.227588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98169f-8db2-4b5a-a789-0d40613c2fe1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:32.368747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 958/1890] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:32 2022] POST /identity/v3/users => generated 285 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:32.393160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98169f-8db2-4b5a-a789-0d40613c2fe1 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:32.403388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98169f-8db2-4b5a-a789-0d40613c2fe1 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:32.408805 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf494fcc-c9ed-4040-ba9a-ef7b67983db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:32.409427 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf494fcc-c9ed-4040-ba9a-ef7b67983db6 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:32.409836 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf494fcc-c9ed-4040-ba9a-ef7b67983db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:32.410119 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf494fcc-c9ed-4040-ba9a-ef7b67983db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:32.410787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf494fcc-c9ed-4040-ba9a-ef7b67983db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:32.412400 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf494fcc-c9ed-4040-ba9a-ef7b67983db6 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:32.422906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 959/1891] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:04:32.427008 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf494fcc-c9ed-4040-ba9a-ef7b67983db6 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:32.436738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf494fcc-c9ed-4040-ba9a-ef7b67983db6 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:32.441906 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925ab85-4854-4d7f-ad30-f4830f26177b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:32.442564 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925ab85-4854-4d7f-ad30-f4830f26177b admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:32.442967 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925ab85-4854-4d7f-ad30-f4830f26177b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:32.443147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925ab85-4854-4d7f-ad30-f4830f26177b admin admin] PATH_INFO: `/v3/projects/0bf89e55a40340aab92fd51d78314660/users/3f4748b1a14f4daca42bbc270399a2ef/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:32.455260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f791bf2a-679a-4a27-b0ae-55460f4530ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d707607f087405db85f8b0e3cce97b2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:32.460004 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:32.461690 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925ab85-4854-4d7f-ad30-f4830f26177b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf89e55a40340aab92fd51d78314660, user_id=3f4748b1a14f4daca42bbc270399a2ef, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:32.463360 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925ab85-4854-4d7f-ad30-f4830f26177b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:32.476318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f791bf2a-679a-4a27-b0ae-55460f4530ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d707607f087405db85f8b0e3cce97b2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:32.481542 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f791bf2a-679a-4a27-b0ae-55460f4530ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d707607f087405db85f8b0e3cce97b2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:32.541369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 960/1892] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:32 2022] PUT /identity/v3/projects/0bf89e55a40340aab92fd51d78314660/users/3f4748b1a14f4daca42bbc270399a2ef/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:32.549592 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925ab85-4854-4d7f-ad30-f4830f26177b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:32.601450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f791bf2a-679a-4a27-b0ae-55460f4530ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d707607f087405db85f8b0e3cce97b2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:32.609678 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f791bf2a-679a-4a27-b0ae-55460f4530ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d707607f087405db85f8b0e3cce97b2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:32.629651 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 933/1893] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:32 2022] DELETE /identity/v3/users/8d707607f087405db85f8b0e3cce97b2 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:32.631056 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c0036-1336-4b40-bf72-73ae1baafa60 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:32.631345 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c0036-1336-4b40-bf72-73ae1baafa60 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:32.631623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c0036-1336-4b40-bf72-73ae1baafa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:32.632037 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925ab85-4854-4d7f-ad30-f4830f26177b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:32.654239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-648c0036-1336-4b40-bf72-73ae1baafa60 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:32.656151 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-648c0036-1336-4b40-bf72-73ae1baafa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:32.697345 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be9d03-15ea-4b8a-8eea-45dfe89c8f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:32.697950 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be9d03-15ea-4b8a-8eea-45dfe89c8f8e admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:32.698228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be9d03-15ea-4b8a-8eea-45dfe89c8f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:32.698536 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be9d03-15ea-4b8a-8eea-45dfe89c8f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:32.699179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be9d03-15ea-4b8a-8eea-45dfe89c8f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:32.700754 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be9d03-15ea-4b8a-8eea-45dfe89c8f8e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:32.714289 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 961/1894] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:32.715305 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be9d03-15ea-4b8a-8eea-45dfe89c8f8e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:32.716887 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f8be9d03-15ea-4b8a-8eea-45dfe89c8f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:32.718999 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 934/1895] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:32.729831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c0036-1336-4b40-bf72-73ae1baafa60 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:32.731221 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-648c0036-1336-4b40-bf72-73ae1baafa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:32.734905 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be9d03-15ea-4b8a-8eea-45dfe89c8f8e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:32.741145 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d243a8-d202-4fee-bc81-86e217a9f7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:32.741821 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d243a8-d202-4fee-bc81-86e217a9f7d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:32.742115 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d243a8-d202-4fee-bc81-86e217a9f7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:32.742361 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d243a8-d202-4fee-bc81-86e217a9f7d6 admin admin] PATH_INFO: `/v3/projects/0bf89e55a40340aab92fd51d78314660/users/3f4748b1a14f4daca42bbc270399a2ef/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:32.744329 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d243a8-d202-4fee-bc81-86e217a9f7d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf89e55a40340aab92fd51d78314660, user_id=3f4748b1a14f4daca42bbc270399a2ef, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:32.747018 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d243a8-d202-4fee-bc81-86e217a9f7d6 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:32.758379 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 962/1896] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:32 2022] PUT /identity/v3/projects/0bf89e55a40340aab92fd51d78314660/users/3f4748b1a14f4daca42bbc270399a2ef/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:32.770167 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bd505-3eeb-451f-9684-031428ffb881 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:32.770459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bd505-3eeb-451f-9684-031428ffb881 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:32.770741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bd505-3eeb-451f-9684-031428ffb881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:32.780351 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:32.790907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c0036-1336-4b40-bf72-73ae1baafa60 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:32.800931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3f7bd505-3eeb-451f-9684-031428ffb881 None None] MFA Rules not processed for user `3f4748b1a14f4daca42bbc270399a2ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:32.802180 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3f7bd505-3eeb-451f-9684-031428ffb881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:32.841196 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9114b67-ff25-41f9-9973-f6db5354cd8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:32.841901 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9114b67-ff25-41f9-9973-f6db5354cd8f service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:32.842189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9114b67-ff25-41f9-9973-f6db5354cd8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:32.842465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9114b67-ff25-41f9-9973-f6db5354cd8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:32.876783 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 963/1897] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:32 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:32.913970 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bd505-3eeb-451f-9684-031428ffb881 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:32.915713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3f7bd505-3eeb-451f-9684-031428ffb881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:32.926104 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9114b67-ff25-41f9-9973-f6db5354cd8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:32.927539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9114b67-ff25-41f9-9973-f6db5354cd8f service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:32.937815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 935/1898] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:32.977159 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bd505-3eeb-451f-9684-031428ffb881 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:32.981446 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26837175-ddbd-45e9-b262-3713b41f402a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:32.982069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26837175-ddbd-45e9-b262-3713b41f402a service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:32.982356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26837175-ddbd-45e9-b262-3713b41f402a service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:32.982635 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26837175-ddbd-45e9-b262-3713b41f402a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:32.992978 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26837175-ddbd-45e9-b262-3713b41f402a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:32.994427 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26837175-ddbd-45e9-b262-3713b41f402a service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:33.005898 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 964/1899] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:32 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:04:33.569155 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9114b67-ff25-41f9-9973-f6db5354cd8f service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:33.570745 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f9114b67-ff25-41f9-9973-f6db5354cd8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:33.584735 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9114b67-ff25-41f9-9973-f6db5354cd8f service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:33.591338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9850ff-5870-4fcd-8923-14e64d8b4313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:33.591338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9850ff-5870-4fcd-8923-14e64d8b4313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:33.591645 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9850ff-5870-4fcd-8923-14e64d8b4313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:33.591960 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9850ff-5870-4fcd-8923-14e64d8b4313 admin admin] PATH_INFO: `/v3/projects/4d4421ea49b4472d9ee04a3cedb08365` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:33.593778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9850ff-5870-4fcd-8923-14e64d8b4313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d4421ea49b4472d9ee04a3cedb08365)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:33.595747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9850ff-5870-4fcd-8923-14e64d8b4313 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:33.788097 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-be9850ff-5870-4fcd-8923-14e64d8b4313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d4421ea49b4472d9ee04a3cedb08365', 'request_id': 'req-be9850ff-5870-4fcd-8923-14e64d8b4313'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:33.793842 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-be9850ff-5870-4fcd-8923-14e64d8b4313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d4421ea49b4472d9ee04a3cedb08365', 'request_id': 'req-be9850ff-5870-4fcd-8923-14e64d8b4313'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:33.802142 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-be9850ff-5870-4fcd-8923-14e64d8b4313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d4421ea49b4472d9ee04a3cedb08365', 'request_id': 'req-be9850ff-5870-4fcd-8923-14e64d8b4313'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:33.815629 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26837175-ddbd-45e9-b262-3713b41f402a service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:33.824960 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26837175-ddbd-45e9-b262-3713b41f402a service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:33.878670 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeffb3-8911-4c16-aa70-49ffa2e93217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:33.879402 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeffb3-8911-4c16-aa70-49ffa2e93217 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:33.879884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeffb3-8911-4c16-aa70-49ffa2e93217 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:33.880164 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeffb3-8911-4c16-aa70-49ffa2e93217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:33.882020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-caaeffb3-8911-4c16-aa70-49ffa2e93217 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:33.934704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-be9850ff-5870-4fcd-8923-14e64d8b4313 admin admin] The token cache is being invalidate because project 4d4421ea49b4472d9ee04a3cedb08365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:33.935093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-be9850ff-5870-4fcd-8923-14e64d8b4313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:33.936400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-be9850ff-5870-4fcd-8923-14e64d8b4313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:33.941626 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 936/1900] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:33 2022] DELETE /identity/v3/projects/4d4421ea49b4472d9ee04a3cedb08365 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:33.943237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9850ff-5870-4fcd-8923-14e64d8b4313 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:33.945813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-be9850ff-5870-4fcd-8923-14e64d8b4313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:33.946288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeffb3-8911-4c16-aa70-49ffa2e93217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:33.948060 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeffb3-8911-4c16-aa70-49ffa2e93217 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:33.959139 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 965/1901] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:33 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:04:34.024034 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:34.048350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9850ff-5870-4fcd-8923-14e64d8b4313 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:34.053460 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a3a03-a066-498c-b8a5-affc90716e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:34.054234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a3a03-a066-498c-b8a5-affc90716e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:34.054517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a3a03-a066-498c-b8a5-affc90716e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:34.054817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a3a03-a066-498c-b8a5-affc90716e64 admin admin] PATH_INFO: `/v3/users/0118038b430147e8b7dca33fc1ae9170` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:34.055987 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a3a03-a066-498c-b8a5-affc90716e64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0118038b430147e8b7dca33fc1ae9170)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:34.057977 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a3a03-a066-498c-b8a5-affc90716e64 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:34.239000 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeffb3-8911-4c16-aa70-49ffa2e93217 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:34.240512 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-caaeffb3-8911-4c16-aa70-49ffa2e93217 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:34.254591 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeffb3-8911-4c16-aa70-49ffa2e93217 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:34.259129 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6021262-591d-4982-bef5-2b72660f54f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:34.259757 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6021262-591d-4982-bef5-2b72660f54f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:34.260035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6021262-591d-4982-bef5-2b72660f54f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:34.260306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6021262-591d-4982-bef5-2b72660f54f9 admin admin] PATH_INFO: `/v3/users/50c9b38471c94fa09fc7587cff7600e5` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:34.261433 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6021262-591d-4982-bef5-2b72660f54f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c9b38471c94fa09fc7587cff7600e5)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:34.263414 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6021262-591d-4982-bef5-2b72660f54f9 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:34.338341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5a0a3a03-a066-498c-b8a5-affc90716e64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0118038b430147e8b7dca33fc1ae9170'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:34.351151 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5a0a3a03-a066-498c-b8a5-affc90716e64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0118038b430147e8b7dca33fc1ae9170'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:34.351878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5a0a3a03-a066-498c-b8a5-affc90716e64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0118038b430147e8b7dca33fc1ae9170'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:34.441260 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:34.467462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5a0a3a03-a066-498c-b8a5-affc90716e64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0118038b430147e8b7dca33fc1ae9170'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:34.475563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5a0a3a03-a066-498c-b8a5-affc90716e64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0118038b430147e8b7dca33fc1ae9170'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:34.487858 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f6021262-591d-4982-bef5-2b72660f54f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c9b38471c94fa09fc7587cff7600e5'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:34.488054 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 937/1902] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:33 2022] DELETE /identity/v3/users/0118038b430147e8b7dca33fc1ae9170 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:34.488917 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a3a03-a066-498c-b8a5-affc90716e64 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:34.491213 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5a0a3a03-a066-498c-b8a5-affc90716e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:34.492349 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f6021262-591d-4982-bef5-2b72660f54f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c9b38471c94fa09fc7587cff7600e5'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:34.510548 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f6021262-591d-4982-bef5-2b72660f54f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c9b38471c94fa09fc7587cff7600e5'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:34.517920 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f6021262-591d-4982-bef5-2b72660f54f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c9b38471c94fa09fc7587cff7600e5'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:34.576455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a3a03-a066-498c-b8a5-affc90716e64 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:34.582168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b05f5-9d3e-4c89-8ced-8e3d298801bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:34.582848 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b05f5-9d3e-4c89-8ced-8e3d298801bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:34.583132 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b05f5-9d3e-4c89-8ced-8e3d298801bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:34.583404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b05f5-9d3e-4c89-8ced-8e3d298801bb admin admin] PATH_INFO: `/v3/users/0c56e71ba7034ce2b6069166e4a522bf` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:34.584543 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b05f5-9d3e-4c89-8ced-8e3d298801bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c56e71ba7034ce2b6069166e4a522bf)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:34.586541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b05f5-9d3e-4c89-8ced-8e3d298801bb admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:34.590984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f6021262-591d-4982-bef5-2b72660f54f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c9b38471c94fa09fc7587cff7600e5'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:34.599103 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 966/1903] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:34 2022] DELETE /identity/v3/users/50c9b38471c94fa09fc7587cff7600e5 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:34.603226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b844ed-5086-4cb3-9709-96417a239d03 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:34.603515 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b844ed-5086-4cb3-9709-96417a239d03 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:34.604075 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b844ed-5086-4cb3-9709-96417a239d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:34.635654 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-94b844ed-5086-4cb3-9709-96417a239d03 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:34.636957 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-94b844ed-5086-4cb3-9709-96417a239d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:34.713518 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 967/1904] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:04:34.721428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b844ed-5086-4cb3-9709-96417a239d03 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:34.722901 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-94b844ed-5086-4cb3-9709-96417a239d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:34.778449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-214b05f5-9d3e-4c89-8ced-8e3d298801bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c56e71ba7034ce2b6069166e4a522bf'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:34.797298 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-214b05f5-9d3e-4c89-8ced-8e3d298801bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c56e71ba7034ce2b6069166e4a522bf'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:34.798227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-214b05f5-9d3e-4c89-8ced-8e3d298801bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c56e71ba7034ce2b6069166e4a522bf'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:34.805265 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b844ed-5086-4cb3-9709-96417a239d03 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:34.811171 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80358941-4081-48bc-9698-b9be32d46925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:34.812229 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80358941-4081-48bc-9698-b9be32d46925 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:34.812956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80358941-4081-48bc-9698-b9be32d46925 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:34.813235 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80358941-4081-48bc-9698-b9be32d46925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:34.825920 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80358941-4081-48bc-9698-b9be32d46925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:34.828175 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80358941-4081-48bc-9698-b9be32d46925 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:34.838373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 968/1905] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:34.853410 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-214b05f5-9d3e-4c89-8ced-8e3d298801bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c56e71ba7034ce2b6069166e4a522bf'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:34.862222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-214b05f5-9d3e-4c89-8ced-8e3d298801bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c56e71ba7034ce2b6069166e4a522bf'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:34.869051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 938/1906] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:34 2022] DELETE /identity/v3/users/0c56e71ba7034ce2b6069166e4a522bf => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:34.873790 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a93f7-9501-44e4-aac0-5aab7b7a68ae None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:34.874094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a93f7-9501-44e4-aac0-5aab7b7a68ae None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:34.874358 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a93f7-9501-44e4-aac0-5aab7b7a68ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:34.897816 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-178a93f7-9501-44e4-aac0-5aab7b7a68ae None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:34.899399 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-178a93f7-9501-44e4-aac0-5aab7b7a68ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:34.970083 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 969/1907] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:34.985279 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b05f5-9d3e-4c89-8ced-8e3d298801bb admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:34.987128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-214b05f5-9d3e-4c89-8ced-8e3d298801bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:35.054224 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b05f5-9d3e-4c89-8ced-8e3d298801bb admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:35.057787 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027509e-8aff-4cb0-a625-bd167ff875c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:35.058492 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027509e-8aff-4cb0-a625-bd167ff875c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:35.058655 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027509e-8aff-4cb0-a625-bd167ff875c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:35.058963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027509e-8aff-4cb0-a625-bd167ff875c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:35.068042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027509e-8aff-4cb0-a625-bd167ff875c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:35.069567 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027509e-8aff-4cb0-a625-bd167ff875c4 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:35.080859 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 939/1908] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:35.196063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a93f7-9501-44e4-aac0-5aab7b7a68ae None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:35.196063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-178a93f7-9501-44e4-aac0-5aab7b7a68ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:35.208674 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a93f7-9501-44e4-aac0-5aab7b7a68ae None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:35.213661 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a8351-5f4a-46df-9cda-0f9c2c932d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:35.214301 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a8351-5f4a-46df-9cda-0f9c2c932d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:35.214588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a8351-5f4a-46df-9cda-0f9c2c932d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:35.214899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a8351-5f4a-46df-9cda-0f9c2c932d48 admin admin] PATH_INFO: `/v3/projects/00b912baa8e44b24a616e2d24f359ad9` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:35.216035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a8351-5f4a-46df-9cda-0f9c2c932d48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00b912baa8e44b24a616e2d24f359ad9)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:35.218521 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a8351-5f4a-46df-9cda-0f9c2c932d48 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:35.433339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-192a8351-5f4a-46df-9cda-0f9c2c932d48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00b912baa8e44b24a616e2d24f359ad9', 'request_id': 'req-192a8351-5f4a-46df-9cda-0f9c2c932d48'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:35.436024 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-192a8351-5f4a-46df-9cda-0f9c2c932d48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00b912baa8e44b24a616e2d24f359ad9', 'request_id': 'req-192a8351-5f4a-46df-9cda-0f9c2c932d48'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:35.460468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027509e-8aff-4cb0-a625-bd167ff875c4 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:35.463709 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6027509e-8aff-4cb0-a625-bd167ff875c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:35.488386 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027509e-8aff-4cb0-a625-bd167ff875c4 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:35.516812 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-192a8351-5f4a-46df-9cda-0f9c2c932d48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00b912baa8e44b24a616e2d24f359ad9', 'request_id': 'req-192a8351-5f4a-46df-9cda-0f9c2c932d48'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:35.532116 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-192a8351-5f4a-46df-9cda-0f9c2c932d48 admin admin] The token cache is being invalidate because project 00b912baa8e44b24a616e2d24f359ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:35.532556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-192a8351-5f4a-46df-9cda-0f9c2c932d48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:35.533278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-192a8351-5f4a-46df-9cda-0f9c2c932d48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:35.535190 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 970/1909] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:35 2022] DELETE /identity/v3/projects/00b912baa8e44b24a616e2d24f359ad9 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:35.540490 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f835d66-001c-41a4-9cc6-4005a40bd893 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:35.540775 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f835d66-001c-41a4-9cc6-4005a40bd893 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:35.541040 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f835d66-001c-41a4-9cc6-4005a40bd893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:35.561188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-2f835d66-001c-41a4-9cc6-4005a40bd893 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:35.562457 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2f835d66-001c-41a4-9cc6-4005a40bd893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:35.599233 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d1a6d-33af-4443-800e-d8c8d085d103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:35.600129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d1a6d-33af-4443-800e-d8c8d085d103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:35.600479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d1a6d-33af-4443-800e-d8c8d085d103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:35.600944 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d1a6d-33af-4443-800e-d8c8d085d103 admin admin] PATH_INFO: `/v3/projects/d09fdc1517b34b80b40b44e531770ca8` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:35.602316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d1a6d-33af-4443-800e-d8c8d085d103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09fdc1517b34b80b40b44e531770ca8)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:35.605888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d1a6d-33af-4443-800e-d8c8d085d103 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:35.654391 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 971/1910] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:04:35.662011 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb7a7a-abf9-41f7-9df4-2c30a07af4dd None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:35.662393 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb7a7a-abf9-41f7-9df4-2c30a07af4dd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:35.662743 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb7a7a-abf9-41f7-9df4-2c30a07af4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:35.684054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-13bb7a7a-abf9-41f7-9df4-2c30a07af4dd None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:35.685401 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-13bb7a7a-abf9-41f7-9df4-2c30a07af4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:35.700312 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 972/1911] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:04:35.705227 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb7a7a-abf9-41f7-9df4-2c30a07af4dd None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:35.717438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:35.730099 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb7a7a-abf9-41f7-9df4-2c30a07af4dd None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:35.745847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1f4d1a6d-33af-4443-800e-d8c8d085d103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09fdc1517b34b80b40b44e531770ca8', 'request_id': 'req-1f4d1a6d-33af-4443-800e-d8c8d085d103'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:35.755316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1f4d1a6d-33af-4443-800e-d8c8d085d103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09fdc1517b34b80b40b44e531770ca8', 'request_id': 'req-1f4d1a6d-33af-4443-800e-d8c8d085d103'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:35.762197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1f4d1a6d-33af-4443-800e-d8c8d085d103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09fdc1517b34b80b40b44e531770ca8', 'request_id': 'req-1f4d1a6d-33af-4443-800e-d8c8d085d103'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:35.811993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff0cc5-2f3d-4320-ad72-c82d773fb31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:35.812631 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff0cc5-2f3d-4320-ad72-c82d773fb31b admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:35.812910 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff0cc5-2f3d-4320-ad72-c82d773fb31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:35.813182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff0cc5-2f3d-4320-ad72-c82d773fb31b admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:35.813838 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff0cc5-2f3d-4320-ad72-c82d773fb31b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:04:35.814138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff0cc5-2f3d-4320-ad72-c82d773fb31b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:35.815772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff0cc5-2f3d-4320-ad72-c82d773fb31b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:35.828570 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 973/1912] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 11:04:35.829807 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff0cc5-2f3d-4320-ad72-c82d773fb31b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:35.831671 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-79ff0cc5-2f3d-4320-ad72-c82d773fb31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:35.846226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff0cc5-2f3d-4320-ad72-c82d773fb31b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:35.851433 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608a58d-a552-421a-a332-8bbee7a890fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:35.852079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608a58d-a552-421a-a332-8bbee7a890fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:35.852403 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608a58d-a552-421a-a332-8bbee7a890fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:35.852672 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608a58d-a552-421a-a332-8bbee7a890fa admin admin] PATH_INFO: `/v3/projects/52470354b5bc4625ab52003d9b7538a1` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:35.854332 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608a58d-a552-421a-a332-8bbee7a890fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=52470354b5bc4625ab52003d9b7538a1)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:35.856282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608a58d-a552-421a-a332-8bbee7a890fa admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:35.867047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1f4d1a6d-33af-4443-800e-d8c8d085d103 admin admin] The token cache is being invalidate because project d09fdc1517b34b80b40b44e531770ca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:35.868261 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1f4d1a6d-33af-4443-800e-d8c8d085d103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:35.869172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1f4d1a6d-33af-4443-800e-d8c8d085d103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:35.872089 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 940/1913] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:35 2022] DELETE /identity/v3/projects/d09fdc1517b34b80b40b44e531770ca8 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:35.874956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d1a6d-33af-4443-800e-d8c8d085d103 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:35.877362 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1f4d1a6d-33af-4443-800e-d8c8d085d103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:35.910075 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d1a6d-33af-4443-800e-d8c8d085d103 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:35.918892 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab76fd6-ee46-4ac0-9e5a-930ac405cbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:35.927701 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab76fd6-ee46-4ac0-9e5a-930ac405cbd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:35.928216 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab76fd6-ee46-4ac0-9e5a-930ac405cbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:35.928570 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab76fd6-ee46-4ac0-9e5a-930ac405cbd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:35.929370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab76fd6-ee46-4ac0-9e5a-930ac405cbd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:35.931918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab76fd6-ee46-4ac0-9e5a-930ac405cbd0 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:36.007933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:36.040533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2608a58d-a552-421a-a332-8bbee7a890fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52470354b5bc4625ab52003d9b7538a1', 'request_id': 'req-2608a58d-a552-421a-a332-8bbee7a890fa'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:36.056092 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2608a58d-a552-421a-a332-8bbee7a890fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52470354b5bc4625ab52003d9b7538a1', 'request_id': 'req-2608a58d-a552-421a-a332-8bbee7a890fa'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:36.153327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2608a58d-a552-421a-a332-8bbee7a890fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52470354b5bc4625ab52003d9b7538a1', 'request_id': 'req-2608a58d-a552-421a-a332-8bbee7a890fa'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:36.161319 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 941/1914] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:35 2022] POST /identity/v3/projects => generated 367 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:36.165408 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab76fd6-ee46-4ac0-9e5a-930ac405cbd0 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:36.167105 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-eab76fd6-ee46-4ac0-9e5a-930ac405cbd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:36.168811 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2608a58d-a552-421a-a332-8bbee7a890fa admin admin] The token cache is being invalidate because project 52470354b5bc4625ab52003d9b7538a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:36.169296 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2608a58d-a552-421a-a332-8bbee7a890fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:36.169964 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2608a58d-a552-421a-a332-8bbee7a890fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:36.172542 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 974/1915] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:35 2022] DELETE /identity/v3/projects/52470354b5bc4625ab52003d9b7538a1 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:36.173363 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608a58d-a552-421a-a332-8bbee7a890fa admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:36.176547 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2608a58d-a552-421a-a332-8bbee7a890fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:36.246554 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab76fd6-ee46-4ac0-9e5a-930ac405cbd0 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:36.252218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0a706-00e5-4ae6-ad4f-d8d98f73fe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:36.253418 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0a706-00e5-4ae6-ad4f-d8d98f73fe49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:36.253702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0a706-00e5-4ae6-ad4f-d8d98f73fe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:36.254529 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0a706-00e5-4ae6-ad4f-d8d98f73fe49 admin admin] PATH_INFO: `/v3/users/f96b207edddd4d8b8c4b2fc297efc4c1` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:36.255786 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0a706-00e5-4ae6-ad4f-d8d98f73fe49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f96b207edddd4d8b8c4b2fc297efc4c1)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:36.257957 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0a706-00e5-4ae6-ad4f-d8d98f73fe49 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:36.267511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608a58d-a552-421a-a332-8bbee7a890fa admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:36.272910 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53b9dc-287b-40d6-b9c5-a90a97ed3f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:36.273523 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53b9dc-287b-40d6-b9c5-a90a97ed3f89 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:36.273804 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53b9dc-287b-40d6-b9c5-a90a97ed3f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:36.274079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53b9dc-287b-40d6-b9c5-a90a97ed3f89 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:36.274748 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53b9dc-287b-40d6-b9c5-a90a97ed3f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:36.276797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53b9dc-287b-40d6-b9c5-a90a97ed3f89 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:36.414887 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 975/1916] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:36 2022] POST /identity/v3/users => generated 284 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:36.415759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53b9dc-287b-40d6-b9c5-a90a97ed3f89 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:36.419173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4c53b9dc-287b-40d6-b9c5-a90a97ed3f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:36.431682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53b9dc-287b-40d6-b9c5-a90a97ed3f89 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:36.437243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a959a-e4a9-43f0-8dcd-6a70ff2af4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:36.438651 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a959a-e4a9-43f0-8dcd-6a70ff2af4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:36.438651 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a959a-e4a9-43f0-8dcd-6a70ff2af4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:36.438651 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a959a-e4a9-43f0-8dcd-6a70ff2af4f9 admin admin] PATH_INFO: `/v3/users/d470210029a0484ba30b7b1242d04c40` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:36.439535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a959a-e4a9-43f0-8dcd-6a70ff2af4f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d470210029a0484ba30b7b1242d04c40)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:36.441520 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a959a-e4a9-43f0-8dcd-6a70ff2af4f9 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:36.478397 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-91f0a706-00e5-4ae6-ad4f-d8d98f73fe49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f96b207edddd4d8b8c4b2fc297efc4c1'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:36.490493 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-91f0a706-00e5-4ae6-ad4f-d8d98f73fe49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f96b207edddd4d8b8c4b2fc297efc4c1'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:36.491115 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-91f0a706-00e5-4ae6-ad4f-d8d98f73fe49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f96b207edddd4d8b8c4b2fc297efc4c1'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:36.573113 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-91f0a706-00e5-4ae6-ad4f-d8d98f73fe49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f96b207edddd4d8b8c4b2fc297efc4c1'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:36.581446 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-91f0a706-00e5-4ae6-ad4f-d8d98f73fe49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f96b207edddd4d8b8c4b2fc297efc4c1'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:36.587378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 942/1917] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:36 2022] DELETE /identity/v3/users/f96b207edddd4d8b8c4b2fc297efc4c1 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:36.588718 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06707ccc-a73a-4190-b0b0-d798dcd4ec9e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:36.589037 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06707ccc-a73a-4190-b0b0-d798dcd4ec9e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:36.589311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06707ccc-a73a-4190-b0b0-d798dcd4ec9e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:36.590876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 943/1918] 10.222.0.43 () {54 vars in 921 bytes} [Thu Aug 11 11:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:04:36.591540 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06707ccc-a73a-4190-b0b0-d798dcd4ec9e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:36.593444 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-06707ccc-a73a-4190-b0b0-d798dcd4ec9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:36.617083 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9e6a959a-e4a9-43f0-8dcd-6a70ff2af4f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd470210029a0484ba30b7b1242d04c40'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:36.617791 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9e6a959a-e4a9-43f0-8dcd-6a70ff2af4f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd470210029a0484ba30b7b1242d04c40'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:36.633101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9e6a959a-e4a9-43f0-8dcd-6a70ff2af4f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd470210029a0484ba30b7b1242d04c40'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:36.641462 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9e6a959a-e4a9-43f0-8dcd-6a70ff2af4f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd470210029a0484ba30b7b1242d04c40'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:36.674529 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06707ccc-a73a-4190-b0b0-d798dcd4ec9e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:36.679774 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21403d5e-d716-4e3e-89e9-c835f9700c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:36.680431 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21403d5e-d716-4e3e-89e9-c835f9700c69 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:36.680716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21403d5e-d716-4e3e-89e9-c835f9700c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:36.680989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21403d5e-d716-4e3e-89e9-c835f9700c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:36.681646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21403d5e-d716-4e3e-89e9-c835f9700c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:36.683311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21403d5e-d716-4e3e-89e9-c835f9700c69 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:36.695010 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 944/1919] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:36.700039 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd138d3d-6e3b-4555-a232-61d0e1e6602e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:36.700039 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd138d3d-6e3b-4555-a232-61d0e1e6602e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:36.700039 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd138d3d-6e3b-4555-a232-61d0e1e6602e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:36.718948 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-fd138d3d-6e3b-4555-a232-61d0e1e6602e None None] MFA Rules not processed for user `9267752ac6724013bc1edcdecff48dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:36.720209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fd138d3d-6e3b-4555-a232-61d0e1e6602e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:36.721686 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9e6a959a-e4a9-43f0-8dcd-6a70ff2af4f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd470210029a0484ba30b7b1242d04c40'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:36.729043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 976/1920] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:36 2022] DELETE /identity/v3/users/d470210029a0484ba30b7b1242d04c40 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:36.729944 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a959a-e4a9-43f0-8dcd-6a70ff2af4f9 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:36.731419 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9e6a959a-e4a9-43f0-8dcd-6a70ff2af4f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:36.843083 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 945/1921] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Aug 11 11:04:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:36.865537 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a959a-e4a9-43f0-8dcd-6a70ff2af4f9 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:36.871627 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e0177-317e-450f-b76a-c65f5296eb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:36.872446 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e0177-317e-450f-b76a-c65f5296eb7b admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:36.872821 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e0177-317e-450f-b76a-c65f5296eb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:36.873104 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e0177-317e-450f-b76a-c65f5296eb7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:36.873930 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e0177-317e-450f-b76a-c65f5296eb7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:36.879696 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd138d3d-6e3b-4555-a232-61d0e1e6602e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:36.881157 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fd138d3d-6e3b-4555-a232-61d0e1e6602e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:36.892003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e0177-317e-450f-b76a-c65f5296eb7b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:36.908531 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd138d3d-6e3b-4555-a232-61d0e1e6602e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:36.920659 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 977/1922] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:36.924288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e0177-317e-450f-b76a-c65f5296eb7b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:36.945105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e0177-317e-450f-b76a-c65f5296eb7b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:36.962772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6fcdc-40bb-4286-9c48-e13d4f273887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:36.963574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6fcdc-40bb-4286-9c48-e13d4f273887 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:36.964041 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6fcdc-40bb-4286-9c48-e13d4f273887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:36.964324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6fcdc-40bb-4286-9c48-e13d4f273887 admin admin] PATH_INFO: `/v3/projects/1db7ba48dc41461a94b2f49b7df7811c/users/3a0811a7332541a0ba2c45252d5a1b7f/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:37.004777 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6fcdc-40bb-4286-9c48-e13d4f273887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db7ba48dc41461a94b2f49b7df7811c, user_id=3a0811a7332541a0ba2c45252d5a1b7f, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:37.008690 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6fcdc-40bb-4286-9c48-e13d4f273887 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:37.052975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013eb240-8bf6-4a04-b7e4-cd286c635eec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:37.053677 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013eb240-8bf6-4a04-b7e4-cd286c635eec service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:37.053963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013eb240-8bf6-4a04-b7e4-cd286c635eec service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:37.054244 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013eb240-8bf6-4a04-b7e4-cd286c635eec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:37.087111 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013eb240-8bf6-4a04-b7e4-cd286c635eec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:37.091918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013eb240-8bf6-4a04-b7e4-cd286c635eec service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:37.107485 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 978/1923] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:36 2022] PUT /identity/v3/projects/1db7ba48dc41461a94b2f49b7df7811c/users/3a0811a7332541a0ba2c45252d5a1b7f/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:37.109826 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6fcdc-40bb-4286-9c48-e13d4f273887 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:37.118659 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2fd6fcdc-40bb-4286-9c48-e13d4f273887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:37.140902 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 946/1924] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:04:37.143586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813ddbf-8c4a-417d-a2b5-863ae3513d45 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:37.145572 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813ddbf-8c4a-417d-a2b5-863ae3513d45 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:37.145946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813ddbf-8c4a-417d-a2b5-863ae3513d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:37.229928 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6813ddbf-8c4a-417d-a2b5-863ae3513d45 None None] MFA Rules not processed for user `3a0811a7332541a0ba2c45252d5a1b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:37.234052 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6813ddbf-8c4a-417d-a2b5-863ae3513d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:37.302744 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6fcdc-40bb-4286-9c48-e13d4f273887 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:37.312487 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad58f9b-0d7a-472f-8ab6-91e020a07f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:37.313275 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad58f9b-0d7a-472f-8ab6-91e020a07f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:37.313628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad58f9b-0d7a-472f-8ab6-91e020a07f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:37.314014 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad58f9b-0d7a-472f-8ab6-91e020a07f1e admin admin] PATH_INFO: `/v3/projects/3e2f436a878945baa6a798a7b0775c47` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:37.315865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad58f9b-0d7a-472f-8ab6-91e020a07f1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e2f436a878945baa6a798a7b0775c47)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:37.318072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad58f9b-0d7a-472f-8ab6-91e020a07f1e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:37.419731 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 947/1925] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:37.423433 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813ddbf-8c4a-417d-a2b5-863ae3513d45 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:37.438921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813ddbf-8c4a-417d-a2b5-863ae3513d45 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:37.442465 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:37.449235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381464c-823f-4e36-9202-06f7c3074f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:37.449235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381464c-823f-4e36-9202-06f7c3074f6b admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:37.449948 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381464c-823f-4e36-9202-06f7c3074f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:37.450460 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381464c-823f-4e36-9202-06f7c3074f6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:37.451366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381464c-823f-4e36-9202-06f7c3074f6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:37.454672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381464c-823f-4e36-9202-06f7c3074f6b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:37.532997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fad58f9b-0d7a-472f-8ab6-91e020a07f1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e2f436a878945baa6a798a7b0775c47', 'request_id': 'req-fad58f9b-0d7a-472f-8ab6-91e020a07f1e'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:37.546158 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fad58f9b-0d7a-472f-8ab6-91e020a07f1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e2f436a878945baa6a798a7b0775c47', 'request_id': 'req-fad58f9b-0d7a-472f-8ab6-91e020a07f1e'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:37.582395 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 948/1926] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:37 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:04:37.583378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381464c-823f-4e36-9202-06f7c3074f6b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:37.585523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3381464c-823f-4e36-9202-06f7c3074f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:37.641778 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fad58f9b-0d7a-472f-8ab6-91e020a07f1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e2f436a878945baa6a798a7b0775c47', 'request_id': 'req-fad58f9b-0d7a-472f-8ab6-91e020a07f1e'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:37.661553 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fad58f9b-0d7a-472f-8ab6-91e020a07f1e admin admin] The token cache is being invalidate because project 3e2f436a878945baa6a798a7b0775c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:37.662196 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fad58f9b-0d7a-472f-8ab6-91e020a07f1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:37.663481 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fad58f9b-0d7a-472f-8ab6-91e020a07f1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:37.665329 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 979/1927] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:37 2022] DELETE /identity/v3/projects/3e2f436a878945baa6a798a7b0775c47 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:37.665933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad58f9b-0d7a-472f-8ab6-91e020a07f1e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:37.667278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fad58f9b-0d7a-472f-8ab6-91e020a07f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:37.679721 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381464c-823f-4e36-9202-06f7c3074f6b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:37.684749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1a33a-b7d7-4164-8019-82803e11dd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:37.685568 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1a33a-b7d7-4164-8019-82803e11dd45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:37.685857 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1a33a-b7d7-4164-8019-82803e11dd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:37.686879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1a33a-b7d7-4164-8019-82803e11dd45 admin admin] PATH_INFO: `/v3/projects/6e4db72452a546f0bb32b4f91493506b` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:37.688190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1a33a-b7d7-4164-8019-82803e11dd45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e4db72452a546f0bb32b4f91493506b)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:37.690153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1a33a-b7d7-4164-8019-82803e11dd45 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:37.750285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad58f9b-0d7a-472f-8ab6-91e020a07f1e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:37.755561 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0c396-0956-4e45-8f74-5c47d94de01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:37.756205 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0c396-0956-4e45-8f74-5c47d94de01e admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:37.756511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0c396-0956-4e45-8f74-5c47d94de01e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:37.756783 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0c396-0956-4e45-8f74-5c47d94de01e admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:37.757412 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0c396-0956-4e45-8f74-5c47d94de01e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:37.759545 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0c396-0956-4e45-8f74-5c47d94de01e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:37.893602 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8be1a33a-b7d7-4164-8019-82803e11dd45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e4db72452a546f0bb32b4f91493506b', 'request_id': 'req-8be1a33a-b7d7-4164-8019-82803e11dd45'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:37.899039 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8be1a33a-b7d7-4164-8019-82803e11dd45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e4db72452a546f0bb32b4f91493506b', 'request_id': 'req-8be1a33a-b7d7-4164-8019-82803e11dd45'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:37.905788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8be1a33a-b7d7-4164-8019-82803e11dd45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e4db72452a546f0bb32b4f91493506b', 'request_id': 'req-8be1a33a-b7d7-4164-8019-82803e11dd45'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:37.921167 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 980/1928] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:37 2022] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:37.921167 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0c396-0956-4e45-8f74-5c47d94de01e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:37.923175 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-08d0c396-0956-4e45-8f74-5c47d94de01e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:37.937085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0c396-0956-4e45-8f74-5c47d94de01e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:38.004912 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da17d9f-613f-4fde-82b5-db9eb90563fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:38.005885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da17d9f-613f-4fde-82b5-db9eb90563fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:38.007556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da17d9f-613f-4fde-82b5-db9eb90563fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:38.007924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da17d9f-613f-4fde-82b5-db9eb90563fb admin admin] PATH_INFO: `/v3/users/20b07390b6ce4082a54eb3c1b24c58ef` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:38.010289 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da17d9f-613f-4fde-82b5-db9eb90563fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b07390b6ce4082a54eb3c1b24c58ef)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:38.015232 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da17d9f-613f-4fde-82b5-db9eb90563fb admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:38.039637 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:38.046625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8be1a33a-b7d7-4164-8019-82803e11dd45 admin admin] The token cache is being invalidate because project 6e4db72452a546f0bb32b4f91493506b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:38.047217 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8be1a33a-b7d7-4164-8019-82803e11dd45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:38.054586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8be1a33a-b7d7-4164-8019-82803e11dd45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:38.056539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 949/1929] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:37 2022] DELETE /identity/v3/projects/6e4db72452a546f0bb32b4f91493506b => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:38.060566 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1a33a-b7d7-4164-8019-82803e11dd45 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:38.061952 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8be1a33a-b7d7-4164-8019-82803e11dd45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:38.081730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1a33a-b7d7-4164-8019-82803e11dd45 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:38.089252 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d00dec-3b45-42dd-a5da-1c8191099f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:38.089876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d00dec-3b45-42dd-a5da-1c8191099f09 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:38.090160 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d00dec-3b45-42dd-a5da-1c8191099f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:38.090430 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d00dec-3b45-42dd-a5da-1c8191099f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:38.091122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d00dec-3b45-42dd-a5da-1c8191099f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:38.093503 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d00dec-3b45-42dd-a5da-1c8191099f09 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:38.107392 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 950/1930] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:38.107392 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f9af9-0d2b-487d-86a3-3e028f432344 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:38.107392 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f9af9-0d2b-487d-86a3-3e028f432344 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:38.107392 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f9af9-0d2b-487d-86a3-3e028f432344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:38.140526 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e56f9af9-0d2b-487d-86a3-3e028f432344 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:38.142027 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e56f9af9-0d2b-487d-86a3-3e028f432344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:38.154919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 951/1931] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:38.157761 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f9af9-0d2b-487d-86a3-3e028f432344 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:38.179976 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f9af9-0d2b-487d-86a3-3e028f432344 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:38.187333 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29217f1-9496-43a4-a58e-05956b6d8ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:38.190363 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29217f1-9496-43a4-a58e-05956b6d8ded admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:38.190363 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29217f1-9496-43a4-a58e-05956b6d8ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:38.190363 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29217f1-9496-43a4-a58e-05956b6d8ded admin admin] PATH_INFO: `/v3/projects/26fb48aa2b3948d88b2fdeeab27d5a05/users/015d11a9fd164f07b2bb59c5766cdaa0/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:38.204279 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29217f1-9496-43a4-a58e-05956b6d8ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=26fb48aa2b3948d88b2fdeeab27d5a05, user_id=015d11a9fd164f07b2bb59c5766cdaa0, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:38.207013 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29217f1-9496-43a4-a58e-05956b6d8ded admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:38.300120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1da17d9f-613f-4fde-82b5-db9eb90563fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b07390b6ce4082a54eb3c1b24c58ef'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:38.300778 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1da17d9f-613f-4fde-82b5-db9eb90563fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b07390b6ce4082a54eb3c1b24c58ef'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:38.312633 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1da17d9f-613f-4fde-82b5-db9eb90563fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b07390b6ce4082a54eb3c1b24c58ef'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:38.319092 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1da17d9f-613f-4fde-82b5-db9eb90563fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b07390b6ce4082a54eb3c1b24c58ef'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:38.332186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 952/1932] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:38 2022] PUT /identity/v3/projects/26fb48aa2b3948d88b2fdeeab27d5a05/users/015d11a9fd164f07b2bb59c5766cdaa0/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:38.333444 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e93479-5d22-4d58-b23b-0506465b26b0 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:38.333735 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e93479-5d22-4d58-b23b-0506465b26b0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:38.337399 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e93479-5d22-4d58-b23b-0506465b26b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:38.355448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-41e93479-5d22-4d58-b23b-0506465b26b0 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:38.360461 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-41e93479-5d22-4d58-b23b-0506465b26b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:38.419142 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1da17d9f-613f-4fde-82b5-db9eb90563fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b07390b6ce4082a54eb3c1b24c58ef'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:38.427759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 981/1933] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:37 2022] DELETE /identity/v3/users/20b07390b6ce4082a54eb3c1b24c58ef => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:38.428598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da17d9f-613f-4fde-82b5-db9eb90563fb admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:38.430479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1da17d9f-613f-4fde-82b5-db9eb90563fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:38.445832 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 953/1934] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:38.447707 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e93479-5d22-4d58-b23b-0506465b26b0 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:38.473647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e93479-5d22-4d58-b23b-0506465b26b0 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:38.558896 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da17d9f-613f-4fde-82b5-db9eb90563fb admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:38.570548 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe4d2f-55b9-41d4-854b-a63e1e5965d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:38.571269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe4d2f-55b9-41d4-854b-a63e1e5965d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:38.571548 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe4d2f-55b9-41d4-854b-a63e1e5965d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:38.571817 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe4d2f-55b9-41d4-854b-a63e1e5965d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:38.572514 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe4d2f-55b9-41d4-854b-a63e1e5965d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:38.574572 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe4d2f-55b9-41d4-854b-a63e1e5965d3 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:38.586789 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 982/1935] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:38.594294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe4d2f-55b9-41d4-854b-a63e1e5965d3 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:38.613669 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27e210-0875-4e4d-8be1-7ea1e12a95e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:38.614304 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27e210-0875-4e4d-8be1-7ea1e12a95e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:38.614586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27e210-0875-4e4d-8be1-7ea1e12a95e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:38.614894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27e210-0875-4e4d-8be1-7ea1e12a95e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:38.615554 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27e210-0875-4e4d-8be1-7ea1e12a95e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:04:38.615929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27e210-0875-4e4d-8be1-7ea1e12a95e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:38.617924 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27e210-0875-4e4d-8be1-7ea1e12a95e8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:38.634634 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe4d2f-55b9-41d4-854b-a63e1e5965d3 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:38.642137 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d2631-01d3-435c-bc33-daeac8e8b9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:38.642137 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d2631-01d3-435c-bc33-daeac8e8b9ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:38.642137 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d2631-01d3-435c-bc33-daeac8e8b9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:38.642137 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d2631-01d3-435c-bc33-daeac8e8b9ca admin admin] PATH_INFO: `/v3/projects/26fb48aa2b3948d88b2fdeeab27d5a05/users/015d11a9fd164f07b2bb59c5766cdaa0/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:38.644048 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d2631-01d3-435c-bc33-daeac8e8b9ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=26fb48aa2b3948d88b2fdeeab27d5a05, user_id=015d11a9fd164f07b2bb59c5766cdaa0, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:38.645396 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 954/1936] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:04:38.646565 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27e210-0875-4e4d-8be1-7ea1e12a95e8 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:38.646844 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d2631-01d3-435c-bc33-daeac8e8b9ca admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:38.658697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 983/1937] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:38 2022] PUT /identity/v3/projects/26fb48aa2b3948d88b2fdeeab27d5a05/users/015d11a9fd164f07b2bb59c5766cdaa0/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:38.680854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab0b49-7149-40f0-be70-266c7ced3476 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:38.680854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab0b49-7149-40f0-be70-266c7ced3476 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:38.680854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab0b49-7149-40f0-be70-266c7ced3476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:38.688885 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27e210-0875-4e4d-8be1-7ea1e12a95e8 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:38.720595 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-76ab0b49-7149-40f0-be70-266c7ced3476 None None] MFA Rules not processed for user `015d11a9fd164f07b2bb59c5766cdaa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:38.723847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-76ab0b49-7149-40f0-be70-266c7ced3476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:38.764980 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c5940-df59-4d24-aca0-e4c54a4bc8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:38.765557 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c5940-df59-4d24-aca0-e4c54a4bc8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:38.765858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c5940-df59-4d24-aca0-e4c54a4bc8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:38.766634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c5940-df59-4d24-aca0-e4c54a4bc8d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:38.767316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c5940-df59-4d24-aca0-e4c54a4bc8d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:38.769246 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c5940-df59-4d24-aca0-e4c54a4bc8d7 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:38.828217 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 984/1938] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:38.836560 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab0b49-7149-40f0-be70-266c7ced3476 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:38.838315 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-76ab0b49-7149-40f0-be70-266c7ced3476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:38.902879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 955/1939] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:38 2022] POST /identity/v3/projects => generated 381 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:38.908463 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c5940-df59-4d24-aca0-e4c54a4bc8d7 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:38.925762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab0b49-7149-40f0-be70-266c7ced3476 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:38.979556 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c5940-df59-4d24-aca0-e4c54a4bc8d7 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:38.986067 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653e341-80a5-45a3-9d7b-75248e89422f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:38.986807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653e341-80a5-45a3-9d7b-75248e89422f admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:38.987153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653e341-80a5-45a3-9d7b-75248e89422f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:38.987500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653e341-80a5-45a3-9d7b-75248e89422f admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:38.989566 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653e341-80a5-45a3-9d7b-75248e89422f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:38.990486 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653e341-80a5-45a3-9d7b-75248e89422f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:38.994672 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd598ef4-b795-43d6-85e4-73df22a37e93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:38.995409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd598ef4-b795-43d6-85e4-73df22a37e93 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:38.995687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd598ef4-b795-43d6-85e4-73df22a37e93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:38.995961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd598ef4-b795-43d6-85e4-73df22a37e93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:39.057287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd598ef4-b795-43d6-85e4-73df22a37e93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:39.058721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd598ef4-b795-43d6-85e4-73df22a37e93 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:39.068341 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 985/1940] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:04:39.111459 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 956/1941] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:38 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:39.115729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd598ef4-b795-43d6-85e4-73df22a37e93 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:39.126233 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd598ef4-b795-43d6-85e4-73df22a37e93 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:39.130721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59090e-1105-4e2a-aec7-54fb02a34800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:39.131346 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59090e-1105-4e2a-aec7-54fb02a34800 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:39.131636 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59090e-1105-4e2a-aec7-54fb02a34800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:39.131887 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59090e-1105-4e2a-aec7-54fb02a34800 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:39.132524 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59090e-1105-4e2a-aec7-54fb02a34800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:39.134100 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59090e-1105-4e2a-aec7-54fb02a34800 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:39.144196 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 986/1942] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:39.157613 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653e341-80a5-45a3-9d7b-75248e89422f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:39.167548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653e341-80a5-45a3-9d7b-75248e89422f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:39.172525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af808d6b-fb8d-4e3c-a897-050c35819c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:39.173491 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af808d6b-fb8d-4e3c-a897-050c35819c68 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:39.173491 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af808d6b-fb8d-4e3c-a897-050c35819c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:39.173650 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af808d6b-fb8d-4e3c-a897-050c35819c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:39.174301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af808d6b-fb8d-4e3c-a897-050c35819c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:39.175921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af808d6b-fb8d-4e3c-a897-050c35819c68 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:39.180651 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59090e-1105-4e2a-aec7-54fb02a34800 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:39.182486 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3e59090e-1105-4e2a-aec7-54fb02a34800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:39.187973 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 957/1943] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:39.191546 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af808d6b-fb8d-4e3c-a897-050c35819c68 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:39.198176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59090e-1105-4e2a-aec7-54fb02a34800 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:39.202820 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af808d6b-fb8d-4e3c-a897-050c35819c68 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:39.205235 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489fc29-6cd7-4914-9f1c-eed0e32cb136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:39.206991 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489fc29-6cd7-4914-9f1c-eed0e32cb136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:39.207304 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489fc29-6cd7-4914-9f1c-eed0e32cb136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:39.207588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489fc29-6cd7-4914-9f1c-eed0e32cb136 admin admin] PATH_INFO: `/v3/projects/02ef7617ee694b41bb23095799ceba7c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:39.207962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dc9cf-aef3-49b3-ad83-7a91594f9786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:39.208478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dc9cf-aef3-49b3-ad83-7a91594f9786 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:39.208766 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dc9cf-aef3-49b3-ad83-7a91594f9786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:39.209170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dc9cf-aef3-49b3-ad83-7a91594f9786 admin admin] PATH_INFO: `/v3/projects/8672db33648a494e9ae429e13f2e16c3/users/3bdf4828e7a9412c8fbd770bf843a13a/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:39.209478 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489fc29-6cd7-4914-9f1c-eed0e32cb136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02ef7617ee694b41bb23095799ceba7c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:39.211720 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489fc29-6cd7-4914-9f1c-eed0e32cb136 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:39.256821 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dc9cf-aef3-49b3-ad83-7a91594f9786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8672db33648a494e9ae429e13f2e16c3, user_id=3bdf4828e7a9412c8fbd770bf843a13a, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:39.259682 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dc9cf-aef3-49b3-ad83-7a91594f9786 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:39.409449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 958/1944] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:39 2022] PUT /identity/v3/projects/8672db33648a494e9ae429e13f2e16c3/users/3bdf4828e7a9412c8fbd770bf843a13a/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:39.420726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d0061-8446-458a-995c-fcd361373b09 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:39.421143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d0061-8446-458a-995c-fcd361373b09 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:39.421524 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d0061-8446-458a-995c-fcd361373b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:39.426617 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9489fc29-6cd7-4914-9f1c-eed0e32cb136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02ef7617ee694b41bb23095799ceba7c', 'request_id': 'req-9489fc29-6cd7-4914-9f1c-eed0e32cb136'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:39.432051 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9489fc29-6cd7-4914-9f1c-eed0e32cb136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02ef7617ee694b41bb23095799ceba7c', 'request_id': 'req-9489fc29-6cd7-4914-9f1c-eed0e32cb136'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:39.451291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8b4d0061-8446-458a-995c-fcd361373b09 None None] MFA Rules not processed for user `3bdf4828e7a9412c8fbd770bf843a13a`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:39.453095 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8b4d0061-8446-458a-995c-fcd361373b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:39.516990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 959/1945] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:39.517929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d0061-8446-458a-995c-fcd361373b09 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:39.521220 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9489fc29-6cd7-4914-9f1c-eed0e32cb136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02ef7617ee694b41bb23095799ceba7c', 'request_id': 'req-9489fc29-6cd7-4914-9f1c-eed0e32cb136'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:39.533514 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9489fc29-6cd7-4914-9f1c-eed0e32cb136 admin admin] The token cache is being invalidate because project 02ef7617ee694b41bb23095799ceba7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:39.533824 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9489fc29-6cd7-4914-9f1c-eed0e32cb136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:39.534499 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9489fc29-6cd7-4914-9f1c-eed0e32cb136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:39.536019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 987/1946] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:39 2022] DELETE /identity/v3/projects/02ef7617ee694b41bb23095799ceba7c => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:39.541126 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489fc29-6cd7-4914-9f1c-eed0e32cb136 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:39.542417 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9489fc29-6cd7-4914-9f1c-eed0e32cb136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:39.575083 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d0061-8446-458a-995c-fcd361373b09 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:39.579584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa9439-e401-49fc-bb35-9ee95f2c85c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:39.580258 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa9439-e401-49fc-bb35-9ee95f2c85c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:39.580544 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa9439-e401-49fc-bb35-9ee95f2c85c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:39.580821 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa9439-e401-49fc-bb35-9ee95f2c85c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:39.582774 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-29aa9439-e401-49fc-bb35-9ee95f2c85c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:39.612795 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489fc29-6cd7-4914-9f1c-eed0e32cb136 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:39.618332 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1807c7-8300-4e18-8aea-0d3d1746b1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:39.619247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1807c7-8300-4e18-8aea-0d3d1746b1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:39.619633 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1807c7-8300-4e18-8aea-0d3d1746b1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:39.620054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1807c7-8300-4e18-8aea-0d3d1746b1c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:39.620834 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1807c7-8300-4e18-8aea-0d3d1746b1c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:39.623095 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1807c7-8300-4e18-8aea-0d3d1746b1c3 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:39.672792 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa9439-e401-49fc-bb35-9ee95f2c85c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:39.674841 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa9439-e401-49fc-bb35-9ee95f2c85c8 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:39.685154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 960/1947] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:39.687412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95e5ac-92a3-4273-abdc-8d1be8d7ab7a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:39.688079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95e5ac-92a3-4273-abdc-8d1be8d7ab7a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:39.688638 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b95e5ac-92a3-4273-abdc-8d1be8d7ab7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:39.710648 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6b95e5ac-92a3-4273-abdc-8d1be8d7ab7a None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:39.712950 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6b95e5ac-92a3-4273-abdc-8d1be8d7ab7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:39.723412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 961/1948] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:39.732407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a732b-6472-41fe-8a0a-251e5fb24d38 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:39.732701 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a732b-6472-41fe-8a0a-251e5fb24d38 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:39.733755 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a732b-6472-41fe-8a0a-251e5fb24d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:39.735274 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 988/1949] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:39 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:39.739419 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1807c7-8300-4e18-8aea-0d3d1746b1c3 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:39.757278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-575a732b-6472-41fe-8a0a-251e5fb24d38 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:39.758562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-575a732b-6472-41fe-8a0a-251e5fb24d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:39.761739 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:39.853656 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1807c7-8300-4e18-8aea-0d3d1746b1c3 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:39.860498 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7b063-a198-43bd-b8c1-6e7386f07efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:39.896885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7b063-a198-43bd-b8c1-6e7386f07efc admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:39.896885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7b063-a198-43bd-b8c1-6e7386f07efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:39.896885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7b063-a198-43bd-b8c1-6e7386f07efc admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:39.896885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7b063-a198-43bd-b8c1-6e7386f07efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:39.896885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7b063-a198-43bd-b8c1-6e7386f07efc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:39.897446 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 962/1950] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:39.897446 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a732b-6472-41fe-8a0a-251e5fb24d38 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:39.908785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a732b-6472-41fe-8a0a-251e5fb24d38 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:39.914290 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f6243-59d1-48b5-9adc-22088b5b19c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:39.915099 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f6243-59d1-48b5-9adc-22088b5b19c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:39.915246 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f6243-59d1-48b5-9adc-22088b5b19c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:39.915468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f6243-59d1-48b5-9adc-22088b5b19c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:39.916150 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f6243-59d1-48b5-9adc-22088b5b19c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:04:39.916521 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f6243-59d1-48b5-9adc-22088b5b19c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:39.918169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f6243-59d1-48b5-9adc-22088b5b19c6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:39.931898 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 963/1951] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 11:04:39.936275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f6243-59d1-48b5-9adc-22088b5b19c6 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:39.945878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f6243-59d1-48b5-9adc-22088b5b19c6 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:39.950636 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951e4ce-fb18-43fd-8cb9-e363e38b81df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:39.951260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951e4ce-fb18-43fd-8cb9-e363e38b81df admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:39.952107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951e4ce-fb18-43fd-8cb9-e363e38b81df admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:39.952408 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951e4ce-fb18-43fd-8cb9-e363e38b81df admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:39.953160 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951e4ce-fb18-43fd-8cb9-e363e38b81df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:39.955153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951e4ce-fb18-43fd-8cb9-e363e38b81df admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:40.564685 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 989/1952] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:39 2022] POST /identity/v3/users => generated 298 bytes in 826 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:40.565838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 964/1953] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:39 2022] POST /identity/v3/projects => generated 393 bytes in 630 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:04:40.567948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7b063-a198-43bd-b8c1-6e7386f07efc admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:40.569335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951e4ce-fb18-43fd-8cb9-e363e38b81df admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:40.579929 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7b063-a198-43bd-b8c1-6e7386f07efc admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:40.644986 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951e4ce-fb18-43fd-8cb9-e363e38b81df admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:40.650167 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ef345-b5db-45ef-bd36-494a70b4adb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:40.651573 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ef345-b5db-45ef-bd36-494a70b4adb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:40.651573 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ef345-b5db-45ef-bd36-494a70b4adb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:40.651803 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ef345-b5db-45ef-bd36-494a70b4adb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:40.652471 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ef345-b5db-45ef-bd36-494a70b4adb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:40.654858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ef345-b5db-45ef-bd36-494a70b4adb2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:40.669386 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 965/1954] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:04:40.674859 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ef345-b5db-45ef-bd36-494a70b4adb2 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:40.683342 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c12817-e054-4708-a50e-94c9df870194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:40.683962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ef345-b5db-45ef-bd36-494a70b4adb2 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:40.684075 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c12817-e054-4708-a50e-94c9df870194 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:40.686012 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c12817-e054-4708-a50e-94c9df870194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:40.687059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c12817-e054-4708-a50e-94c9df870194 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:40.688169 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c12817-e054-4708-a50e-94c9df870194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:40.690029 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1548b8-692b-495a-a2b5-59b0e028761a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:40.690225 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c12817-e054-4708-a50e-94c9df870194 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:40.690875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1548b8-692b-495a-a2b5-59b0e028761a admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:40.691227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1548b8-692b-495a-a2b5-59b0e028761a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:40.691735 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1548b8-692b-495a-a2b5-59b0e028761a admin admin] PATH_INFO: `/v3/projects/806b815f0e014eb993c11e5c7f65acad/users/bca47869c5ef404da36f366fecf7d15b/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:40.706934 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1548b8-692b-495a-a2b5-59b0e028761a admin admin] RBAC: Authorizing `identity:create_grant(project_id=806b815f0e014eb993c11e5c7f65acad, user_id=bca47869c5ef404da36f366fecf7d15b, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:40.709608 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1548b8-692b-495a-a2b5-59b0e028761a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:40.825989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 966/1955] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:40 2022] PUT /identity/v3/projects/806b815f0e014eb993c11e5c7f65acad/users/bca47869c5ef404da36f366fecf7d15b/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:40.829943 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1548b8-692b-495a-a2b5-59b0e028761a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:40.843239 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 990/1956] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:40 2022] POST /identity/v3/users => generated 297 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:40.849775 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c12817-e054-4708-a50e-94c9df870194 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:40.869535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c12817-e054-4708-a50e-94c9df870194 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:40.920012 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1548b8-692b-495a-a2b5-59b0e028761a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:40.932402 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9ec06-ef58-46ed-91da-94ed32451770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:40.933595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9ec06-ef58-46ed-91da-94ed32451770 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:40.933891 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9ec06-ef58-46ed-91da-94ed32451770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:40.934478 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9ec06-ef58-46ed-91da-94ed32451770 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:40.935255 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9ec06-ef58-46ed-91da-94ed32451770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:40.939255 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9ec06-ef58-46ed-91da-94ed32451770 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:40.952010 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 967/1957] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:40.955869 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9ec06-ef58-46ed-91da-94ed32451770 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:40.973009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9ec06-ef58-46ed-91da-94ed32451770 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:40.978847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa412c29-5ecc-4fd3-8daf-1f9de389f911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:40.979525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa412c29-5ecc-4fd3-8daf-1f9de389f911 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:40.979809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa412c29-5ecc-4fd3-8daf-1f9de389f911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:40.980086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa412c29-5ecc-4fd3-8daf-1f9de389f911 admin admin] PATH_INFO: `/v3/projects/806b815f0e014eb993c11e5c7f65acad/users/bca47869c5ef404da36f366fecf7d15b/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:40.982183 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa412c29-5ecc-4fd3-8daf-1f9de389f911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=806b815f0e014eb993c11e5c7f65acad, user_id=bca47869c5ef404da36f366fecf7d15b, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:40.985215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa412c29-5ecc-4fd3-8daf-1f9de389f911 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:40.986230 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21fa7e-810e-4063-9c6d-25ed8764cbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:40.986959 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21fa7e-810e-4063-9c6d-25ed8764cbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:40.987855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21fa7e-810e-4063-9c6d-25ed8764cbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:40.988216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21fa7e-810e-4063-9c6d-25ed8764cbf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:40.990086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21fa7e-810e-4063-9c6d-25ed8764cbf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:40.992275 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e21fa7e-810e-4063-9c6d-25ed8764cbf8 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:41.006647 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 991/1958] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:41.009096 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21fa7e-810e-4063-9c6d-25ed8764cbf8 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:41.030899 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 968/1959] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:40 2022] PUT /identity/v3/projects/806b815f0e014eb993c11e5c7f65acad/users/bca47869c5ef404da36f366fecf7d15b/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:41.030899 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3346bc-72c8-42fa-854f-73726ad603cc None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:41.030899 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3346bc-72c8-42fa-854f-73726ad603cc None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:41.030899 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3346bc-72c8-42fa-854f-73726ad603cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:41.031561 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21fa7e-810e-4063-9c6d-25ed8764cbf8 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:41.067626 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-fa3346bc-72c8-42fa-854f-73726ad603cc None None] MFA Rules not processed for user `bca47869c5ef404da36f366fecf7d15b`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:41.068854 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fa3346bc-72c8-42fa-854f-73726ad603cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:41.103189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027701a1-e799-4fbc-be0a-d40173e878d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:41.103860 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027701a1-e799-4fbc-be0a-d40173e878d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:41.104141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027701a1-e799-4fbc-be0a-d40173e878d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:41.104467 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027701a1-e799-4fbc-be0a-d40173e878d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:41.105210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027701a1-e799-4fbc-be0a-d40173e878d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:41.106919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027701a1-e799-4fbc-be0a-d40173e878d3 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:41.126636 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 992/1960] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:04:41.127589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027701a1-e799-4fbc-be0a-d40173e878d3 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:41.138363 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027701a1-e799-4fbc-be0a-d40173e878d3 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:41.156869 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a89ff9-d18a-4069-89f5-6353d30d9bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:41.158650 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a89ff9-d18a-4069-89f5-6353d30d9bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:41.158650 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a89ff9-d18a-4069-89f5-6353d30d9bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:41.159588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a89ff9-d18a-4069-89f5-6353d30d9bdc admin admin] PATH_INFO: `/v3/projects/918674a8094d41f6ad3bf52d5542393a/users/4b3e9f7ac5d24cc284e362f514c82590/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:41.181148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a89ff9-d18a-4069-89f5-6353d30d9bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=918674a8094d41f6ad3bf52d5542393a, user_id=4b3e9f7ac5d24cc284e362f514c82590, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:41.186607 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a89ff9-d18a-4069-89f5-6353d30d9bdc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:41.193885 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 969/1961] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:41.219638 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3346bc-72c8-42fa-854f-73726ad603cc None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:41.221100 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fa3346bc-72c8-42fa-854f-73726ad603cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:41.292486 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3346bc-72c8-42fa-854f-73726ad603cc None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:41.298116 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd020c-8e7b-4566-a28c-451a10f1e6c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:41.298739 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd020c-8e7b-4566-a28c-451a10f1e6c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:41.299134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd020c-8e7b-4566-a28c-451a10f1e6c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:41.299411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd020c-8e7b-4566-a28c-451a10f1e6c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:41.312488 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd020c-8e7b-4566-a28c-451a10f1e6c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:41.314115 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd020c-8e7b-4566-a28c-451a10f1e6c0 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:41.344341 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 993/1962] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:41 2022] PUT /identity/v3/projects/918674a8094d41f6ad3bf52d5542393a/users/4b3e9f7ac5d24cc284e362f514c82590/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:41.345178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 970/1963] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:04:41.356917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0595cf0-be8b-4fac-8807-60520f51e95e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:41.356917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0595cf0-be8b-4fac-8807-60520f51e95e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:41.356917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0595cf0-be8b-4fac-8807-60520f51e95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:41.393157 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e0595cf0-be8b-4fac-8807-60520f51e95e None None] MFA Rules not processed for user `4b3e9f7ac5d24cc284e362f514c82590`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:41.394946 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e0595cf0-be8b-4fac-8807-60520f51e95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:41.502287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 994/1964] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:41.506803 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd020c-8e7b-4566-a28c-451a10f1e6c0 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:41.538751 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd020c-8e7b-4566-a28c-451a10f1e6c0 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:41.625951 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a35234-b631-48ea-a637-2f8bb66f019f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:41.626993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a35234-b631-48ea-a637-2f8bb66f019f admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:41.627424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a35234-b631-48ea-a637-2f8bb66f019f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:41.627869 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a35234-b631-48ea-a637-2f8bb66f019f admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:41.628742 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a35234-b631-48ea-a637-2f8bb66f019f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:41.633918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a35234-b631-48ea-a637-2f8bb66f019f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:41.753135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 971/1965] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:41 2022] POST /identity/v3/projects => generated 393 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:41.754148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0595cf0-be8b-4fac-8807-60520f51e95e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:41.766516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0595cf0-be8b-4fac-8807-60520f51e95e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:41.826217 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3750a05-6e53-4d35-a21e-090da2b4e01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:41.827522 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3750a05-6e53-4d35-a21e-090da2b4e01c admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:41.827892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3750a05-6e53-4d35-a21e-090da2b4e01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:41.828170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3750a05-6e53-4d35-a21e-090da2b4e01c admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:41.828791 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3750a05-6e53-4d35-a21e-090da2b4e01c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:41.830948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3750a05-6e53-4d35-a21e-090da2b4e01c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:41.836755 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a35234-b631-48ea-a637-2f8bb66f019f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:41.838580 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b3a35234-b631-48ea-a637-2f8bb66f019f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:41.896516 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a35234-b631-48ea-a637-2f8bb66f019f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:41.900240 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a781944-09c0-4d08-ab81-389f3aa57b15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:41.900853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a781944-09c0-4d08-ab81-389f3aa57b15 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:41.901137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a781944-09c0-4d08-ab81-389f3aa57b15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:41.901412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a781944-09c0-4d08-ab81-389f3aa57b15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:41.903203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0a781944-09c0-4d08-ab81-389f3aa57b15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:41.962354 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a781944-09c0-4d08-ab81-389f3aa57b15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:41.963724 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a781944-09c0-4d08-ab81-389f3aa57b15 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:41.972849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 972/1966] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:04:41.994249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 995/1967] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:41 2022] POST /identity/v3/users => generated 303 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:41.994373 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a781944-09c0-4d08-ab81-389f3aa57b15 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:41.994373 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a781944-09c0-4d08-ab81-389f3aa57b15 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:41.999431 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380001e-fdd9-4af0-8bf0-63c6251e04f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:42.000119 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380001e-fdd9-4af0-8bf0-63c6251e04f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:42.000401 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380001e-fdd9-4af0-8bf0-63c6251e04f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:42.000675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a380001e-fdd9-4af0-8bf0-63c6251e04f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:42.001310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380001e-fdd9-4af0-8bf0-63c6251e04f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:42.002938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a380001e-fdd9-4af0-8bf0-63c6251e04f3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:42.012917 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 973/1968] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:04:42.017792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3750a05-6e53-4d35-a21e-090da2b4e01c admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:42.028175 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3750a05-6e53-4d35-a21e-090da2b4e01c admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:42.033207 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8d442-07ee-4431-a6f9-638eb79aa7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:42.034252 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8d442-07ee-4431-a6f9-638eb79aa7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:42.034690 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8d442-07ee-4431-a6f9-638eb79aa7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:42.035011 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee8d442-07ee-4431-a6f9-638eb79aa7a6 admin admin] PATH_INFO: `/v3/projects/5af3fdd4ca7e43cf9aeaccdf5755aeef/users/39635a451ed84bba9c77f743afc2fc7f/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:42.053164 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8d442-07ee-4431-a6f9-638eb79aa7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af3fdd4ca7e43cf9aeaccdf5755aeef, user_id=39635a451ed84bba9c77f743afc2fc7f, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:42.056116 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee8d442-07ee-4431-a6f9-638eb79aa7a6 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:42.181061 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 996/1969] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:42 2022] PUT /identity/v3/projects/5af3fdd4ca7e43cf9aeaccdf5755aeef/users/39635a451ed84bba9c77f743afc2fc7f/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:42.185072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380001e-fdd9-4af0-8bf0-63c6251e04f3 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:42.218128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a380001e-fdd9-4af0-8bf0-63c6251e04f3 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:42.317259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db07452-60ed-44da-9757-cf4221a89f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:42.317923 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db07452-60ed-44da-9757-cf4221a89f20 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:42.318204 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db07452-60ed-44da-9757-cf4221a89f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:42.318488 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db07452-60ed-44da-9757-cf4221a89f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:42.319162 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db07452-60ed-44da-9757-cf4221a89f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:42.320861 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db07452-60ed-44da-9757-cf4221a89f20 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:42.334816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 974/1970] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:42.336363 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8d442-07ee-4431-a6f9-638eb79aa7a6 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:42.350543 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee8d442-07ee-4431-a6f9-638eb79aa7a6 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:42.362348 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1982c-ed1a-4566-afdd-a59cce25ea22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:42.363110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1982c-ed1a-4566-afdd-a59cce25ea22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:42.363396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1982c-ed1a-4566-afdd-a59cce25ea22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:42.366086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1982c-ed1a-4566-afdd-a59cce25ea22 admin admin] PATH_INFO: `/v3/projects/5af3fdd4ca7e43cf9aeaccdf5755aeef/users/39635a451ed84bba9c77f743afc2fc7f/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:42.366086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1982c-ed1a-4566-afdd-a59cce25ea22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af3fdd4ca7e43cf9aeaccdf5755aeef, user_id=39635a451ed84bba9c77f743afc2fc7f, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:42.368415 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1982c-ed1a-4566-afdd-a59cce25ea22 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:42.381533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 997/1971] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:42 2022] PUT /identity/v3/projects/5af3fdd4ca7e43cf9aeaccdf5755aeef/users/39635a451ed84bba9c77f743afc2fc7f/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:42.392284 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9161784-cacd-4c70-bd9f-b219fd16dbcc None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:42.392577 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9161784-cacd-4c70-bd9f-b219fd16dbcc None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:42.392852 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9161784-cacd-4c70-bd9f-b219fd16dbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:42.425510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f9161784-cacd-4c70-bd9f-b219fd16dbcc None None] MFA Rules not processed for user `39635a451ed84bba9c77f743afc2fc7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:42.426751 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f9161784-cacd-4c70-bd9f-b219fd16dbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:42.489262 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:42.529377 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 975/1972] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:42 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:42.709142 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1982c-ed1a-4566-afdd-a59cce25ea22 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:42.763304 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1982c-ed1a-4566-afdd-a59cce25ea22 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:42.768023 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495cb95-e34c-4022-a43e-ded9d14792f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:42.768715 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495cb95-e34c-4022-a43e-ded9d14792f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:42.769026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495cb95-e34c-4022-a43e-ded9d14792f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:42.769302 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495cb95-e34c-4022-a43e-ded9d14792f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:42.779184 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495cb95-e34c-4022-a43e-ded9d14792f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:42.781160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495cb95-e34c-4022-a43e-ded9d14792f2 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:42.791628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 998/1973] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:42 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:42.820714 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:42.907674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9161784-cacd-4c70-bd9f-b219fd16dbcc None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:42.917276 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9161784-cacd-4c70-bd9f-b219fd16dbcc None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:42.921444 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3543178-211d-4687-9a1d-5099f514c5de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:42.922057 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3543178-211d-4687-9a1d-5099f514c5de service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:42.922338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3543178-211d-4687-9a1d-5099f514c5de service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:42.922613 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3543178-211d-4687-9a1d-5099f514c5de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:42.993467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3543178-211d-4687-9a1d-5099f514c5de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:42.995695 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3543178-211d-4687-9a1d-5099f514c5de service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:43.004813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 976/1974] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:42 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:43.841975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:44.557247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:45.127579 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:48.428397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495cb95-e34c-4022-a43e-ded9d14792f2 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:48.510621 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495cb95-e34c-4022-a43e-ded9d14792f2 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:48.516437 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87855d-180a-4674-b0d1-2b658191ed97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:48.517114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87855d-180a-4674-b0d1-2b658191ed97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:48.517427 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87855d-180a-4674-b0d1-2b658191ed97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:48.517729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87855d-180a-4674-b0d1-2b658191ed97 admin admin] PATH_INFO: `/v3/users/3bdf4828e7a9412c8fbd770bf843a13a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:48.518941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87855d-180a-4674-b0d1-2b658191ed97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bdf4828e7a9412c8fbd770bf843a13a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:48.523421 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87855d-180a-4674-b0d1-2b658191ed97 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:48.635139 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:48.766401 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ec87855d-180a-4674-b0d1-2b658191ed97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bdf4828e7a9412c8fbd770bf843a13a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:48.767501 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ec87855d-180a-4674-b0d1-2b658191ed97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bdf4828e7a9412c8fbd770bf843a13a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:48.783575 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ec87855d-180a-4674-b0d1-2b658191ed97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bdf4828e7a9412c8fbd770bf843a13a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:48.791793 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ec87855d-180a-4674-b0d1-2b658191ed97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bdf4828e7a9412c8fbd770bf843a13a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:48.898189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ec87855d-180a-4674-b0d1-2b658191ed97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bdf4828e7a9412c8fbd770bf843a13a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:48.907384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 999/1975] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:48 2022] DELETE /identity/v3/users/3bdf4828e7a9412c8fbd770bf843a13a => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:48.911817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923c634-91d6-4878-b096-d680c6f20492 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:48.912633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923c634-91d6-4878-b096-d680c6f20492 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:48.912921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923c634-91d6-4878-b096-d680c6f20492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:48.944666 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6923c634-91d6-4878-b096-d680c6f20492 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:48.945923 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6923c634-91d6-4878-b096-d680c6f20492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:49.018272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 977/1976] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:49.027083 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87855d-180a-4674-b0d1-2b658191ed97 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:49.028580 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ec87855d-180a-4674-b0d1-2b658191ed97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:49.087834 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87855d-180a-4674-b0d1-2b658191ed97 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:49.092572 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a49d7-86e5-4901-8a6f-ec70654f6869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:49.097734 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a49d7-86e5-4901-8a6f-ec70654f6869 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:49.097734 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a49d7-86e5-4901-8a6f-ec70654f6869 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:49.097734 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a49d7-86e5-4901-8a6f-ec70654f6869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:49.103662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a49d7-86e5-4901-8a6f-ec70654f6869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:49.105117 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a49d7-86e5-4901-8a6f-ec70654f6869 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:49.116194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1000/1977] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:49.150269 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:49.591712 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923c634-91d6-4878-b096-d680c6f20492 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:49.593453 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6923c634-91d6-4878-b096-d680c6f20492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:49.608089 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923c634-91d6-4878-b096-d680c6f20492 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:49.616308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f8099-94bf-4455-a7e4-93d6e972185d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:49.617074 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f8099-94bf-4455-a7e4-93d6e972185d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:49.617624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f8099-94bf-4455-a7e4-93d6e972185d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:49.618812 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f8099-94bf-4455-a7e4-93d6e972185d admin admin] PATH_INFO: `/v3/projects/8672db33648a494e9ae429e13f2e16c3` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:49.630294 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f8099-94bf-4455-a7e4-93d6e972185d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8672db33648a494e9ae429e13f2e16c3)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:49.636223 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f8099-94bf-4455-a7e4-93d6e972185d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:49.759876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3c7f8099-94bf-4455-a7e4-93d6e972185d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8672db33648a494e9ae429e13f2e16c3', 'request_id': 'req-3c7f8099-94bf-4455-a7e4-93d6e972185d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:49.767651 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3c7f8099-94bf-4455-a7e4-93d6e972185d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8672db33648a494e9ae429e13f2e16c3', 'request_id': 'req-3c7f8099-94bf-4455-a7e4-93d6e972185d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:49.776794 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3c7f8099-94bf-4455-a7e4-93d6e972185d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8672db33648a494e9ae429e13f2e16c3', 'request_id': 'req-3c7f8099-94bf-4455-a7e4-93d6e972185d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:49.869388 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3c7f8099-94bf-4455-a7e4-93d6e972185d admin admin] The token cache is being invalidate because project 8672db33648a494e9ae429e13f2e16c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:49.869782 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3c7f8099-94bf-4455-a7e4-93d6e972185d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:49.870468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3c7f8099-94bf-4455-a7e4-93d6e972185d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:49.872080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 978/1978] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:49 2022] DELETE /identity/v3/projects/8672db33648a494e9ae429e13f2e16c3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:49.876838 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a49d7-86e5-4901-8a6f-ec70654f6869 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:49.886738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a49d7-86e5-4901-8a6f-ec70654f6869 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:49.942173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9877c-fe8e-437e-a138-fa5ad8907e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:49.942889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9877c-fe8e-437e-a138-fa5ad8907e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:49.943170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9877c-fe8e-437e-a138-fa5ad8907e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:49.943439 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9877c-fe8e-437e-a138-fa5ad8907e1c admin admin] PATH_INFO: `/v3/users/bca47869c5ef404da36f366fecf7d15b` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:49.944608 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9877c-fe8e-437e-a138-fa5ad8907e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bca47869c5ef404da36f366fecf7d15b)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:49.946669 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9877c-fe8e-437e-a138-fa5ad8907e1c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:50.267875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-38d9877c-fe8e-437e-a138-fa5ad8907e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bca47869c5ef404da36f366fecf7d15b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:50.268618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-38d9877c-fe8e-437e-a138-fa5ad8907e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bca47869c5ef404da36f366fecf7d15b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:50.279793 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-38d9877c-fe8e-437e-a138-fa5ad8907e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bca47869c5ef404da36f366fecf7d15b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:50.286923 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-38d9877c-fe8e-437e-a138-fa5ad8907e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bca47869c5ef404da36f366fecf7d15b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:50.458645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-38d9877c-fe8e-437e-a138-fa5ad8907e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bca47869c5ef404da36f366fecf7d15b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:50.465214 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1001/1979] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:49 2022] DELETE /identity/v3/users/bca47869c5ef404da36f366fecf7d15b => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:50.713062 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:50.997468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f8099-94bf-4455-a7e4-93d6e972185d admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:50.998987 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3c7f8099-94bf-4455-a7e4-93d6e972185d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:51.013358 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f8099-94bf-4455-a7e4-93d6e972185d admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:51.073439 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee7c7f-4659-48f1-b7b6-7665f9fef759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:51.074200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee7c7f-4659-48f1-b7b6-7665f9fef759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:51.074487 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee7c7f-4659-48f1-b7b6-7665f9fef759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:51.074790 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee7c7f-4659-48f1-b7b6-7665f9fef759 admin admin] PATH_INFO: `/v3/projects/806b815f0e014eb993c11e5c7f65acad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:51.075906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee7c7f-4659-48f1-b7b6-7665f9fef759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=806b815f0e014eb993c11e5c7f65acad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:51.078383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee7c7f-4659-48f1-b7b6-7665f9fef759 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:51.270353 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-66ee7c7f-4659-48f1-b7b6-7665f9fef759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '806b815f0e014eb993c11e5c7f65acad', 'request_id': 'req-66ee7c7f-4659-48f1-b7b6-7665f9fef759'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:51.277835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-66ee7c7f-4659-48f1-b7b6-7665f9fef759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '806b815f0e014eb993c11e5c7f65acad', 'request_id': 'req-66ee7c7f-4659-48f1-b7b6-7665f9fef759'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:51.287930 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-66ee7c7f-4659-48f1-b7b6-7665f9fef759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '806b815f0e014eb993c11e5c7f65acad', 'request_id': 'req-66ee7c7f-4659-48f1-b7b6-7665f9fef759'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:51.304640 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9877c-fe8e-437e-a138-fa5ad8907e1c admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:51.306122 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-38d9877c-fe8e-437e-a138-fa5ad8907e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:51.318916 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9877c-fe8e-437e-a138-fa5ad8907e1c admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:51.376070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9f497-2c22-49ef-b566-cf275f0ee1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:51.376943 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9f497-2c22-49ef-b566-cf275f0ee1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:51.377061 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9f497-2c22-49ef-b566-cf275f0ee1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:51.377330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9f497-2c22-49ef-b566-cf275f0ee1cb admin admin] PATH_INFO: `/v3/users/3a0811a7332541a0ba2c45252d5a1b7f` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:51.378477 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9f497-2c22-49ef-b566-cf275f0ee1cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a0811a7332541a0ba2c45252d5a1b7f)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:51.380448 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9f497-2c22-49ef-b566-cf275f0ee1cb admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:51.413416 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-66ee7c7f-4659-48f1-b7b6-7665f9fef759 admin admin] The token cache is being invalidate because project 806b815f0e014eb993c11e5c7f65acad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:51.413714 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-66ee7c7f-4659-48f1-b7b6-7665f9fef759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:51.414372 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-66ee7c7f-4659-48f1-b7b6-7665f9fef759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:51.416073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 979/1980] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:50 2022] DELETE /identity/v3/projects/806b815f0e014eb993c11e5c7f65acad => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:51.421182 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee7c7f-4659-48f1-b7b6-7665f9fef759 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:51.423119 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-66ee7c7f-4659-48f1-b7b6-7665f9fef759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:51.437753 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee7c7f-4659-48f1-b7b6-7665f9fef759 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:51.444142 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a918477-56e1-42ad-b848-3c0dd0813862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:51.444876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a918477-56e1-42ad-b848-3c0dd0813862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:51.445456 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a918477-56e1-42ad-b848-3c0dd0813862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:51.445820 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a918477-56e1-42ad-b848-3c0dd0813862 admin admin] PATH_INFO: `/v3/users/4b3e9f7ac5d24cc284e362f514c82590` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:51.447071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a918477-56e1-42ad-b848-3c0dd0813862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b3e9f7ac5d24cc284e362f514c82590)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:51.449121 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a918477-56e1-42ad-b848-3c0dd0813862 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:51.596751 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-a4d9f497-2c22-49ef-b566-cf275f0ee1cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a0811a7332541a0ba2c45252d5a1b7f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:51.597416 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-a4d9f497-2c22-49ef-b566-cf275f0ee1cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a0811a7332541a0ba2c45252d5a1b7f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:51.611545 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-a4d9f497-2c22-49ef-b566-cf275f0ee1cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a0811a7332541a0ba2c45252d5a1b7f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:51.619164 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-a4d9f497-2c22-49ef-b566-cf275f0ee1cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a0811a7332541a0ba2c45252d5a1b7f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:51.628273 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5a918477-56e1-42ad-b848-3c0dd0813862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b3e9f7ac5d24cc284e362f514c82590'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:51.640481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5a918477-56e1-42ad-b848-3c0dd0813862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b3e9f7ac5d24cc284e362f514c82590'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:51.641271 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5a918477-56e1-42ad-b848-3c0dd0813862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b3e9f7ac5d24cc284e362f514c82590'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:51.721075 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-a4d9f497-2c22-49ef-b566-cf275f0ee1cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a0811a7332541a0ba2c45252d5a1b7f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:51.727671 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1002/1981] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:51 2022] DELETE /identity/v3/users/3a0811a7332541a0ba2c45252d5a1b7f => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:51.729902 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b983c8e-14b8-4ea2-a940-ce802b3c47b9 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:51.730119 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b983c8e-14b8-4ea2-a940-ce802b3c47b9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:51.730401 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b983c8e-14b8-4ea2-a940-ce802b3c47b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:51.750536 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1b983c8e-14b8-4ea2-a940-ce802b3c47b9 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:51.751365 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1b983c8e-14b8-4ea2-a940-ce802b3c47b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:51.811185 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1003/1982] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:51.812471 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d800c9-87c9-421d-b60f-32be346d1fc3 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:51.812798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d800c9-87c9-421d-b60f-32be346d1fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:51.813077 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d800c9-87c9-421d-b60f-32be346d1fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:51.831519 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5a918477-56e1-42ad-b848-3c0dd0813862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b3e9f7ac5d24cc284e362f514c82590'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:51.834052 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d8d800c9-87c9-421d-b60f-32be346d1fc3 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:51.835299 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d8d800c9-87c9-421d-b60f-32be346d1fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:51.839000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5a918477-56e1-42ad-b848-3c0dd0813862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b3e9f7ac5d24cc284e362f514c82590'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:51.845500 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1004/1983] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:51.845881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 980/1984] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:51 2022] DELETE /identity/v3/users/4b3e9f7ac5d24cc284e362f514c82590 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:51.847016 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fb804-b873-44ce-946f-55a8b09fa8e1 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:51.847305 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fb804-b873-44ce-946f-55a8b09fa8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:51.847578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766fb804-b873-44ce-946f-55a8b09fa8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:51.855701 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e041b-d581-4fe3-9f7a-a06afb8cb781 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:51.855997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e041b-d581-4fe3-9f7a-a06afb8cb781 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:51.856424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e041b-d581-4fe3-9f7a-a06afb8cb781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:51.870621 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-766fb804-b873-44ce-946f-55a8b09fa8e1 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:51.871876 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-766fb804-b873-44ce-946f-55a8b09fa8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:51.877119 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a00e041b-d581-4fe3-9f7a-a06afb8cb781 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:51.878391 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a00e041b-d581-4fe3-9f7a-a06afb8cb781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:51.933889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1005/1985] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:51.934850 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fb804-b873-44ce-946f-55a8b09fa8e1 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:51.936228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-766fb804-b873-44ce-946f-55a8b09fa8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:51.939606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 981/1986] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:51.940450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e041b-d581-4fe3-9f7a-a06afb8cb781 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:51.950981 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e041b-d581-4fe3-9f7a-a06afb8cb781 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:51.956602 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9bef4-bbf7-478f-9fe8-7297d3a1c0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:51.957216 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9bef4-bbf7-478f-9fe8-7297d3a1c0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:51.957497 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9bef4-bbf7-478f-9fe8-7297d3a1c0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:51.957772 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9bef4-bbf7-478f-9fe8-7297d3a1c0b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:51.958423 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9bef4-bbf7-478f-9fe8-7297d3a1c0b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:04:51.958723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9bef4-bbf7-478f-9fe8-7297d3a1c0b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:51.960376 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9bef4-bbf7-478f-9fe8-7297d3a1c0b1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:51.972918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 982/1987] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:04:51.973844 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9bef4-bbf7-478f-9fe8-7297d3a1c0b1 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:51.975501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-73b9bef4-bbf7-478f-9fe8-7297d3a1c0b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:51.995933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766fb804-b873-44ce-946f-55a8b09fa8e1 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:52.000104 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f84dc-58e6-4e2a-b82c-98ea9b2f9060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:52.000789 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f84dc-58e6-4e2a-b82c-98ea9b2f9060 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:52.001070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f84dc-58e6-4e2a-b82c-98ea9b2f9060 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:52.001351 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f84dc-58e6-4e2a-b82c-98ea9b2f9060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:52.010381 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f84dc-58e6-4e2a-b82c-98ea9b2f9060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:52.011912 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f84dc-58e6-4e2a-b82c-98ea9b2f9060 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:52.018051 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:52.023998 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1006/1988] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:52.024714 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f84dc-58e6-4e2a-b82c-98ea9b2f9060 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:52.034970 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9bef4-bbf7-478f-9fe8-7297d3a1c0b1 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:52.035140 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f84dc-58e6-4e2a-b82c-98ea9b2f9060 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:52.039314 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6fc60-0211-470d-a20c-f713192fdd6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:52.039701 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6fc60-0211-470d-a20c-f713192fdd6d service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:52.039985 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6fc60-0211-470d-a20c-f713192fdd6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:52.040087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc6382-5102-4451-961d-a928c30ed879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:52.040261 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6fc60-0211-470d-a20c-f713192fdd6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:52.040687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc6382-5102-4451-961d-a928c30ed879 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:52.040971 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc6382-5102-4451-961d-a928c30ed879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:52.041243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc6382-5102-4451-961d-a928c30ed879 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:52.041867 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc6382-5102-4451-961d-a928c30ed879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:52.043902 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc6382-5102-4451-961d-a928c30ed879 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:52.051076 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6fc60-0211-470d-a20c-f713192fdd6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:52.053402 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6fc60-0211-470d-a20c-f713192fdd6d service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:52.067690 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 983/1989] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:52.166750 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1007/1990] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:52 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:52.168230 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6fc60-0211-470d-a20c-f713192fdd6d service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:52.178834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6fc60-0211-470d-a20c-f713192fdd6d service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:52.236304 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47ca76-32a8-4072-90c5-5eb833a9c90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:52.236920 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47ca76-32a8-4072-90c5-5eb833a9c90f admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:52.237207 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47ca76-32a8-4072-90c5-5eb833a9c90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:52.237486 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47ca76-32a8-4072-90c5-5eb833a9c90f admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:52.238112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47ca76-32a8-4072-90c5-5eb833a9c90f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:52.240092 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47ca76-32a8-4072-90c5-5eb833a9c90f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:52.428351 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 984/1991] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:52 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:52.429760 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc6382-5102-4451-961d-a928c30ed879 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:52.441305 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc6382-5102-4451-961d-a928c30ed879 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:52.446042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e4bd7-fa1c-4b5e-b7d4-81aac662395a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:52.446651 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e4bd7-fa1c-4b5e-b7d4-81aac662395a admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:52.446959 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e4bd7-fa1c-4b5e-b7d4-81aac662395a admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:52.447426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9e4bd7-fa1c-4b5e-b7d4-81aac662395a admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:52.448048 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e4bd7-fa1c-4b5e-b7d4-81aac662395a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:52.449674 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9e4bd7-fa1c-4b5e-b7d4-81aac662395a admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:52.460490 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1008/1992] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:04:52.464764 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47ca76-32a8-4072-90c5-5eb833a9c90f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:52.475414 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47ca76-32a8-4072-90c5-5eb833a9c90f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:52.480181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47394fe-bb4a-416d-9c67-98ce75fcd1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:52.480892 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47394fe-bb4a-416d-9c67-98ce75fcd1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:52.486527 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47394fe-bb4a-416d-9c67-98ce75fcd1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:52.486527 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47394fe-bb4a-416d-9c67-98ce75fcd1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:52.486527 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47394fe-bb4a-416d-9c67-98ce75fcd1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:52.486527 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47394fe-bb4a-416d-9c67-98ce75fcd1e3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:52.494527 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 985/1993] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:52.499944 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e4bd7-fa1c-4b5e-b7d4-81aac662395a admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:52.510129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:52.510356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9e4bd7-fa1c-4b5e-b7d4-81aac662395a admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:52.516088 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4355cd-6fb7-4004-87f2-bc74b051b4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:52.516771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4355cd-6fb7-4004-87f2-bc74b051b4a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:52.521319 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4355cd-6fb7-4004-87f2-bc74b051b4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:52.521319 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4355cd-6fb7-4004-87f2-bc74b051b4a1 admin admin] PATH_INFO: `/v3/projects/2b8ebc2b64ea4d948075e862615958f2/users/c5803b6f8c1f4b4ea30345544f4a0f54/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:52.532589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4355cd-6fb7-4004-87f2-bc74b051b4a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b8ebc2b64ea4d948075e862615958f2, user_id=c5803b6f8c1f4b4ea30345544f4a0f54, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:52.535353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4355cd-6fb7-4004-87f2-bc74b051b4a1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:52.540420 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47394fe-bb4a-416d-9c67-98ce75fcd1e3 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:52.542367 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e47394fe-bb4a-416d-9c67-98ce75fcd1e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:52.557155 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47394fe-bb4a-416d-9c67-98ce75fcd1e3 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:52.562692 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91212f89-2edb-4a05-ad5f-6a070748bda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:52.563580 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91212f89-2edb-4a05-ad5f-6a070748bda3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:52.563868 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91212f89-2edb-4a05-ad5f-6a070748bda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:52.564226 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91212f89-2edb-4a05-ad5f-6a070748bda3 admin admin] PATH_INFO: `/v3/projects/1db7ba48dc41461a94b2f49b7df7811c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:52.573770 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91212f89-2edb-4a05-ad5f-6a070748bda3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db7ba48dc41461a94b2f49b7df7811c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:52.573770 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91212f89-2edb-4a05-ad5f-6a070748bda3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:52.620041 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1009/1994] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:52 2022] PUT /identity/v3/projects/2b8ebc2b64ea4d948075e862615958f2/users/c5803b6f8c1f4b4ea30345544f4a0f54/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:52.631114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e555f75-11c9-421a-b2f6-b8be6dcfc739 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:52.631610 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e555f75-11c9-421a-b2f6-b8be6dcfc739 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:52.631890 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e555f75-11c9-421a-b2f6-b8be6dcfc739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:52.670400 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0e555f75-11c9-421a-b2f6-b8be6dcfc739 None None] MFA Rules not processed for user `c5803b6f8c1f4b4ea30345544f4a0f54`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:52.672466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0e555f75-11c9-421a-b2f6-b8be6dcfc739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:52.680817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-91212f89-2edb-4a05-ad5f-6a070748bda3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db7ba48dc41461a94b2f49b7df7811c', 'request_id': 'req-91212f89-2edb-4a05-ad5f-6a070748bda3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:52.691810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-91212f89-2edb-4a05-ad5f-6a070748bda3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db7ba48dc41461a94b2f49b7df7811c', 'request_id': 'req-91212f89-2edb-4a05-ad5f-6a070748bda3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:52.704351 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-91212f89-2edb-4a05-ad5f-6a070748bda3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db7ba48dc41461a94b2f49b7df7811c', 'request_id': 'req-91212f89-2edb-4a05-ad5f-6a070748bda3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:52.753446 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1010/1995] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:04:52.754991 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e555f75-11c9-421a-b2f6-b8be6dcfc739 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:52.758555 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0e555f75-11c9-421a-b2f6-b8be6dcfc739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:52.806802 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-91212f89-2edb-4a05-ad5f-6a070748bda3 admin admin] The token cache is being invalidate because project 1db7ba48dc41461a94b2f49b7df7811c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:52.807109 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-91212f89-2edb-4a05-ad5f-6a070748bda3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:52.807776 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-91212f89-2edb-4a05-ad5f-6a070748bda3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:52.810874 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 986/1996] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:52 2022] DELETE /identity/v3/projects/1db7ba48dc41461a94b2f49b7df7811c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:52.812426 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91212f89-2edb-4a05-ad5f-6a070748bda3 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:52.816122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-91212f89-2edb-4a05-ad5f-6a070748bda3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:52.832024 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e555f75-11c9-421a-b2f6-b8be6dcfc739 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:52.832381 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91212f89-2edb-4a05-ad5f-6a070748bda3 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:52.837272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf56ccd-9a18-470e-a68c-de4a9a030657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:52.837717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edfeab-5059-4468-a9ab-019c5944f19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:52.838085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf56ccd-9a18-470e-a68c-de4a9a030657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:52.838330 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edfeab-5059-4468-a9ab-019c5944f19f admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:52.838448 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf56ccd-9a18-470e-a68c-de4a9a030657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:52.839042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edfeab-5059-4468-a9ab-019c5944f19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:52.839042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edfeab-5059-4468-a9ab-019c5944f19f admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:52.839228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf56ccd-9a18-470e-a68c-de4a9a030657 admin admin] PATH_INFO: `/v3/projects/918674a8094d41f6ad3bf52d5542393a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:52.839710 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edfeab-5059-4468-a9ab-019c5944f19f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:52.840611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf56ccd-9a18-470e-a68c-de4a9a030657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=918674a8094d41f6ad3bf52d5542393a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:52.841606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edfeab-5059-4468-a9ab-019c5944f19f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:52.844017 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf56ccd-9a18-470e-a68c-de4a9a030657 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:52.960385 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 987/1997] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:52 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:52.960385 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edfeab-5059-4468-a9ab-019c5944f19f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:52.964678 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-92edfeab-5059-4468-a9ab-019c5944f19f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:53.008768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-baf56ccd-9a18-470e-a68c-de4a9a030657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '918674a8094d41f6ad3bf52d5542393a', 'request_id': 'req-baf56ccd-9a18-470e-a68c-de4a9a030657'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:53.031385 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-baf56ccd-9a18-470e-a68c-de4a9a030657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '918674a8094d41f6ad3bf52d5542393a', 'request_id': 'req-baf56ccd-9a18-470e-a68c-de4a9a030657'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:53.048163 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edfeab-5059-4468-a9ab-019c5944f19f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:53.121127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563570a-7cc6-4da4-88e2-643a1fdf9896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:53.122048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563570a-7cc6-4da4-88e2-643a1fdf9896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:53.122331 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563570a-7cc6-4da4-88e2-643a1fdf9896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:53.122609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563570a-7cc6-4da4-88e2-643a1fdf9896 admin admin] PATH_INFO: `/v3/users/015d11a9fd164f07b2bb59c5766cdaa0` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:53.124359 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563570a-7cc6-4da4-88e2-643a1fdf9896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=015d11a9fd164f07b2bb59c5766cdaa0)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:53.132887 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563570a-7cc6-4da4-88e2-643a1fdf9896 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:53.133103 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-baf56ccd-9a18-470e-a68c-de4a9a030657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '918674a8094d41f6ad3bf52d5542393a', 'request_id': 'req-baf56ccd-9a18-470e-a68c-de4a9a030657'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:53.142310 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-baf56ccd-9a18-470e-a68c-de4a9a030657 admin admin] The token cache is being invalidate because project 918674a8094d41f6ad3bf52d5542393a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:53.142511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-baf56ccd-9a18-470e-a68c-de4a9a030657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:53.143621 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-baf56ccd-9a18-470e-a68c-de4a9a030657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:53.148493 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1011/1998] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:52 2022] DELETE /identity/v3/projects/918674a8094d41f6ad3bf52d5542393a => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:53.148493 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf56ccd-9a18-470e-a68c-de4a9a030657 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:53.148493 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-baf56ccd-9a18-470e-a68c-de4a9a030657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:53.166164 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf56ccd-9a18-470e-a68c-de4a9a030657 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:53.172373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c48c2-9507-48f0-9068-d3d7e8d48b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:53.173030 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c48c2-9507-48f0-9068-d3d7e8d48b08 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:53.173498 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c48c2-9507-48f0-9068-d3d7e8d48b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:53.173811 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c48c2-9507-48f0-9068-d3d7e8d48b08 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:53.174415 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c48c2-9507-48f0-9068-d3d7e8d48b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:53.176702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c48c2-9507-48f0-9068-d3d7e8d48b08 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:53.385450 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1012/1999] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:53 2022] POST /identity/v3/users => generated 288 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:53.386335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c48c2-9507-48f0-9068-d3d7e8d48b08 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:53.388183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e49c48c2-9507-48f0-9068-d3d7e8d48b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:53.400162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c48c2-9507-48f0-9068-d3d7e8d48b08 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:53.404773 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5ebd3-e593-401d-b1c1-d906ca2ab717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:53.405393 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5ebd3-e593-401d-b1c1-d906ca2ab717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:53.405667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5ebd3-e593-401d-b1c1-d906ca2ab717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:53.405935 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5ebd3-e593-401d-b1c1-d906ca2ab717 admin admin] PATH_INFO: `/v3/users/39635a451ed84bba9c77f743afc2fc7f` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:53.407067 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5ebd3-e593-401d-b1c1-d906ca2ab717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39635a451ed84bba9c77f743afc2fc7f)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:53.408973 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5ebd3-e593-401d-b1c1-d906ca2ab717 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:53.431848 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2563570a-7cc6-4da4-88e2-643a1fdf9896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '015d11a9fd164f07b2bb59c5766cdaa0'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:53.443895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2563570a-7cc6-4da4-88e2-643a1fdf9896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '015d11a9fd164f07b2bb59c5766cdaa0'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:53.444569 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2563570a-7cc6-4da4-88e2-643a1fdf9896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '015d11a9fd164f07b2bb59c5766cdaa0'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:53.566834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2563570a-7cc6-4da4-88e2-643a1fdf9896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '015d11a9fd164f07b2bb59c5766cdaa0'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:53.577040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2563570a-7cc6-4da4-88e2-643a1fdf9896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '015d11a9fd164f07b2bb59c5766cdaa0'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:53.584251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 988/2000] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:52 2022] DELETE /identity/v3/users/015d11a9fd164f07b2bb59c5766cdaa0 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:53.585272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563570a-7cc6-4da4-88e2-643a1fdf9896 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:53.587275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2563570a-7cc6-4da4-88e2-643a1fdf9896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:53.657342 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563570a-7cc6-4da4-88e2-643a1fdf9896 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:53.662352 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb793143-f40c-42e1-9e8d-d0aa493a8512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:53.663054 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb793143-f40c-42e1-9e8d-d0aa493a8512 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:53.663400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb793143-f40c-42e1-9e8d-d0aa493a8512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:53.663676 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb793143-f40c-42e1-9e8d-d0aa493a8512 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:53.664380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb793143-f40c-42e1-9e8d-d0aa493a8512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:53.667823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb793143-f40c-42e1-9e8d-d0aa493a8512 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:53.687814 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 989/2001] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:53.688868 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb793143-f40c-42e1-9e8d-d0aa493a8512 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:53.703437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb793143-f40c-42e1-9e8d-d0aa493a8512 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:53.708527 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e412e32-a3ce-4b9f-ad61-54b107d345b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:53.709192 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4dd5ebd3-e593-401d-b1c1-d906ca2ab717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39635a451ed84bba9c77f743afc2fc7f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:53.709639 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e412e32-a3ce-4b9f-ad61-54b107d345b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:53.709639 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e412e32-a3ce-4b9f-ad61-54b107d345b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:53.710127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e412e32-a3ce-4b9f-ad61-54b107d345b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:53.710492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4dd5ebd3-e593-401d-b1c1-d906ca2ab717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39635a451ed84bba9c77f743afc2fc7f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:53.710892 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e412e32-a3ce-4b9f-ad61-54b107d345b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:53.713110 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e412e32-a3ce-4b9f-ad61-54b107d345b1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:53.732641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 990/2002] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:53.734268 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4dd5ebd3-e593-401d-b1c1-d906ca2ab717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39635a451ed84bba9c77f743afc2fc7f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:53.734574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e412e32-a3ce-4b9f-ad61-54b107d345b1 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:53.745317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e412e32-a3ce-4b9f-ad61-54b107d345b1 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:53.746185 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4dd5ebd3-e593-401d-b1c1-d906ca2ab717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39635a451ed84bba9c77f743afc2fc7f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:53.751374 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0be538-12ff-48b6-992a-1e6c50edec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:53.752248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0be538-12ff-48b6-992a-1e6c50edec93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:53.752611 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0be538-12ff-48b6-992a-1e6c50edec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:53.752942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0be538-12ff-48b6-992a-1e6c50edec93 admin admin] PATH_INFO: `/v3/projects/0df1de99050c4ef8aefa8ec050fd44e8/users/3221f74ed11349cba3cd03173e1500ed/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:53.772371 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0be538-12ff-48b6-992a-1e6c50edec93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df1de99050c4ef8aefa8ec050fd44e8, user_id=3221f74ed11349cba3cd03173e1500ed, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:53.774796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0be538-12ff-48b6-992a-1e6c50edec93 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:53.852479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4dd5ebd3-e593-401d-b1c1-d906ca2ab717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39635a451ed84bba9c77f743afc2fc7f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:53.862522 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1013/2003] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:04:53 2022] DELETE /identity/v3/users/39635a451ed84bba9c77f743afc2fc7f => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:53.929595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:53.936473 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 991/2004] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:53 2022] PUT /identity/v3/projects/0df1de99050c4ef8aefa8ec050fd44e8/users/3221f74ed11349cba3cd03173e1500ed/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:53.947326 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0917f2-7840-43d5-a9fc-3b70598743be None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:53.947921 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0917f2-7840-43d5-a9fc-3b70598743be None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:53.948199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0917f2-7840-43d5-a9fc-3b70598743be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:53.985476 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3c0917f2-7840-43d5-a9fc-3b70598743be None None] MFA Rules not processed for user `3221f74ed11349cba3cd03173e1500ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:53.987034 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3c0917f2-7840-43d5-a9fc-3b70598743be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:54.057509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1014/2005] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:54.062053 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0be538-12ff-48b6-992a-1e6c50edec93 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:54.063870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3e0be538-12ff-48b6-992a-1e6c50edec93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:54.137331 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0be538-12ff-48b6-992a-1e6c50edec93 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:54.143675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0992f84-99dd-475f-9224-9e4add4606ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:54.144538 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0992f84-99dd-475f-9224-9e4add4606ca admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:54.144997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0992f84-99dd-475f-9224-9e4add4606ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:54.145341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0992f84-99dd-475f-9224-9e4add4606ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:54.146327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0992f84-99dd-475f-9224-9e4add4606ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:54.148656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0992f84-99dd-475f-9224-9e4add4606ca admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:54.284079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 992/2006] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:54 2022] POST /identity/v3/projects => generated 375 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:54.289202 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0917f2-7840-43d5-a9fc-3b70598743be None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:54.308837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0917f2-7840-43d5-a9fc-3b70598743be None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:54.310853 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:54.372815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc7957-866b-4c5b-99b6-dc05180a3850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:54.372815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc7957-866b-4c5b-99b6-dc05180a3850 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:54.372815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc7957-866b-4c5b-99b6-dc05180a3850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:54.372815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc7957-866b-4c5b-99b6-dc05180a3850 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:54.373448 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc7957-866b-4c5b-99b6-dc05180a3850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:54.376535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc7957-866b-4c5b-99b6-dc05180a3850 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:54.382693 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0992f84-99dd-475f-9224-9e4add4606ca admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:54.384609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a0992f84-99dd-475f-9224-9e4add4606ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:54.404240 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0992f84-99dd-475f-9224-9e4add4606ca admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:54.412802 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847e3d2-81f6-4980-8de1-b466da682346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:54.413571 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847e3d2-81f6-4980-8de1-b466da682346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:54.413923 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847e3d2-81f6-4980-8de1-b466da682346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:54.414153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847e3d2-81f6-4980-8de1-b466da682346 admin admin] PATH_INFO: `/v3/projects/5af3fdd4ca7e43cf9aeaccdf5755aeef` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:54.415368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847e3d2-81f6-4980-8de1-b466da682346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af3fdd4ca7e43cf9aeaccdf5755aeef)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:54.418358 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847e3d2-81f6-4980-8de1-b466da682346 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:54.483255 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1015/2007] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:54 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:54.484435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc7957-866b-4c5b-99b6-dc05180a3850 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:54.494992 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc7957-866b-4c5b-99b6-dc05180a3850 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:54.500914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf845e5-b4af-47ca-9fec-82bd852c2bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:54.501555 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf845e5-b4af-47ca-9fec-82bd852c2bcf admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:54.501818 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf845e5-b4af-47ca-9fec-82bd852c2bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:54.502093 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf845e5-b4af-47ca-9fec-82bd852c2bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:54.509526 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf845e5-b4af-47ca-9fec-82bd852c2bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:54.509526 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf845e5-b4af-47ca-9fec-82bd852c2bcf admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:54.520211 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1016/2008] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:04:54.521529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf845e5-b4af-47ca-9fec-82bd852c2bcf admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:54.532015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf845e5-b4af-47ca-9fec-82bd852c2bcf admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:54.537137 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4da42d-e106-46b4-bf9a-62547bcbafc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:54.537830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4da42d-e106-46b4-bf9a-62547bcbafc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:54.538094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4da42d-e106-46b4-bf9a-62547bcbafc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:54.538400 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4da42d-e106-46b4-bf9a-62547bcbafc5 admin admin] PATH_INFO: `/v3/projects/771391c632de4ed291a887c1e916407f/users/bc95e332aaea4cffaa2f7eb16b553dc0/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:54.555533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4da42d-e106-46b4-bf9a-62547bcbafc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=771391c632de4ed291a887c1e916407f, user_id=bc95e332aaea4cffaa2f7eb16b553dc0, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:54.559435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4da42d-e106-46b4-bf9a-62547bcbafc5 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:54.569888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e847e3d2-81f6-4980-8de1-b466da682346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af3fdd4ca7e43cf9aeaccdf5755aeef', 'request_id': 'req-e847e3d2-81f6-4980-8de1-b466da682346'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:54.576516 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e847e3d2-81f6-4980-8de1-b466da682346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af3fdd4ca7e43cf9aeaccdf5755aeef', 'request_id': 'req-e847e3d2-81f6-4980-8de1-b466da682346'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:54.586628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e847e3d2-81f6-4980-8de1-b466da682346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af3fdd4ca7e43cf9aeaccdf5755aeef', 'request_id': 'req-e847e3d2-81f6-4980-8de1-b466da682346'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:54.631172 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1017/2009] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:54 2022] PUT /identity/v3/projects/771391c632de4ed291a887c1e916407f/users/bc95e332aaea4cffaa2f7eb16b553dc0/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:54.635095 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4da42d-e106-46b4-bf9a-62547bcbafc5 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:54.653928 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e847e3d2-81f6-4980-8de1-b466da682346 admin admin] The token cache is being invalidate because project 5af3fdd4ca7e43cf9aeaccdf5755aeef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:54.654322 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e847e3d2-81f6-4980-8de1-b466da682346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:54.655145 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e847e3d2-81f6-4980-8de1-b466da682346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:54.663551 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 993/2010] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:54 2022] DELETE /identity/v3/projects/5af3fdd4ca7e43cf9aeaccdf5755aeef => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:54.666376 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbf53c-500f-4e63-a395-19ce4f8484f6 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:54.666685 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbf53c-500f-4e63-a395-19ce4f8484f6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:54.667058 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbf53c-500f-4e63-a395-19ce4f8484f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:54.689146 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-67cbf53c-500f-4e63-a395-19ce4f8484f6 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:54.690583 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-67cbf53c-500f-4e63-a395-19ce4f8484f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:54.703283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4da42d-e106-46b4-bf9a-62547bcbafc5 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:54.708225 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa317f7f-a4c6-4862-99ba-8d32a5d3e54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:54.708846 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa317f7f-a4c6-4862-99ba-8d32a5d3e54f admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:54.709127 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa317f7f-a4c6-4862-99ba-8d32a5d3e54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:54.709417 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa317f7f-a4c6-4862-99ba-8d32a5d3e54f admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:54.710117 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa317f7f-a4c6-4862-99ba-8d32a5d3e54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:54.711986 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa317f7f-a4c6-4862-99ba-8d32a5d3e54f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:54.727215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1018/2011] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:04:54.727215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa317f7f-a4c6-4862-99ba-8d32a5d3e54f admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:54.727215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-aa317f7f-a4c6-4862-99ba-8d32a5d3e54f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:54.740720 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa317f7f-a4c6-4862-99ba-8d32a5d3e54f admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:54.745927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac192a-e15f-4c85-b79e-231d163e4ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:54.746566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac192a-e15f-4c85-b79e-231d163e4ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:54.746881 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac192a-e15f-4c85-b79e-231d163e4ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:54.747167 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac192a-e15f-4c85-b79e-231d163e4ff0 admin admin] PATH_INFO: `/v3/projects/26fb48aa2b3948d88b2fdeeab27d5a05` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:54.749316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac192a-e15f-4c85-b79e-231d163e4ff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26fb48aa2b3948d88b2fdeeab27d5a05)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:54.751752 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac192a-e15f-4c85-b79e-231d163e4ff0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:54.799897 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 994/2012] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:54.800744 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbf53c-500f-4e63-a395-19ce4f8484f6 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:54.807393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-67cbf53c-500f-4e63-a395-19ce4f8484f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:54.820421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbf53c-500f-4e63-a395-19ce4f8484f6 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:54.825181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22433fc2-a7bf-4f1a-95e8-f0db1b5e3861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:54.825870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22433fc2-a7bf-4f1a-95e8-f0db1b5e3861 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:54.826159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22433fc2-a7bf-4f1a-95e8-f0db1b5e3861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:54.826444 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22433fc2-a7bf-4f1a-95e8-f0db1b5e3861 admin admin] PATH_INFO: `/v3/projects/771391c632de4ed291a887c1e916407f/users/bc95e332aaea4cffaa2f7eb16b553dc0/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:54.829558 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22433fc2-a7bf-4f1a-95e8-f0db1b5e3861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=771391c632de4ed291a887c1e916407f, user_id=bc95e332aaea4cffaa2f7eb16b553dc0, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:54.832254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22433fc2-a7bf-4f1a-95e8-f0db1b5e3861 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:54.848189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 995/2013] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:54 2022] PUT /identity/v3/projects/771391c632de4ed291a887c1e916407f/users/bc95e332aaea4cffaa2f7eb16b553dc0/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:54.849652 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe0754-e1ee-4979-bf52-bfffea026e13 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:54.850006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe0754-e1ee-4979-bf52-bfffea026e13 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:54.850337 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe0754-e1ee-4979-bf52-bfffea026e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:54.891438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4abe0754-e1ee-4979-bf52-bfffea026e13 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:54.892644 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4abe0754-e1ee-4979-bf52-bfffea026e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:54.905922 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-60ac192a-e15f-4c85-b79e-231d163e4ff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26fb48aa2b3948d88b2fdeeab27d5a05', 'request_id': 'req-60ac192a-e15f-4c85-b79e-231d163e4ff0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:54.911689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-60ac192a-e15f-4c85-b79e-231d163e4ff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26fb48aa2b3948d88b2fdeeab27d5a05', 'request_id': 'req-60ac192a-e15f-4c85-b79e-231d163e4ff0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:54.960983 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 996/2014] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:54.962193 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e4664-5ae0-41d8-bca3-3b27e7645750 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:54.962904 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e4664-5ae0-41d8-bca3-3b27e7645750 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:54.963188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e4664-5ae0-41d8-bca3-3b27e7645750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:54.984205 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-60ac192a-e15f-4c85-b79e-231d163e4ff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26fb48aa2b3948d88b2fdeeab27d5a05', 'request_id': 'req-60ac192a-e15f-4c85-b79e-231d163e4ff0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:54.996396 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-247e4664-5ae0-41d8-bca3-3b27e7645750 None None] MFA Rules not processed for user `bc95e332aaea4cffaa2f7eb16b553dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:55.005768 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-247e4664-5ae0-41d8-bca3-3b27e7645750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:55.011970 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-60ac192a-e15f-4c85-b79e-231d163e4ff0 admin admin] The token cache is being invalidate because project 26fb48aa2b3948d88b2fdeeab27d5a05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:04:55.012157 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-60ac192a-e15f-4c85-b79e-231d163e4ff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:55.015163 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-60ac192a-e15f-4c85-b79e-231d163e4ff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:04:55.024292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1019/2015] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:04:54 2022] DELETE /identity/v3/projects/26fb48aa2b3948d88b2fdeeab27d5a05 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:55.024292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac192a-e15f-4c85-b79e-231d163e4ff0 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:55.036207 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-60ac192a-e15f-4c85-b79e-231d163e4ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:55.052989 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac192a-e15f-4c85-b79e-231d163e4ff0 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:55.059323 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba30e9-6450-4cbb-a813-d1fdf450c41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:55.060804 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba30e9-6450-4cbb-a813-d1fdf450c41f admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:55.060804 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba30e9-6450-4cbb-a813-d1fdf450c41f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:55.060804 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba30e9-6450-4cbb-a813-d1fdf450c41f admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:55.061723 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba30e9-6450-4cbb-a813-d1fdf450c41f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:04:55.062033 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba30e9-6450-4cbb-a813-d1fdf450c41f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:55.063970 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba30e9-6450-4cbb-a813-d1fdf450c41f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:55.082595 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1020/2016] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:04:55.084077 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83f68c-09c6-4108-a58b-5a1ea35bd2c0 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:55.084414 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83f68c-09c6-4108-a58b-5a1ea35bd2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:55.084743 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83f68c-09c6-4108-a58b-5a1ea35bd2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:55.109214 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-7e83f68c-09c6-4108-a58b-5a1ea35bd2c0 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:55.109602 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 997/2017] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:55.110613 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e4664-5ae0-41d8-bca3-3b27e7645750 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:55.111383 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7e83f68c-09c6-4108-a58b-5a1ea35bd2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:55.124301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e4664-5ae0-41d8-bca3-3b27e7645750 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:55.130749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7e705-31d1-4f45-beb1-2f11d6f81fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:55.131611 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7e705-31d1-4f45-beb1-2f11d6f81fdf admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:55.131738 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7e705-31d1-4f45-beb1-2f11d6f81fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:55.132177 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1021/2018] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:55.132384 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7e705-31d1-4f45-beb1-2f11d6f81fdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:55.132800 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7e705-31d1-4f45-beb1-2f11d6f81fdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:55.134777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7e705-31d1-4f45-beb1-2f11d6f81fdf admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:55.141747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83f68c-09c6-4108-a58b-5a1ea35bd2c0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:55.142970 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7e83f68c-09c6-4108-a58b-5a1ea35bd2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:55.204801 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83f68c-09c6-4108-a58b-5a1ea35bd2c0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:55.208637 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f362e-88eb-459f-b753-f64ab63642b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:55.209256 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f362e-88eb-459f-b753-f64ab63642b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:55.209540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f362e-88eb-459f-b753-f64ab63642b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:55.209839 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f362e-88eb-459f-b753-f64ab63642b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:55.211898 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8d1f362e-88eb-459f-b753-f64ab63642b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:55.270567 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f362e-88eb-459f-b753-f64ab63642b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:55.272002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f362e-88eb-459f-b753-f64ab63642b8 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:55.281295 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1022/2019] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:55.282613 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a7775-fef3-4665-b615-d68cc298b0f9 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:55.282934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a7775-fef3-4665-b615-d68cc298b0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:55.283207 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a7775-fef3-4665-b615-d68cc298b0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:55.305992 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-988a7775-fef3-4665-b615-d68cc298b0f9 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:55.307266 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-988a7775-fef3-4665-b615-d68cc298b0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:55.315760 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1023/2020] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:55.320390 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a7775-fef3-4665-b615-d68cc298b0f9 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:55.333399 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a7775-fef3-4665-b615-d68cc298b0f9 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:55.336896 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e048694-b9a8-4963-b833-9b737376a763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:55.337512 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e048694-b9a8-4963-b833-9b737376a763 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:55.337790 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e048694-b9a8-4963-b833-9b737376a763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:55.338060 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e048694-b9a8-4963-b833-9b737376a763 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:55.338717 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e048694-b9a8-4963-b833-9b737376a763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:04:55.339057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e048694-b9a8-4963-b833-9b737376a763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:55.340650 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e048694-b9a8-4963-b833-9b737376a763 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:55.357720 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1024/2021] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:04:55.368002 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 998/2022] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:55 2022] POST /identity/v3/projects => generated 379 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:55.371925 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7e705-31d1-4f45-beb1-2f11d6f81fdf admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:55.375698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e048694-b9a8-4963-b833-9b737376a763 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:55.398793 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e048694-b9a8-4963-b833-9b737376a763 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:55.466068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7e705-31d1-4f45-beb1-2f11d6f81fdf admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:55.470977 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b257770-0687-4424-963e-413f09df4dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:55.471958 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b257770-0687-4424-963e-413f09df4dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:55.471958 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b257770-0687-4424-963e-413f09df4dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:55.472391 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b257770-0687-4424-963e-413f09df4dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:55.473422 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b257770-0687-4424-963e-413f09df4dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:55.474988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589b5d3-d8b7-4975-b18b-c3d20fafef08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:55.475147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b257770-0687-4424-963e-413f09df4dc8 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:55.475797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589b5d3-d8b7-4975-b18b-c3d20fafef08 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:55.476052 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589b5d3-d8b7-4975-b18b-c3d20fafef08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:55.476333 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589b5d3-d8b7-4975-b18b-c3d20fafef08 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:55.476991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589b5d3-d8b7-4975-b18b-c3d20fafef08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:55.479010 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b589b5d3-d8b7-4975-b18b-c3d20fafef08 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:55.648666 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 999/2023] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:55 2022] POST /identity/v3/users => generated 290 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:04:55.649942 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1025/2024] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:55 2022] POST /identity/v3/projects => generated 375 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:55.653116 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589b5d3-d8b7-4975-b18b-c3d20fafef08 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:55.654073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b257770-0687-4424-963e-413f09df4dc8 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:55.664124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589b5d3-d8b7-4975-b18b-c3d20fafef08 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:55.728382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b257770-0687-4424-963e-413f09df4dc8 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:55.732996 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc73e10-2a2c-49fa-af59-e7fd947ca81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:55.733972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc73e10-2a2c-49fa-af59-e7fd947ca81b admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:55.734310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc73e10-2a2c-49fa-af59-e7fd947ca81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:55.734575 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed87e9-24c8-4d34-b4eb-060ec044d65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:55.734692 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc73e10-2a2c-49fa-af59-e7fd947ca81b admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:55.735221 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed87e9-24c8-4d34-b4eb-060ec044d65d admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:55.739196 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc73e10-2a2c-49fa-af59-e7fd947ca81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:55.739485 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed87e9-24c8-4d34-b4eb-060ec044d65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:55.739485 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed87e9-24c8-4d34-b4eb-060ec044d65d admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:55.739485 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed87e9-24c8-4d34-b4eb-060ec044d65d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:55.739694 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc73e10-2a2c-49fa-af59-e7fd947ca81b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:55.739765 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed87e9-24c8-4d34-b4eb-060ec044d65d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:55.749135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1000/2025] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:55.753137 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc73e10-2a2c-49fa-af59-e7fd947ca81b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:55.762660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc73e10-2a2c-49fa-af59-e7fd947ca81b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:55.768206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84c4cb-1dee-4a3b-9425-05141ac0be88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:55.768793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84c4cb-1dee-4a3b-9425-05141ac0be88 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:55.769071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84c4cb-1dee-4a3b-9425-05141ac0be88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:55.769343 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84c4cb-1dee-4a3b-9425-05141ac0be88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:55.773608 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84c4cb-1dee-4a3b-9425-05141ac0be88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:55.773608 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84c4cb-1dee-4a3b-9425-05141ac0be88 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:55.782856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1001/2026] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:04:55.787077 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84c4cb-1dee-4a3b-9425-05141ac0be88 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:55.796450 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:55.802413 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84c4cb-1dee-4a3b-9425-05141ac0be88 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:55.805827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74948b-6744-4018-9d15-4cc464cb39e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:55.806494 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74948b-6744-4018-9d15-4cc464cb39e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:55.806774 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74948b-6744-4018-9d15-4cc464cb39e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:55.807078 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74948b-6744-4018-9d15-4cc464cb39e3 admin admin] PATH_INFO: `/v3/projects/d875dc51ec2a4c0689db83c00f434cf9/users/6760bfd1a740430998bb105c8a2a1562/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:55.822109 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74948b-6744-4018-9d15-4cc464cb39e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d875dc51ec2a4c0689db83c00f434cf9, user_id=6760bfd1a740430998bb105c8a2a1562, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:55.824907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74948b-6744-4018-9d15-4cc464cb39e3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:55.860011 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1026/2027] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:55 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:55.864419 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed87e9-24c8-4d34-b4eb-060ec044d65d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:55.874080 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed87e9-24c8-4d34-b4eb-060ec044d65d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:55.878897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a0c65-3bc7-4c7f-bf18-b8f291440bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:55.879521 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a0c65-3bc7-4c7f-bf18-b8f291440bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:55.879801 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a0c65-3bc7-4c7f-bf18-b8f291440bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:55.880184 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a0c65-3bc7-4c7f-bf18-b8f291440bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:55.880856 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a0c65-3bc7-4c7f-bf18-b8f291440bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:55.882453 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a0c65-3bc7-4c7f-bf18-b8f291440bf1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:55.893907 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1027/2028] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:04:55.897774 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a0c65-3bc7-4c7f-bf18-b8f291440bf1 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:55.909385 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a0c65-3bc7-4c7f-bf18-b8f291440bf1 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:55.914889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323474fd-86c2-42b6-8638-edf7be247662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:55.916556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323474fd-86c2-42b6-8638-edf7be247662 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:55.916556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323474fd-86c2-42b6-8638-edf7be247662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:55.916556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323474fd-86c2-42b6-8638-edf7be247662 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:55.919181 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323474fd-86c2-42b6-8638-edf7be247662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:55.920944 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323474fd-86c2-42b6-8638-edf7be247662 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:55.932823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1028/2029] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:04:55.932983 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1002/2030] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:55 2022] PUT /identity/v3/projects/d875dc51ec2a4c0689db83c00f434cf9/users/6760bfd1a740430998bb105c8a2a1562/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:04:55.937494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323474fd-86c2-42b6-8638-edf7be247662 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:55.946196 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051f730-df14-4f83-b11c-e5f4c1e4cbec None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:55.946485 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051f730-df14-4f83-b11c-e5f4c1e4cbec None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:55.946820 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051f730-df14-4f83-b11c-e5f4c1e4cbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:55.948162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323474fd-86c2-42b6-8638-edf7be247662 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:55.994783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4051f730-df14-4f83-b11c-e5f4c1e4cbec None None] MFA Rules not processed for user `6760bfd1a740430998bb105c8a2a1562`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:55.996452 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4051f730-df14-4f83-b11c-e5f4c1e4cbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:56.003960 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:56.079626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5aa36-4b6d-44c7-b4db-f5ddbebcfa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:56.080745 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5aa36-4b6d-44c7-b4db-f5ddbebcfa64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:56.081106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5aa36-4b6d-44c7-b4db-f5ddbebcfa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:56.081290 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5aa36-4b6d-44c7-b4db-f5ddbebcfa64 admin admin] PATH_INFO: `/v3/projects/6690aadfb55846dca65551c04bb37573/users/ad590ae81dc94159b85db697ab842f7c/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:56.110023 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5aa36-4b6d-44c7-b4db-f5ddbebcfa64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6690aadfb55846dca65551c04bb37573, user_id=ad590ae81dc94159b85db697ab842f7c, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:56.113003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5aa36-4b6d-44c7-b4db-f5ddbebcfa64 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:56.136387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1003/2031] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:04:56.144135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051f730-df14-4f83-b11c-e5f4c1e4cbec None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:56.154826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051f730-df14-4f83-b11c-e5f4c1e4cbec None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:56.159582 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f513d3-051c-450a-bca6-f97641513a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:56.160722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f513d3-051c-450a-bca6-f97641513a86 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:56.160722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f513d3-051c-450a-bca6-f97641513a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:56.160898 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f513d3-051c-450a-bca6-f97641513a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:56.161590 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f513d3-051c-450a-bca6-f97641513a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:56.163541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f513d3-051c-450a-bca6-f97641513a86 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:56.357201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1004/2033] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:56 2022] POST /identity/v3/projects => generated 377 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:56.360051 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1029/2033] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:55 2022] PUT /identity/v3/projects/6690aadfb55846dca65551c04bb37573/users/ad590ae81dc94159b85db697ab842f7c/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:56.362619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5aa36-4b6d-44c7-b4db-f5ddbebcfa64 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:56.363650 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe27052-6439-43de-95b4-f9f42488abc0 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:56.364111 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe27052-6439-43de-95b4-f9f42488abc0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:56.364853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe27052-6439-43de-95b4-f9f42488abc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:56.397189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-dfe27052-6439-43de-95b4-f9f42488abc0 None None] MFA Rules not processed for user `ad590ae81dc94159b85db697ab842f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:56.398400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-dfe27052-6439-43de-95b4-f9f42488abc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:56.434671 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5aa36-4b6d-44c7-b4db-f5ddbebcfa64 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:56.468275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1005/2034] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:56.472618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe27052-6439-43de-95b4-f9f42488abc0 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:56.505305 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94b4e9-cddb-4c19-837c-b5f137d8141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:56.505917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94b4e9-cddb-4c19-837c-b5f137d8141d admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:56.506191 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94b4e9-cddb-4c19-837c-b5f137d8141d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:56.506463 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94b4e9-cddb-4c19-837c-b5f137d8141d admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:56.507114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94b4e9-cddb-4c19-837c-b5f137d8141d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:56.509344 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94b4e9-cddb-4c19-837c-b5f137d8141d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:56.543588 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe27052-6439-43de-95b4-f9f42488abc0 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:56.549257 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494b676-30f2-46c9-9242-860f00368109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:56.549882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494b676-30f2-46c9-9242-860f00368109 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:56.550167 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494b676-30f2-46c9-9242-860f00368109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:56.550446 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494b676-30f2-46c9-9242-860f00368109 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:56.551112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494b676-30f2-46c9-9242-860f00368109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:56.553110 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494b676-30f2-46c9-9242-860f00368109 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:56.606848 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1030/2035] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:56 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:56.611398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94b4e9-cddb-4c19-837c-b5f137d8141d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:56.620962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94b4e9-cddb-4c19-837c-b5f137d8141d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:56.626294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a785978-62ce-4001-ac5e-56c681f26eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:56.626902 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a785978-62ce-4001-ac5e-56c681f26eef admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:56.627183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a785978-62ce-4001-ac5e-56c681f26eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:56.627453 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a785978-62ce-4001-ac5e-56c681f26eef admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:56.628102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a785978-62ce-4001-ac5e-56c681f26eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:56.629763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a785978-62ce-4001-ac5e-56c681f26eef admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:56.639812 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1031/2036] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:04:56.643460 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a785978-62ce-4001-ac5e-56c681f26eef admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:56.653457 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a785978-62ce-4001-ac5e-56c681f26eef admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:56.658837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c73615-1172-45ad-8314-9fea5ed42834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:56.659439 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c73615-1172-45ad-8314-9fea5ed42834 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:56.659718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c73615-1172-45ad-8314-9fea5ed42834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:56.660021 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c73615-1172-45ad-8314-9fea5ed42834 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:56.660691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c73615-1172-45ad-8314-9fea5ed42834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:56.662264 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c73615-1172-45ad-8314-9fea5ed42834 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:56.680885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1032/2037] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:04:56.681529 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1006/2038] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:56 2022] POST /identity/v3/projects => generated 373 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:04:56.681999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c73615-1172-45ad-8314-9fea5ed42834 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:56.682526 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494b676-30f2-46c9-9242-860f00368109 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:56.695895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c73615-1172-45ad-8314-9fea5ed42834 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:56.756808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494b676-30f2-46c9-9242-860f00368109 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:56.762551 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67ad51-560f-4f7d-9342-90450bc05ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:56.763259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67ad51-560f-4f7d-9342-90450bc05ced admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:56.763543 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67ad51-560f-4f7d-9342-90450bc05ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:56.763963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67ad51-560f-4f7d-9342-90450bc05ced admin admin] PATH_INFO: `/v3/projects/f670d95db13d4c939e227a00f27bb137/users/e877401e56b94027bd4e710f683b6b63/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:56.781033 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c9825-10cd-4655-aad8-28be2ff17f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:56.782400 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c9825-10cd-4655-aad8-28be2ff17f6a admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:56.782946 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c9825-10cd-4655-aad8-28be2ff17f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:56.783056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c9825-10cd-4655-aad8-28be2ff17f6a admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:56.783966 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c9825-10cd-4655-aad8-28be2ff17f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:56.785767 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67ad51-560f-4f7d-9342-90450bc05ced admin admin] RBAC: Authorizing `identity:create_grant(project_id=f670d95db13d4c939e227a00f27bb137, user_id=e877401e56b94027bd4e710f683b6b63, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:56.785995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c9825-10cd-4655-aad8-28be2ff17f6a admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:56.788584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67ad51-560f-4f7d-9342-90450bc05ced admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:56.916774 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1033/2039] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:56 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:04:56.916962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1007/2040] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:56 2022] PUT /identity/v3/projects/f670d95db13d4c939e227a00f27bb137/users/e877401e56b94027bd4e710f683b6b63/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:56.922526 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c9825-10cd-4655-aad8-28be2ff17f6a admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:56.928412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f381d-50c1-460c-abb1-dfac5f64d866 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:56.928702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f381d-50c1-460c-abb1-dfac5f64d866 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:56.928982 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f381d-50c1-460c-abb1-dfac5f64d866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:56.932907 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c9825-10cd-4655-aad8-28be2ff17f6a admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:56.956019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-670f381d-50c1-460c-abb1-dfac5f64d866 None None] MFA Rules not processed for user `e877401e56b94027bd4e710f683b6b63`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:56.957316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-670f381d-50c1-460c-abb1-dfac5f64d866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:56.969266 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:56.992328 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2d49d-f77f-4fee-99d1-8d5d2c41adbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:56.992915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2d49d-f77f-4fee-99d1-8d5d2c41adbc admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:56.993195 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2d49d-f77f-4fee-99d1-8d5d2c41adbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:56.993516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2d49d-f77f-4fee-99d1-8d5d2c41adbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:56.994206 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2d49d-f77f-4fee-99d1-8d5d2c41adbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:56.995828 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2d49d-f77f-4fee-99d1-8d5d2c41adbc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:57.006515 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1034/2041] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:57.010722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2d49d-f77f-4fee-99d1-8d5d2c41adbc admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:57.026696 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2d49d-f77f-4fee-99d1-8d5d2c41adbc admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:57.034160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c121f-43d0-4ef2-83bc-c53ef66bac93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:57.034693 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1008/2042] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:04:57.036803 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c121f-43d0-4ef2-83bc-c53ef66bac93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:57.037090 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c121f-43d0-4ef2-83bc-c53ef66bac93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:57.039564 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c121f-43d0-4ef2-83bc-c53ef66bac93 admin admin] PATH_INFO: `/v3/projects/9e7eec922b5c455595a69493096941ee/users/544aeb424ee94a2986be1f774583549b/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:57.042463 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f381d-50c1-460c-abb1-dfac5f64d866 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:57.055084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f381d-50c1-460c-abb1-dfac5f64d866 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:57.058030 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c121f-43d0-4ef2-83bc-c53ef66bac93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e7eec922b5c455595a69493096941ee, user_id=544aeb424ee94a2986be1f774583549b, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:57.061037 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f1bc5-4aa6-4b50-90a7-a43cc638293f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:57.061037 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f1bc5-4aa6-4b50-90a7-a43cc638293f admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:57.061300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c121f-43d0-4ef2-83bc-c53ef66bac93 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:57.061380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f1bc5-4aa6-4b50-90a7-a43cc638293f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:57.061380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f1bc5-4aa6-4b50-90a7-a43cc638293f admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:57.062402 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f1bc5-4aa6-4b50-90a7-a43cc638293f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:57.064376 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f1bc5-4aa6-4b50-90a7-a43cc638293f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:57.178718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1035/2043] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:57 2022] PUT /identity/v3/projects/9e7eec922b5c455595a69493096941ee/users/544aeb424ee94a2986be1f774583549b/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:57.182040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1009/2044] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:04:57 2022] POST /identity/v3/projects => generated 379 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:04:57.182919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c121f-43d0-4ef2-83bc-c53ef66bac93 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:57.186201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f1bc5-4aa6-4b50-90a7-a43cc638293f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:57.247054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c121f-43d0-4ef2-83bc-c53ef66bac93 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:57.252096 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3292c-fada-4c3f-8e8c-d30fdb778156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:57.252704 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3292c-fada-4c3f-8e8c-d30fdb778156 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:57.252987 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3292c-fada-4c3f-8e8c-d30fdb778156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:57.253262 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3292c-fada-4c3f-8e8c-d30fdb778156 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:57.253912 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3292c-fada-4c3f-8e8c-d30fdb778156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:57.255053 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f1bc5-4aa6-4b50-90a7-a43cc638293f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:57.255670 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3292c-fada-4c3f-8e8c-d30fdb778156 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:57.260520 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f074eea-5e49-4dbd-809d-2ff21ffb5e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:57.261143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f074eea-5e49-4dbd-809d-2ff21ffb5e10 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:57.261448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f074eea-5e49-4dbd-809d-2ff21ffb5e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:57.261718 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f074eea-5e49-4dbd-809d-2ff21ffb5e10 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:57.262377 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f074eea-5e49-4dbd-809d-2ff21ffb5e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:57.264877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f074eea-5e49-4dbd-809d-2ff21ffb5e10 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:57.266389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1036/2045] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:04:57.270854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3292c-fada-4c3f-8e8c-d30fdb778156 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:57.281070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3292c-fada-4c3f-8e8c-d30fdb778156 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:57.285907 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25847fd4-49a7-4a46-aebf-7b213e883c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:57.286549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25847fd4-49a7-4a46-aebf-7b213e883c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:57.287275 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25847fd4-49a7-4a46-aebf-7b213e883c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:57.287275 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25847fd4-49a7-4a46-aebf-7b213e883c5a admin admin] PATH_INFO: `/v3/projects/9e7eec922b5c455595a69493096941ee/users/544aeb424ee94a2986be1f774583549b/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:57.289188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25847fd4-49a7-4a46-aebf-7b213e883c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e7eec922b5c455595a69493096941ee, user_id=544aeb424ee94a2986be1f774583549b, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:57.291946 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25847fd4-49a7-4a46-aebf-7b213e883c5a admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:57.302334 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1037/2046] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:57 2022] PUT /identity/v3/projects/9e7eec922b5c455595a69493096941ee/users/544aeb424ee94a2986be1f774583549b/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:57.312390 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5048a-ff2e-4d76-aada-f15575b768a5 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:57.312687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5048a-ff2e-4d76-aada-f15575b768a5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:57.312947 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5048a-ff2e-4d76-aada-f15575b768a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:57.340973 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-16d5048a-ff2e-4d76-aada-f15575b768a5 None None] MFA Rules not processed for user `544aeb424ee94a2986be1f774583549b`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:57.342860 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-16d5048a-ff2e-4d76-aada-f15575b768a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:57.410463 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1038/2047] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:04:57.422728 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5048a-ff2e-4d76-aada-f15575b768a5 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:57.459868 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1010/2048] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:04:57 2022] POST /identity/v3/users => generated 296 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:04:57.468849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f074eea-5e49-4dbd-809d-2ff21ffb5e10 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:57.478965 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5048a-ff2e-4d76-aada-f15575b768a5 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:57.480414 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f074eea-5e49-4dbd-809d-2ff21ffb5e10 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:57.482625 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857672b-470a-42fd-8a09-f10d1eea1290 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:57.483231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857672b-470a-42fd-8a09-f10d1eea1290 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:57.483536 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857672b-470a-42fd-8a09-f10d1eea1290 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:57.483788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1857672b-470a-42fd-8a09-f10d1eea1290 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:57.542814 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c811a-e71e-4d76-8b26-babd8d1505e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:57.543443 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c811a-e71e-4d76-8b26-babd8d1505e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:57.543721 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c811a-e71e-4d76-8b26-babd8d1505e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:57.544043 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c811a-e71e-4d76-8b26-babd8d1505e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:57.544804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c811a-e71e-4d76-8b26-babd8d1505e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:57.546679 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c811a-e71e-4d76-8b26-babd8d1505e9 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:57.549826 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857672b-470a-42fd-8a09-f10d1eea1290 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:57.551477 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1857672b-470a-42fd-8a09-f10d1eea1290 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:57.557320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1011/2049] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:57.561918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1039/2050] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:04:57.565327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c811a-e71e-4d76-8b26-babd8d1505e9 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:57.577592 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c811a-e71e-4d76-8b26-babd8d1505e9 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:57.585738 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d933fb4-9d89-4b9a-830c-55ec9805b592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:57.586421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d933fb4-9d89-4b9a-830c-55ec9805b592 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:57.586709 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d933fb4-9d89-4b9a-830c-55ec9805b592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:57.587026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d933fb4-9d89-4b9a-830c-55ec9805b592 admin admin] PATH_INFO: `/v3/projects/a98d2ca63ac0495388a225c5334a56ea/users/0dc6766ff4e144f3af65c242612b8739/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:57.607049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d933fb4-9d89-4b9a-830c-55ec9805b592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98d2ca63ac0495388a225c5334a56ea, user_id=0dc6766ff4e144f3af65c242612b8739, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:57.610107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d933fb4-9d89-4b9a-830c-55ec9805b592 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:57.687855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1012/2051] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:57 2022] PUT /identity/v3/projects/a98d2ca63ac0495388a225c5334a56ea/users/0dc6766ff4e144f3af65c242612b8739/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:57.691922 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857672b-470a-42fd-8a09-f10d1eea1290 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:57.703664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1857672b-470a-42fd-8a09-f10d1eea1290 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:57.767641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf78f57-ec87-46b7-b0d8-428e856187d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:57.768285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf78f57-ec87-46b7-b0d8-428e856187d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:57.768569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf78f57-ec87-46b7-b0d8-428e856187d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:57.768847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf78f57-ec87-46b7-b0d8-428e856187d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:57.769849 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf78f57-ec87-46b7-b0d8-428e856187d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:57.771699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf78f57-ec87-46b7-b0d8-428e856187d6 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:57.786396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1040/2052] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:04:57.786937 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d933fb4-9d89-4b9a-830c-55ec9805b592 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:57.797276 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d933fb4-9d89-4b9a-830c-55ec9805b592 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:57.802349 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e2e08-7f7b-4317-a7dd-2b44c6eb92d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:57.803043 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e2e08-7f7b-4317-a7dd-2b44c6eb92d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:57.803326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e2e08-7f7b-4317-a7dd-2b44c6eb92d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:57.803629 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e2e08-7f7b-4317-a7dd-2b44c6eb92d8 admin admin] PATH_INFO: `/v3/projects/a98d2ca63ac0495388a225c5334a56ea/users/0dc6766ff4e144f3af65c242612b8739/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:57.805695 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e2e08-7f7b-4317-a7dd-2b44c6eb92d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98d2ca63ac0495388a225c5334a56ea, user_id=0dc6766ff4e144f3af65c242612b8739, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:57.808429 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e2e08-7f7b-4317-a7dd-2b44c6eb92d8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:57.823185 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1013/2053] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:04:57 2022] PUT /identity/v3/projects/a98d2ca63ac0495388a225c5334a56ea/users/0dc6766ff4e144f3af65c242612b8739/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:04:57.834838 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afc691-6b37-43fb-a024-fd995c09e171 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:57.835112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afc691-6b37-43fb-a024-fd995c09e171 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:57.835342 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afc691-6b37-43fb-a024-fd995c09e171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:57.867123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-55afc691-6b37-43fb-a024-fd995c09e171 None None] MFA Rules not processed for user `0dc6766ff4e144f3af65c242612b8739`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:04:57.868450 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-55afc691-6b37-43fb-a024-fd995c09e171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:57.911006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:57.949165 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1041/2054] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:04:57 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:04:57.964070 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e2e08-7f7b-4317-a7dd-2b44c6eb92d8 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:57.965991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d52e2e08-7f7b-4317-a7dd-2b44c6eb92d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:58.025057 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e2e08-7f7b-4317-a7dd-2b44c6eb92d8 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:58.029312 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4488ae-ac99-4f9b-afec-0aee0ebbf2d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:58.030786 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4488ae-ac99-4f9b-afec-0aee0ebbf2d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:58.031317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4488ae-ac99-4f9b-afec-0aee0ebbf2d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:58.031674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4488ae-ac99-4f9b-afec-0aee0ebbf2d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:58.041539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4488ae-ac99-4f9b-afec-0aee0ebbf2d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:58.043030 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4488ae-ac99-4f9b-afec-0aee0ebbf2d7 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:58.053165 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1014/2055] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:58.488387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afc691-6b37-43fb-a024-fd995c09e171 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:58.497947 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afc691-6b37-43fb-a024-fd995c09e171 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:58.502542 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc919d-7c12-48fd-8dfc-b5ddeac940a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:58.502972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc919d-7c12-48fd-8dfc-b5ddeac940a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:58.503282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc919d-7c12-48fd-8dfc-b5ddeac940a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:58.503557 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc919d-7c12-48fd-8dfc-b5ddeac940a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:58.559545 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc919d-7c12-48fd-8dfc-b5ddeac940a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:58.561546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc919d-7c12-48fd-8dfc-b5ddeac940a8 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:58.568086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:58.576048 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1042/2056] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:04:59.145248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4488ae-ac99-4f9b-afec-0aee0ebbf2d7 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:04:59.160260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4488ae-ac99-4f9b-afec-0aee0ebbf2d7 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:04:59.160260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bad52-8746-48ac-9e41-b93dcd5a3dc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:04:59.160260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bad52-8746-48ac-9e41-b93dcd5a3dc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:04:59.160260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bad52-8746-48ac-9e41-b93dcd5a3dc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:04:59.160653 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bad52-8746-48ac-9e41-b93dcd5a3dc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:04:59.161375 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-095bad52-8746-48ac-9e41-b93dcd5a3dc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:04:59.242142 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bad52-8746-48ac-9e41-b93dcd5a3dc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:04:59.243606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095bad52-8746-48ac-9e41-b93dcd5a3dc0 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:04:59.253028 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1015/2057] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:04:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:00.110335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:00.458579 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:01.229687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc919d-7c12-48fd-8dfc-b5ddeac940a8 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:01.241470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc919d-7c12-48fd-8dfc-b5ddeac940a8 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:01.245573 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83d837-9064-42de-8ac1-e82ffa4b35fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:01.246260 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83d837-9064-42de-8ac1-e82ffa4b35fd service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:01.246548 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83d837-9064-42de-8ac1-e82ffa4b35fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:01.246924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83d837-9064-42de-8ac1-e82ffa4b35fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:01.259119 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:01.312694 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83d837-9064-42de-8ac1-e82ffa4b35fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:01.314151 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83d837-9064-42de-8ac1-e82ffa4b35fd service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:01.324312 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1043/2058] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:02.042437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bad52-8746-48ac-9e41-b93dcd5a3dc0 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:02.146586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bad52-8746-48ac-9e41-b93dcd5a3dc0 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:02.155744 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c440104-ee0b-4938-9c10-e7e796ea65c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:02.156660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c440104-ee0b-4938-9c10-e7e796ea65c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:02.157105 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c440104-ee0b-4938-9c10-e7e796ea65c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:02.157545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c440104-ee0b-4938-9c10-e7e796ea65c5 admin admin] PATH_INFO: `/v3/users/ad590ae81dc94159b85db697ab842f7c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:02.158962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c440104-ee0b-4938-9c10-e7e796ea65c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad590ae81dc94159b85db697ab842f7c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:02.161465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c440104-ee0b-4938-9c10-e7e796ea65c5 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:02.505493 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1c440104-ee0b-4938-9c10-e7e796ea65c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad590ae81dc94159b85db697ab842f7c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:02.531907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1c440104-ee0b-4938-9c10-e7e796ea65c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad590ae81dc94159b85db697ab842f7c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:02.532812 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1c440104-ee0b-4938-9c10-e7e796ea65c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad590ae81dc94159b85db697ab842f7c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:02.544798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:02.606386 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1c440104-ee0b-4938-9c10-e7e796ea65c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad590ae81dc94159b85db697ab842f7c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:02.614942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1c440104-ee0b-4938-9c10-e7e796ea65c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad590ae81dc94159b85db697ab842f7c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:02.628070 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1016/2059] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:02 2022] DELETE /identity/v3/users/ad590ae81dc94159b85db697ab842f7c => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:02.632628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bff9a1-4000-40e5-933b-87bfcd79e74e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:02.632937 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bff9a1-4000-40e5-933b-87bfcd79e74e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:02.633485 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bff9a1-4000-40e5-933b-87bfcd79e74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:02.657401 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a2bff9a1-4000-40e5-933b-87bfcd79e74e None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:02.661348 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a2bff9a1-4000-40e5-933b-87bfcd79e74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:02.731238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1044/2060] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:02.747543 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c440104-ee0b-4938-9c10-e7e796ea65c5 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:02.754819 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1c440104-ee0b-4938-9c10-e7e796ea65c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:02.818711 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c440104-ee0b-4938-9c10-e7e796ea65c5 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:02.821949 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a889e-d674-4a20-a607-f32ef3b64856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:02.822570 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a889e-d674-4a20-a607-f32ef3b64856 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:02.822888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a889e-d674-4a20-a607-f32ef3b64856 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:02.823170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a889e-d674-4a20-a607-f32ef3b64856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:02.832732 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a889e-d674-4a20-a607-f32ef3b64856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:02.834179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a889e-d674-4a20-a607-f32ef3b64856 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:02.848676 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1017/2061] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:03.281020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:03.363512 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bff9a1-4000-40e5-933b-87bfcd79e74e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:03.365146 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a2bff9a1-4000-40e5-933b-87bfcd79e74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:03.381008 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bff9a1-4000-40e5-933b-87bfcd79e74e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:03.386278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e471153-b87d-45c2-98b3-4d8d5fbd440d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:03.387364 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e471153-b87d-45c2-98b3-4d8d5fbd440d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:03.387976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e471153-b87d-45c2-98b3-4d8d5fbd440d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:03.389871 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e471153-b87d-45c2-98b3-4d8d5fbd440d admin admin] PATH_INFO: `/v3/projects/6690aadfb55846dca65551c04bb37573` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:03.391561 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e471153-b87d-45c2-98b3-4d8d5fbd440d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6690aadfb55846dca65551c04bb37573)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:03.394513 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e471153-b87d-45c2-98b3-4d8d5fbd440d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:03.569922 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9e471153-b87d-45c2-98b3-4d8d5fbd440d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6690aadfb55846dca65551c04bb37573', 'request_id': 'req-9e471153-b87d-45c2-98b3-4d8d5fbd440d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:03.575717 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9e471153-b87d-45c2-98b3-4d8d5fbd440d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6690aadfb55846dca65551c04bb37573', 'request_id': 'req-9e471153-b87d-45c2-98b3-4d8d5fbd440d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:03.664551 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9e471153-b87d-45c2-98b3-4d8d5fbd440d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6690aadfb55846dca65551c04bb37573', 'request_id': 'req-9e471153-b87d-45c2-98b3-4d8d5fbd440d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:03.681005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9e471153-b87d-45c2-98b3-4d8d5fbd440d admin admin] The token cache is being invalidate because project 6690aadfb55846dca65551c04bb37573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:03.681540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9e471153-b87d-45c2-98b3-4d8d5fbd440d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:03.682995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9e471153-b87d-45c2-98b3-4d8d5fbd440d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:03.685733 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1045/2062] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:03 2022] DELETE /identity/v3/projects/6690aadfb55846dca65551c04bb37573 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:03.689479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a889e-d674-4a20-a607-f32ef3b64856 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:03.700601 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a889e-d674-4a20-a607-f32ef3b64856 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:03.807160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e471153-b87d-45c2-98b3-4d8d5fbd440d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:03.808779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9e471153-b87d-45c2-98b3-4d8d5fbd440d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:03.825429 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263323ff-bac5-4a2a-8f91-0277328aee62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:03.826962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263323ff-bac5-4a2a-8f91-0277328aee62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:03.827538 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263323ff-bac5-4a2a-8f91-0277328aee62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:03.828055 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263323ff-bac5-4a2a-8f91-0277328aee62 admin admin] PATH_INFO: `/v3/users/544aeb424ee94a2986be1f774583549b` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:03.829218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263323ff-bac5-4a2a-8f91-0277328aee62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=544aeb424ee94a2986be1f774583549b)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:03.831480 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263323ff-bac5-4a2a-8f91-0277328aee62 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:03.842286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:03.908909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e471153-b87d-45c2-98b3-4d8d5fbd440d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:03.915049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fb098-7d8e-4fda-9f89-af0856b6f208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:03.915891 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fb098-7d8e-4fda-9f89-af0856b6f208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:03.916370 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fb098-7d8e-4fda-9f89-af0856b6f208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:03.916794 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fb098-7d8e-4fda-9f89-af0856b6f208 admin admin] PATH_INFO: `/v3/users/6760bfd1a740430998bb105c8a2a1562` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:03.918338 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fb098-7d8e-4fda-9f89-af0856b6f208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6760bfd1a740430998bb105c8a2a1562)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:03.921284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fb098-7d8e-4fda-9f89-af0856b6f208 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:04.145502 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-263323ff-bac5-4a2a-8f91-0277328aee62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '544aeb424ee94a2986be1f774583549b'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:04.157865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-263323ff-bac5-4a2a-8f91-0277328aee62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '544aeb424ee94a2986be1f774583549b'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:04.158621 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-263323ff-bac5-4a2a-8f91-0277328aee62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '544aeb424ee94a2986be1f774583549b'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:04.184503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0d1fb098-7d8e-4fda-9f89-af0856b6f208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6760bfd1a740430998bb105c8a2a1562'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:04.185193 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0d1fb098-7d8e-4fda-9f89-af0856b6f208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6760bfd1a740430998bb105c8a2a1562'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:04.201352 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0d1fb098-7d8e-4fda-9f89-af0856b6f208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6760bfd1a740430998bb105c8a2a1562'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:04.210301 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0d1fb098-7d8e-4fda-9f89-af0856b6f208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6760bfd1a740430998bb105c8a2a1562'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:04.229490 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-263323ff-bac5-4a2a-8f91-0277328aee62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '544aeb424ee94a2986be1f774583549b'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:04.239740 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-263323ff-bac5-4a2a-8f91-0277328aee62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '544aeb424ee94a2986be1f774583549b'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:04.250135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1018/2063] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:03 2022] DELETE /identity/v3/users/544aeb424ee94a2986be1f774583549b => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:05:04.250135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263323ff-bac5-4a2a-8f91-0277328aee62 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:04.250135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-263323ff-bac5-4a2a-8f91-0277328aee62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:04.361924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0d1fb098-7d8e-4fda-9f89-af0856b6f208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6760bfd1a740430998bb105c8a2a1562'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:04.374998 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1046/2064] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:03 2022] DELETE /identity/v3/users/6760bfd1a740430998bb105c8a2a1562 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:04.375189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263323ff-bac5-4a2a-8f91-0277328aee62 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:04.377042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e1f2b-0d47-4113-9308-f8760bfb45ae None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:04.377331 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e1f2b-0d47-4113-9308-f8760bfb45ae None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:04.377606 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e1f2b-0d47-4113-9308-f8760bfb45ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:04.424961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4a3e1f2b-0d47-4113-9308-f8760bfb45ae None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:04.426250 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4a3e1f2b-0d47-4113-9308-f8760bfb45ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:04.481298 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cec95-5800-4371-aa62-e693915b8548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:04.482431 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cec95-5800-4371-aa62-e693915b8548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:04.482431 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cec95-5800-4371-aa62-e693915b8548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:04.483684 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cec95-5800-4371-aa62-e693915b8548 admin admin] PATH_INFO: `/v3/users/8f79a38178724e47b983b3717447570c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:04.484898 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cec95-5800-4371-aa62-e693915b8548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f79a38178724e47b983b3717447570c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:04.487667 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39cec95-5800-4371-aa62-e693915b8548 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:04.522673 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1047/2065] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:04.534376 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e1f2b-0d47-4113-9308-f8760bfb45ae None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:04.536006 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4a3e1f2b-0d47-4113-9308-f8760bfb45ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:04.633661 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e1f2b-0d47-4113-9308-f8760bfb45ae None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:04.639256 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68af96b-3464-4917-93eb-917ef94a281e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:04.639256 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68af96b-3464-4917-93eb-917ef94a281e service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:04.639256 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68af96b-3464-4917-93eb-917ef94a281e service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:04.639256 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68af96b-3464-4917-93eb-917ef94a281e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:04.649067 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68af96b-3464-4917-93eb-917ef94a281e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:04.650537 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68af96b-3464-4917-93eb-917ef94a281e service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:04.660901 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1048/2066] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:05:04.661964 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68af96b-3464-4917-93eb-917ef94a281e service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:04.663324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b68af96b-3464-4917-93eb-917ef94a281e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:04.676091 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68af96b-3464-4917-93eb-917ef94a281e service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:04.680643 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a5f3e-adac-4078-9f77-e747c569be07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:04.681260 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a5f3e-adac-4078-9f77-e747c569be07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:04.681537 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a5f3e-adac-4078-9f77-e747c569be07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:04.681810 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a5f3e-adac-4078-9f77-e747c569be07 admin admin] PATH_INFO: `/v3/users/38e8806e8adc4d2cbdfdd06442834571` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:04.683059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a5f3e-adac-4078-9f77-e747c569be07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38e8806e8adc4d2cbdfdd06442834571)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:04.685025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a5f3e-adac-4078-9f77-e747c569be07 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:04.728190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e39cec95-5800-4371-aa62-e693915b8548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f79a38178724e47b983b3717447570c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:04.745629 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e39cec95-5800-4371-aa62-e693915b8548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f79a38178724e47b983b3717447570c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:04.746704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e39cec95-5800-4371-aa62-e693915b8548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f79a38178724e47b983b3717447570c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:04.869851 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e39cec95-5800-4371-aa62-e693915b8548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f79a38178724e47b983b3717447570c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:04.877544 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e39cec95-5800-4371-aa62-e693915b8548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f79a38178724e47b983b3717447570c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:04.883763 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1019/2067] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:04 2022] DELETE /identity/v3/users/8f79a38178724e47b983b3717447570c => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:04.888146 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd4efa-347f-49c4-a293-45a97e50585c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:04.888446 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd4efa-347f-49c4-a293-45a97e50585c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:04.889240 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd4efa-347f-49c4-a293-45a97e50585c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:04.912400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-40bd4efa-347f-49c4-a293-45a97e50585c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:04.913671 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-40bd4efa-347f-49c4-a293-45a97e50585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:04.914169 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-698a5f3e-adac-4078-9f77-e747c569be07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38e8806e8adc4d2cbdfdd06442834571'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:04.915008 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-698a5f3e-adac-4078-9f77-e747c569be07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38e8806e8adc4d2cbdfdd06442834571'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:04.929507 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-698a5f3e-adac-4078-9f77-e747c569be07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38e8806e8adc4d2cbdfdd06442834571'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:04.939105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-698a5f3e-adac-4078-9f77-e747c569be07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38e8806e8adc4d2cbdfdd06442834571'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:04.991643 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1020/2068] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:05:04.993182 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd4efa-347f-49c4-a293-45a97e50585c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:04.995151 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-40bd4efa-347f-49c4-a293-45a97e50585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:05.008132 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd4efa-347f-49c4-a293-45a97e50585c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:05.012408 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-698a5f3e-adac-4078-9f77-e747c569be07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38e8806e8adc4d2cbdfdd06442834571'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:05.020158 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1049/2069] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:04 2022] DELETE /identity/v3/users/38e8806e8adc4d2cbdfdd06442834571 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:05.024440 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a5f3e-adac-4078-9f77-e747c569be07 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:05.024555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c2b5d-9633-4a63-9b52-32dfe341175b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:05.024691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-698a5f3e-adac-4078-9f77-e747c569be07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:05.024783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c2b5d-9633-4a63-9b52-32dfe341175b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:05.024783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c2b5d-9633-4a63-9b52-32dfe341175b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:05.024783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c2b5d-9633-4a63-9b52-32dfe341175b admin admin] PATH_INFO: `/v3/projects/9e7eec922b5c455595a69493096941ee` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:05.025647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c2b5d-9633-4a63-9b52-32dfe341175b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e7eec922b5c455595a69493096941ee)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:05.028031 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c2b5d-9633-4a63-9b52-32dfe341175b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:05.101983 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a5f3e-adac-4078-9f77-e747c569be07 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:05.106107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368b173-e73f-4d47-a3be-e6a5b37378c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:05.106826 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368b173-e73f-4d47-a3be-e6a5b37378c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:05.107111 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368b173-e73f-4d47-a3be-e6a5b37378c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:05.107428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368b173-e73f-4d47-a3be-e6a5b37378c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:05.109320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b368b173-e73f-4d47-a3be-e6a5b37378c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:05.191374 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3f6c2b5d-9633-4a63-9b52-32dfe341175b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e7eec922b5c455595a69493096941ee', 'request_id': 'req-3f6c2b5d-9633-4a63-9b52-32dfe341175b'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:05.199191 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3f6c2b5d-9633-4a63-9b52-32dfe341175b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e7eec922b5c455595a69493096941ee', 'request_id': 'req-3f6c2b5d-9633-4a63-9b52-32dfe341175b'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:05.207723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3f6c2b5d-9633-4a63-9b52-32dfe341175b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e7eec922b5c455595a69493096941ee', 'request_id': 'req-3f6c2b5d-9633-4a63-9b52-32dfe341175b'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:05.215390 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368b173-e73f-4d47-a3be-e6a5b37378c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:05.217039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b368b173-e73f-4d47-a3be-e6a5b37378c9 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:05.228969 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1050/2070] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:05.230139 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368b173-e73f-4d47-a3be-e6a5b37378c9 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:05.231854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b368b173-e73f-4d47-a3be-e6a5b37378c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:05.246907 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368b173-e73f-4d47-a3be-e6a5b37378c9 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:05.304917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e3b64-c513-49aa-994b-324007fe9dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:05.305463 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e3b64-c513-49aa-994b-324007fe9dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:05.305743 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e3b64-c513-49aa-994b-324007fe9dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:05.306013 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e3b64-c513-49aa-994b-324007fe9dea admin admin] PATH_INFO: `/v3/projects/d875dc51ec2a4c0689db83c00f434cf9` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:05.307162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e3b64-c513-49aa-994b-324007fe9dea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d875dc51ec2a4c0689db83c00f434cf9)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:05.309081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e3b64-c513-49aa-994b-324007fe9dea admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:05.316826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3f6c2b5d-9633-4a63-9b52-32dfe341175b admin admin] The token cache is being invalidate because project 9e7eec922b5c455595a69493096941ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:05.317123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3f6c2b5d-9633-4a63-9b52-32dfe341175b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:05.317887 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3f6c2b5d-9633-4a63-9b52-32dfe341175b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:05.319472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1021/2071] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:04 2022] DELETE /identity/v3/projects/9e7eec922b5c455595a69493096941ee => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:05.325046 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0a0f3-b630-49f2-8938-55c62701d255 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:05.325329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0a0f3-b630-49f2-8938-55c62701d255 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:05.325609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0a0f3-b630-49f2-8938-55c62701d255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:05.347013 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-05d0a0f3-b630-49f2-8938-55c62701d255 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:05.348226 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-05d0a0f3-b630-49f2-8938-55c62701d255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:05.356165 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1022/2072] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:05.364749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e53e3-b2e1-4446-8686-03fc9e2d7453 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:05.365035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e53e3-b2e1-4446-8686-03fc9e2d7453 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:05.365312 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e53e3-b2e1-4446-8686-03fc9e2d7453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:05.390067 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c77e53e3-b2e1-4446-8686-03fc9e2d7453 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:05.390067 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c77e53e3-b2e1-4446-8686-03fc9e2d7453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:05.399051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1023/2073] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:05:05.399051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e53e3-b2e1-4446-8686-03fc9e2d7453 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:05.399051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c77e53e3-b2e1-4446-8686-03fc9e2d7453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:05.413429 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e53e3-b2e1-4446-8686-03fc9e2d7453 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:05.419567 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969155b-9807-437a-86ec-38ed90bdcc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:05.420745 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969155b-9807-437a-86ec-38ed90bdcc95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:05.421024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969155b-9807-437a-86ec-38ed90bdcc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:05.424398 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969155b-9807-437a-86ec-38ed90bdcc95 admin admin] PATH_INFO: `/v3/projects/bda11fac1143401388fca98942985141` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:05.424398 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969155b-9807-437a-86ec-38ed90bdcc95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bda11fac1143401388fca98942985141)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:05.424398 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d969155b-9807-437a-86ec-38ed90bdcc95 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:05.480034 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-eb2e3b64-c513-49aa-994b-324007fe9dea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd875dc51ec2a4c0689db83c00f434cf9', 'request_id': 'req-eb2e3b64-c513-49aa-994b-324007fe9dea'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:05.486010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-eb2e3b64-c513-49aa-994b-324007fe9dea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd875dc51ec2a4c0689db83c00f434cf9', 'request_id': 'req-eb2e3b64-c513-49aa-994b-324007fe9dea'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:05.581158 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d969155b-9807-437a-86ec-38ed90bdcc95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bda11fac1143401388fca98942985141', 'request_id': 'req-d969155b-9807-437a-86ec-38ed90bdcc95'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:05.587946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d969155b-9807-437a-86ec-38ed90bdcc95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bda11fac1143401388fca98942985141', 'request_id': 'req-d969155b-9807-437a-86ec-38ed90bdcc95'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:05.589790 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-eb2e3b64-c513-49aa-994b-324007fe9dea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd875dc51ec2a4c0689db83c00f434cf9', 'request_id': 'req-eb2e3b64-c513-49aa-994b-324007fe9dea'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:05.596174 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d969155b-9807-437a-86ec-38ed90bdcc95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bda11fac1143401388fca98942985141', 'request_id': 'req-d969155b-9807-437a-86ec-38ed90bdcc95'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:05.609163 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-eb2e3b64-c513-49aa-994b-324007fe9dea admin admin] The token cache is being invalidate because project d875dc51ec2a4c0689db83c00f434cf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:05.609529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-eb2e3b64-c513-49aa-994b-324007fe9dea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:05.610289 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-eb2e3b64-c513-49aa-994b-324007fe9dea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:05.612248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1051/2074] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:05 2022] DELETE /identity/v3/projects/d875dc51ec2a4c0689db83c00f434cf9 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:05.613216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e3b64-c513-49aa-994b-324007fe9dea admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:05.614605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-eb2e3b64-c513-49aa-994b-324007fe9dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:05.686130 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e3b64-c513-49aa-994b-324007fe9dea admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:05.698506 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d969155b-9807-437a-86ec-38ed90bdcc95 admin admin] The token cache is being invalidate because project bda11fac1143401388fca98942985141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:05.698953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d969155b-9807-437a-86ec-38ed90bdcc95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:05.699679 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d969155b-9807-437a-86ec-38ed90bdcc95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:05.702553 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1024/2075] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:05 2022] DELETE /identity/v3/projects/bda11fac1143401388fca98942985141 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:05.703246 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969155b-9807-437a-86ec-38ed90bdcc95 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:05.704661 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d969155b-9807-437a-86ec-38ed90bdcc95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:05.759650 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2ac68-feb2-4e5e-a892-de8e4732da51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:05.768072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2ac68-feb2-4e5e-a892-de8e4732da51 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:05.768072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2ac68-feb2-4e5e-a892-de8e4732da51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:05.768072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2ac68-feb2-4e5e-a892-de8e4732da51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:05.768072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2ac68-feb2-4e5e-a892-de8e4732da51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:05:05.768072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2ac68-feb2-4e5e-a892-de8e4732da51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:05.768072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2ac68-feb2-4e5e-a892-de8e4732da51 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:05.780517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1052/2076] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:05:05.782740 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9efa0-5c40-4722-b102-0f736ca93788 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:05.783059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9efa0-5c40-4722-b102-0f736ca93788 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:05.783339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b9efa0-5c40-4722-b102-0f736ca93788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:05.814646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a7b9efa0-5c40-4722-b102-0f736ca93788 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:05.814646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a7b9efa0-5c40-4722-b102-0f736ca93788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:05.816174 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969155b-9807-437a-86ec-38ed90bdcc95 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:05.822186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c6e40-505d-4d4e-bdd0-65cde4c5a9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:05.823339 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c6e40-505d-4d4e-bdd0-65cde4c5a9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:05.823724 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c6e40-505d-4d4e-bdd0-65cde4c5a9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:05.824098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c6e40-505d-4d4e-bdd0-65cde4c5a9b8 admin admin] PATH_INFO: `/v3/users/e877401e56b94027bd4e710f683b6b63` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:05.825562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c6e40-505d-4d4e-bdd0-65cde4c5a9b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e877401e56b94027bd4e710f683b6b63)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:05.828706 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c6e40-505d-4d4e-bdd0-65cde4c5a9b8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:05.830964 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1053/2077] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:05.832893 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9efa0-5c40-4722-b102-0f736ca93788 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:05.836714 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a7b9efa0-5c40-4722-b102-0f736ca93788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:05.850738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b9efa0-5c40-4722-b102-0f736ca93788 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:05.865221 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e9907-f8f7-4914-b6d2-bb504f371c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:05.865221 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e9907-f8f7-4914-b6d2-bb504f371c42 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:05.865221 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e9907-f8f7-4914-b6d2-bb504f371c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:05.865221 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e9907-f8f7-4914-b6d2-bb504f371c42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:05.865552 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e9907-f8f7-4914-b6d2-bb504f371c42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:05.865552 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e9907-f8f7-4914-b6d2-bb504f371c42 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:05.910795 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:06.036235 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1054/2078] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:05:05 2022] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:06.038256 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88055cff-8c3c-4757-ba28-f44210c8c09f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:06.038689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88055cff-8c3c-4757-ba28-f44210c8c09f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:06.039496 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88055cff-8c3c-4757-ba28-f44210c8c09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:06.060316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-88055cff-8c3c-4757-ba28-f44210c8c09f None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:06.062259 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-88055cff-8c3c-4757-ba28-f44210c8c09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:06.128869 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1055/2079] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:06.128869 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88055cff-8c3c-4757-ba28-f44210c8c09f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:06.130286 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-88055cff-8c3c-4757-ba28-f44210c8c09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:06.131844 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-df2c6e40-505d-4d4e-bdd0-65cde4c5a9b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e877401e56b94027bd4e710f683b6b63'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:06.142645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88055cff-8c3c-4757-ba28-f44210c8c09f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:06.147855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-df2c6e40-505d-4d4e-bdd0-65cde4c5a9b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e877401e56b94027bd4e710f683b6b63'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:06.148564 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-df2c6e40-505d-4d4e-bdd0-65cde4c5a9b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e877401e56b94027bd4e710f683b6b63'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:06.148836 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d28fc-6c7b-4f1d-90f7-a35a6bea6313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:06.149623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d28fc-6c7b-4f1d-90f7-a35a6bea6313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:06.150118 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d28fc-6c7b-4f1d-90f7-a35a6bea6313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:06.150387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d28fc-6c7b-4f1d-90f7-a35a6bea6313 admin admin] PATH_INFO: `/v3/projects/037a698c77a64ed3998f44e83c174ac8` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:06.152026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d28fc-6c7b-4f1d-90f7-a35a6bea6313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=037a698c77a64ed3998f44e83c174ac8)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:06.153927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d28fc-6c7b-4f1d-90f7-a35a6bea6313 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:06.377622 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-df2c6e40-505d-4d4e-bdd0-65cde4c5a9b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e877401e56b94027bd4e710f683b6b63'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:06.386319 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-df2c6e40-505d-4d4e-bdd0-65cde4c5a9b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e877401e56b94027bd4e710f683b6b63'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:06.392951 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1025/2080] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:05 2022] DELETE /identity/v3/users/e877401e56b94027bd4e710f683b6b63 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:06.393720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c6e40-505d-4d4e-bdd0-65cde4c5a9b8 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:06.395142 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-df2c6e40-505d-4d4e-bdd0-65cde4c5a9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:06.400858 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c37d28fc-6c7b-4f1d-90f7-a35a6bea6313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '037a698c77a64ed3998f44e83c174ac8', 'request_id': 'req-c37d28fc-6c7b-4f1d-90f7-a35a6bea6313'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:06.408997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c37d28fc-6c7b-4f1d-90f7-a35a6bea6313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '037a698c77a64ed3998f44e83c174ac8', 'request_id': 'req-c37d28fc-6c7b-4f1d-90f7-a35a6bea6313'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:06.462379 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c6e40-505d-4d4e-bdd0-65cde4c5a9b8 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:06.467358 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08957098-f590-4740-a8c1-c2206349cea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:06.467987 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08957098-f590-4740-a8c1-c2206349cea1 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:06.468274 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08957098-f590-4740-a8c1-c2206349cea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:06.468553 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08957098-f590-4740-a8c1-c2206349cea1 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:06.469183 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08957098-f590-4740-a8c1-c2206349cea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:06.471456 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08957098-f590-4740-a8c1-c2206349cea1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:06.509412 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c37d28fc-6c7b-4f1d-90f7-a35a6bea6313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '037a698c77a64ed3998f44e83c174ac8', 'request_id': 'req-c37d28fc-6c7b-4f1d-90f7-a35a6bea6313'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:06.523166 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c37d28fc-6c7b-4f1d-90f7-a35a6bea6313 admin admin] The token cache is being invalidate because project 037a698c77a64ed3998f44e83c174ac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:06.523504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c37d28fc-6c7b-4f1d-90f7-a35a6bea6313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:06.524216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c37d28fc-6c7b-4f1d-90f7-a35a6bea6313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:06.525900 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1056/2081] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:06 2022] DELETE /identity/v3/projects/037a698c77a64ed3998f44e83c174ac8 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:06.526653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d28fc-6c7b-4f1d-90f7-a35a6bea6313 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:06.528120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c37d28fc-6c7b-4f1d-90f7-a35a6bea6313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:06.594090 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d28fc-6c7b-4f1d-90f7-a35a6bea6313 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:06.598687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb4c61-bff5-4e70-b849-db44de08721d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:06.599403 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb4c61-bff5-4e70-b849-db44de08721d admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:06.599684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb4c61-bff5-4e70-b849-db44de08721d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:06.599959 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb4c61-bff5-4e70-b849-db44de08721d admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:06.600606 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb4c61-bff5-4e70-b849-db44de08721d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:05:06.600911 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb4c61-bff5-4e70-b849-db44de08721d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:06.602560 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb4c61-bff5-4e70-b849-db44de08721d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:06.611397 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1026/2082] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:05:06 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:06.611397 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08957098-f590-4740-a8c1-c2206349cea1 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:06.611397 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-08957098-f590-4740-a8c1-c2206349cea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:06.615186 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1057/2083] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:05:06.616218 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb4c61-bff5-4e70-b849-db44de08721d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:06.617817 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-95eb4c61-bff5-4e70-b849-db44de08721d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:06.622417 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08957098-f590-4740-a8c1-c2206349cea1 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:06.627055 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8324c-e5be-4dba-b09d-fca786496c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:06.627745 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8324c-e5be-4dba-b09d-fca786496c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:06.628115 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8324c-e5be-4dba-b09d-fca786496c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:06.628395 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8324c-e5be-4dba-b09d-fca786496c3a admin admin] PATH_INFO: `/v3/users/3f4748b1a14f4daca42bbc270399a2ef` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:06.629896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8324c-e5be-4dba-b09d-fca786496c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f4748b1a14f4daca42bbc270399a2ef)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:06.633816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8324c-e5be-4dba-b09d-fca786496c3a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:06.635150 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:06.643854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb4c61-bff5-4e70-b849-db44de08721d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:06.650033 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a1f41-3e77-440c-a811-3402f6549aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:06.650901 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a1f41-3e77-440c-a811-3402f6549aca admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:06.651331 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a1f41-3e77-440c-a811-3402f6549aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:06.652012 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a1f41-3e77-440c-a811-3402f6549aca admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:06.652840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a1f41-3e77-440c-a811-3402f6549aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:06.655629 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a1f41-3e77-440c-a811-3402f6549aca admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:06.667327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1058/2084] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:06.668239 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a1f41-3e77-440c-a811-3402f6549aca admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:06.678890 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a1f41-3e77-440c-a811-3402f6549aca admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:06.684431 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b454df-30a6-4853-8499-a082ec351a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:06.685129 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b454df-30a6-4853-8499-a082ec351a95 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:06.685850 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b454df-30a6-4853-8499-a082ec351a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:06.685991 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b454df-30a6-4853-8499-a082ec351a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:06.686803 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b454df-30a6-4853-8499-a082ec351a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:06.688718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b454df-30a6-4853-8499-a082ec351a95 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:06.800378 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1059/2085] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:05:06 2022] POST /identity/v3/projects => generated 391 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:06.800378 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b454df-30a6-4853-8499-a082ec351a95 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:06.858935 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b454df-30a6-4853-8499-a082ec351a95 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:06.864144 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7005e-3598-4f27-aeb3-d86d3e55be7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:06.864751 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7005e-3598-4f27-aeb3-d86d3e55be7c admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:06.865026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7005e-3598-4f27-aeb3-d86d3e55be7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:06.865304 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7005e-3598-4f27-aeb3-d86d3e55be7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:06.866849 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7005e-3598-4f27-aeb3-d86d3e55be7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:06.867733 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7005e-3598-4f27-aeb3-d86d3e55be7c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:06.878195 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1060/2086] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:06.879055 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7005e-3598-4f27-aeb3-d86d3e55be7c admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:06.888391 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7005e-3598-4f27-aeb3-d86d3e55be7c admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:06.893814 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388cae5-5006-406c-a0c5-277f1b1a1a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:06.894390 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388cae5-5006-406c-a0c5-277f1b1a1a48 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:06.894907 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388cae5-5006-406c-a0c5-277f1b1a1a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:06.895088 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388cae5-5006-406c-a0c5-277f1b1a1a48 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:06.895680 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388cae5-5006-406c-a0c5-277f1b1a1a48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:06.898003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388cae5-5006-406c-a0c5-277f1b1a1a48 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:06.912888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8cc8324c-e5be-4dba-b09d-fca786496c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f4748b1a14f4daca42bbc270399a2ef'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:06.930491 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8cc8324c-e5be-4dba-b09d-fca786496c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f4748b1a14f4daca42bbc270399a2ef'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:06.931297 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8cc8324c-e5be-4dba-b09d-fca786496c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f4748b1a14f4daca42bbc270399a2ef'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:07.017395 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8cc8324c-e5be-4dba-b09d-fca786496c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f4748b1a14f4daca42bbc270399a2ef'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:07.024221 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1061/2087] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:05:06 2022] POST /identity/v3/users => generated 296 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:07.025632 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388cae5-5006-406c-a0c5-277f1b1a1a48 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:07.025746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8cc8324c-e5be-4dba-b09d-fca786496c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f4748b1a14f4daca42bbc270399a2ef'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:07.033710 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1027/2088] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:06 2022] DELETE /identity/v3/users/3f4748b1a14f4daca42bbc270399a2ef => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:07.034334 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8324c-e5be-4dba-b09d-fca786496c3a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:07.035756 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8cc8324c-e5be-4dba-b09d-fca786496c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:07.040366 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388cae5-5006-406c-a0c5-277f1b1a1a48 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:07.103729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20590c83-8758-430b-a3b7-34575003983f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:07.104562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8324c-e5be-4dba-b09d-fca786496c3a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:07.105005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20590c83-8758-430b-a3b7-34575003983f admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:07.105616 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20590c83-8758-430b-a3b7-34575003983f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:07.106047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20590c83-8758-430b-a3b7-34575003983f admin admin] PATH_INFO: `/v3/projects/8ceafbb4e11f45ce8379e1455ecf579f/users/46622f2abac84ff08b42a5c0d14e9f63/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:07.110448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87cb16-4b97-437f-99b2-466ba474959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:07.111563 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87cb16-4b97-437f-99b2-466ba474959d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:07.112040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87cb16-4b97-437f-99b2-466ba474959d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:07.112468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87cb16-4b97-437f-99b2-466ba474959d admin admin] PATH_INFO: `/v3/projects/f670d95db13d4c939e227a00f27bb137` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:07.114057 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87cb16-4b97-437f-99b2-466ba474959d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f670d95db13d4c939e227a00f27bb137)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:07.116515 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87cb16-4b97-437f-99b2-466ba474959d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:07.123994 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20590c83-8758-430b-a3b7-34575003983f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ceafbb4e11f45ce8379e1455ecf579f, user_id=46622f2abac84ff08b42a5c0d14e9f63, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:07.126856 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20590c83-8758-430b-a3b7-34575003983f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:07.277165 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1062/2089] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:07 2022] PUT /identity/v3/projects/8ceafbb4e11f45ce8379e1455ecf579f/users/46622f2abac84ff08b42a5c0d14e9f63/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:07.278031 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20590c83-8758-430b-a3b7-34575003983f admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:07.287749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-20590c83-8758-430b-a3b7-34575003983f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:07.291740 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0d87cb16-4b97-437f-99b2-466ba474959d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f670d95db13d4c939e227a00f27bb137', 'request_id': 'req-0d87cb16-4b97-437f-99b2-466ba474959d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:07.298428 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0d87cb16-4b97-437f-99b2-466ba474959d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f670d95db13d4c939e227a00f27bb137', 'request_id': 'req-0d87cb16-4b97-437f-99b2-466ba474959d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:07.308569 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0d87cb16-4b97-437f-99b2-466ba474959d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f670d95db13d4c939e227a00f27bb137', 'request_id': 'req-0d87cb16-4b97-437f-99b2-466ba474959d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:07.372751 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20590c83-8758-430b-a3b7-34575003983f admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:07.429076 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40af8c0-07f2-43ef-b496-907bbe153a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:07.429989 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40af8c0-07f2-43ef-b496-907bbe153a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:07.430274 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40af8c0-07f2-43ef-b496-907bbe153a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:07.430546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40af8c0-07f2-43ef-b496-907bbe153a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:07.431238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40af8c0-07f2-43ef-b496-907bbe153a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:07.433114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40af8c0-07f2-43ef-b496-907bbe153a44 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:07.442543 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0d87cb16-4b97-437f-99b2-466ba474959d admin admin] The token cache is being invalidate because project f670d95db13d4c939e227a00f27bb137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:07.443536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0d87cb16-4b97-437f-99b2-466ba474959d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:07.444283 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0d87cb16-4b97-437f-99b2-466ba474959d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:07.445980 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1028/2090] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:07 2022] DELETE /identity/v3/projects/f670d95db13d4c939e227a00f27bb137 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:07.447405 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d496f1-5b5f-4029-91b5-82d7bde0d49b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:07.447754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d496f1-5b5f-4029-91b5-82d7bde0d49b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:07.448100 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d496f1-5b5f-4029-91b5-82d7bde0d49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:07.454687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1063/2091] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:07.457480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40af8c0-07f2-43ef-b496-907bbe153a44 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:07.459464 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b40af8c0-07f2-43ef-b496-907bbe153a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:07.472096 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40af8c0-07f2-43ef-b496-907bbe153a44 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:07.476799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc058798-acfe-4e04-ae0b-c953e9cd95f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:07.477428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc058798-acfe-4e04-ae0b-c953e9cd95f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:07.477707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc058798-acfe-4e04-ae0b-c953e9cd95f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:07.477981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc058798-acfe-4e04-ae0b-c953e9cd95f3 admin admin] PATH_INFO: `/v3/users/0dc6766ff4e144f3af65c242612b8739` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:07.478462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f0d496f1-5b5f-4029-91b5-82d7bde0d49b None None] MFA Rules not processed for user `46622f2abac84ff08b42a5c0d14e9f63`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:07.479168 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc058798-acfe-4e04-ae0b-c953e9cd95f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc6766ff4e144f3af65c242612b8739)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:07.479699 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f0d496f1-5b5f-4029-91b5-82d7bde0d49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:07.481094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc058798-acfe-4e04-ae0b-c953e9cd95f3 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:07.543264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1029/2092] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:07.544259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d496f1-5b5f-4029-91b5-82d7bde0d49b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:07.546092 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f0d496f1-5b5f-4029-91b5-82d7bde0d49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:07.562094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d496f1-5b5f-4029-91b5-82d7bde0d49b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:07.567095 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8206163-2a71-4eef-ab97-425a515fca39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:07.567718 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8206163-2a71-4eef-ab97-425a515fca39 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:07.568036 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8206163-2a71-4eef-ab97-425a515fca39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:07.568333 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8206163-2a71-4eef-ab97-425a515fca39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:07.569013 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8206163-2a71-4eef-ab97-425a515fca39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:07.570694 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8206163-2a71-4eef-ab97-425a515fca39 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:07.582870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1030/2093] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:07.583627 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8206163-2a71-4eef-ab97-425a515fca39 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:07.586645 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f8206163-2a71-4eef-ab97-425a515fca39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:07.649808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8206163-2a71-4eef-ab97-425a515fca39 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:07.653527 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf275570-708f-4086-97f1-94eae319c314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:07.654215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf275570-708f-4086-97f1-94eae319c314 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:07.657081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf275570-708f-4086-97f1-94eae319c314 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:07.657081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf275570-708f-4086-97f1-94eae319c314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:07.663254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf275570-708f-4086-97f1-94eae319c314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:07.664680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf275570-708f-4086-97f1-94eae319c314 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:07.674074 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1031/2094] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:07.674903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf275570-708f-4086-97f1-94eae319c314 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:07.676174 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cf275570-708f-4086-97f1-94eae319c314 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:07.690399 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf275570-708f-4086-97f1-94eae319c314 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:07.695096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f19cc-3d7e-402e-903d-bea0e295cc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:07.695752 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f19cc-3d7e-402e-903d-bea0e295cc3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:07.696033 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f19cc-3d7e-402e-903d-bea0e295cc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:07.696311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f19cc-3d7e-402e-903d-bea0e295cc3b admin admin] PATH_INFO: `/v3/projects/0bf89e55a40340aab92fd51d78314660` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:07.697428 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f19cc-3d7e-402e-903d-bea0e295cc3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bf89e55a40340aab92fd51d78314660)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:07.699355 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f19cc-3d7e-402e-903d-bea0e295cc3b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:07.730594 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fc058798-acfe-4e04-ae0b-c953e9cd95f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc6766ff4e144f3af65c242612b8739'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:07.731359 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fc058798-acfe-4e04-ae0b-c953e9cd95f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc6766ff4e144f3af65c242612b8739'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:07.744218 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fc058798-acfe-4e04-ae0b-c953e9cd95f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc6766ff4e144f3af65c242612b8739'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:07.752401 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fc058798-acfe-4e04-ae0b-c953e9cd95f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc6766ff4e144f3af65c242612b8739'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:07.829882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-977f19cc-3d7e-402e-903d-bea0e295cc3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bf89e55a40340aab92fd51d78314660', 'request_id': 'req-977f19cc-3d7e-402e-903d-bea0e295cc3b'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:07.835274 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-977f19cc-3d7e-402e-903d-bea0e295cc3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bf89e55a40340aab92fd51d78314660', 'request_id': 'req-977f19cc-3d7e-402e-903d-bea0e295cc3b'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:07.841386 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-977f19cc-3d7e-402e-903d-bea0e295cc3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bf89e55a40340aab92fd51d78314660', 'request_id': 'req-977f19cc-3d7e-402e-903d-bea0e295cc3b'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:07.845938 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fc058798-acfe-4e04-ae0b-c953e9cd95f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc6766ff4e144f3af65c242612b8739'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:07.852111 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1064/2095] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:07 2022] DELETE /identity/v3/users/0dc6766ff4e144f3af65c242612b8739 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:07.852852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc058798-acfe-4e04-ae0b-c953e9cd95f3 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:07.857875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fc058798-acfe-4e04-ae0b-c953e9cd95f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:07.918801 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc058798-acfe-4e04-ae0b-c953e9cd95f3 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:07.923911 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5babe-a8d0-479a-bade-bd27bafc4f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:07.924566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5babe-a8d0-479a-bade-bd27bafc4f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:07.924848 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5babe-a8d0-479a-bade-bd27bafc4f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:07.925120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5babe-a8d0-479a-bade-bd27bafc4f36 admin admin] PATH_INFO: `/v3/projects/83ea8686ce044a86af451e3d4119dc7e/users/ae05a859b3eb47e5ab60e39467b5ab06/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:07.939519 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5babe-a8d0-479a-bade-bd27bafc4f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ea8686ce044a86af451e3d4119dc7e, user_id=ae05a859b3eb47e5ab60e39467b5ab06, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:07.942160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5babe-a8d0-479a-bade-bd27bafc4f36 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:07.960100 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-977f19cc-3d7e-402e-903d-bea0e295cc3b admin admin] The token cache is being invalidate because project 0bf89e55a40340aab92fd51d78314660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:07.960596 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-977f19cc-3d7e-402e-903d-bea0e295cc3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:07.961139 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-977f19cc-3d7e-402e-903d-bea0e295cc3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:07.962629 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1032/2096] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:07 2022] DELETE /identity/v3/projects/0bf89e55a40340aab92fd51d78314660 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:07.963498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f19cc-3d7e-402e-903d-bea0e295cc3b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:07.964812 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-977f19cc-3d7e-402e-903d-bea0e295cc3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:08.030952 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f19cc-3d7e-402e-903d-bea0e295cc3b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:08.039984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1065/2097] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:07 2022] PUT /identity/v3/projects/83ea8686ce044a86af451e3d4119dc7e/users/ae05a859b3eb47e5ab60e39467b5ab06/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:08.039984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f46ac-7058-4353-b34a-c900ca814f06 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:08.039984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f46ac-7058-4353-b34a-c900ca814f06 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:08.039984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f46ac-7058-4353-b34a-c900ca814f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:08.061707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-324f46ac-7058-4353-b34a-c900ca814f06 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:08.062934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-324f46ac-7058-4353-b34a-c900ca814f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:08.095252 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9ba36-ecad-4eef-ad54-a7c1e6ed1fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:08.096027 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ba36-ecad-4eef-ad54-a7c1e6ed1fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:08.096372 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ba36-ecad-4eef-ad54-a7c1e6ed1fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:08.096657 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9ba36-ecad-4eef-ad54-a7c1e6ed1fb3 admin admin] PATH_INFO: `/v3/users/c5803b6f8c1f4b4ea30345544f4a0f54` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:08.097832 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9ba36-ecad-4eef-ad54-a7c1e6ed1fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5803b6f8c1f4b4ea30345544f4a0f54)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:08.099899 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9ba36-ecad-4eef-ad54-a7c1e6ed1fb3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:08.147042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1066/2098] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:08.148309 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd0aef-3fa4-4102-8e16-2fa7c4b9ddd9 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:08.148966 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd0aef-3fa4-4102-8e16-2fa7c4b9ddd9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:08.148966 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd0aef-3fa4-4102-8e16-2fa7c4b9ddd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:08.170971 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1ddd0aef-3fa4-4102-8e16-2fa7c4b9ddd9 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:08.172104 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1ddd0aef-3fa4-4102-8e16-2fa7c4b9ddd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:08.180151 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1067/2099] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:08.181340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fc96f-8551-4ed4-9fd0-c0941ff24845 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:08.181624 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fc96f-8551-4ed4-9fd0-c0941ff24845 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:08.181897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1fc96f-8551-4ed4-9fd0-c0941ff24845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:08.212280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ae1fc96f-8551-4ed4-9fd0-c0941ff24845 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:08.213481 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ae1fc96f-8551-4ed4-9fd0-c0941ff24845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:08.221602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1068/2100] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:08.222458 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fc96f-8551-4ed4-9fd0-c0941ff24845 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:08.223689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ae1fc96f-8551-4ed4-9fd0-c0941ff24845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:08.280725 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1fc96f-8551-4ed4-9fd0-c0941ff24845 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:08.284930 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15ee83-334d-4566-932b-593a9608fd73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:08.285564 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15ee83-334d-4566-932b-593a9608fd73 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:08.286030 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15ee83-334d-4566-932b-593a9608fd73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:08.286351 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15ee83-334d-4566-932b-593a9608fd73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:08.296221 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15ee83-334d-4566-932b-593a9608fd73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:08.297656 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15ee83-334d-4566-932b-593a9608fd73 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:08.307699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1069/2101] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:08.308556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15ee83-334d-4566-932b-593a9608fd73 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:08.318500 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15ee83-334d-4566-932b-593a9608fd73 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:08.323479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219d5df-3916-4bd6-b52e-0b9f8c6dd85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:08.324071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219d5df-3916-4bd6-b52e-0b9f8c6dd85d admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:08.324353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219d5df-3916-4bd6-b52e-0b9f8c6dd85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:08.325032 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219d5df-3916-4bd6-b52e-0b9f8c6dd85d admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:08.325310 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219d5df-3916-4bd6-b52e-0b9f8c6dd85d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:05:08.340025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219d5df-3916-4bd6-b52e-0b9f8c6dd85d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:08.340025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219d5df-3916-4bd6-b52e-0b9f8c6dd85d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:08.341269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1070/2102] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:05:08.342254 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219d5df-3916-4bd6-b52e-0b9f8c6dd85d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:08.346597 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e219d5df-3916-4bd6-b52e-0b9f8c6dd85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:08.348888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-27b9ba36-ecad-4eef-ad54-a7c1e6ed1fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5803b6f8c1f4b4ea30345544f4a0f54'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:08.361390 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219d5df-3916-4bd6-b52e-0b9f8c6dd85d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:08.363524 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-27b9ba36-ecad-4eef-ad54-a7c1e6ed1fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5803b6f8c1f4b4ea30345544f4a0f54'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:08.364250 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-27b9ba36-ecad-4eef-ad54-a7c1e6ed1fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5803b6f8c1f4b4ea30345544f4a0f54'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:08.366980 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ca1d9-352a-42d8-b81c-880fd5dad974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:08.367704 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ca1d9-352a-42d8-b81c-880fd5dad974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:08.367986 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ca1d9-352a-42d8-b81c-880fd5dad974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:08.368263 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ca1d9-352a-42d8-b81c-880fd5dad974 admin admin] PATH_INFO: `/v3/projects/a98d2ca63ac0495388a225c5334a56ea` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:08.369594 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ca1d9-352a-42d8-b81c-880fd5dad974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a98d2ca63ac0495388a225c5334a56ea)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:08.371540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ca1d9-352a-42d8-b81c-880fd5dad974 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:08.492608 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:08.494144 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-27b9ba36-ecad-4eef-ad54-a7c1e6ed1fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5803b6f8c1f4b4ea30345544f4a0f54'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:08.504902 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-27b9ba36-ecad-4eef-ad54-a7c1e6ed1fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5803b6f8c1f4b4ea30345544f4a0f54'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:08.512366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1033/2103] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:07 2022] DELETE /identity/v3/users/c5803b6f8c1f4b4ea30345544f4a0f54 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:08.516522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9ba36-ecad-4eef-ad54-a7c1e6ed1fb3 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:08.518045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-27b9ba36-ecad-4eef-ad54-a7c1e6ed1fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:08.584206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9ba36-ecad-4eef-ad54-a7c1e6ed1fb3 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:08.595440 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-314ca1d9-352a-42d8-b81c-880fd5dad974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a98d2ca63ac0495388a225c5334a56ea', 'request_id': 'req-314ca1d9-352a-42d8-b81c-880fd5dad974'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:08.600691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-314ca1d9-352a-42d8-b81c-880fd5dad974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a98d2ca63ac0495388a225c5334a56ea', 'request_id': 'req-314ca1d9-352a-42d8-b81c-880fd5dad974'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:08.640987 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c174cf5-21e4-4938-8475-3a03639f62fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:08.641627 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c174cf5-21e4-4938-8475-3a03639f62fa admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:08.642208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c174cf5-21e4-4938-8475-3a03639f62fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:08.642208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c174cf5-21e4-4938-8475-3a03639f62fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:08.642801 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c174cf5-21e4-4938-8475-3a03639f62fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:08.644780 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c174cf5-21e4-4938-8475-3a03639f62fa admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:08.716416 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-314ca1d9-352a-42d8-b81c-880fd5dad974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a98d2ca63ac0495388a225c5334a56ea', 'request_id': 'req-314ca1d9-352a-42d8-b81c-880fd5dad974'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:08.731813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-314ca1d9-352a-42d8-b81c-880fd5dad974 admin admin] The token cache is being invalidate because project a98d2ca63ac0495388a225c5334a56ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:08.732541 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-314ca1d9-352a-42d8-b81c-880fd5dad974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:08.733069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-314ca1d9-352a-42d8-b81c-880fd5dad974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:08.734949 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1071/2104] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:08 2022] DELETE /identity/v3/projects/a98d2ca63ac0495388a225c5334a56ea => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:08.736594 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7f6c9-7b6c-4c3d-90fa-9179847e80b7 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:08.737037 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7f6c9-7b6c-4c3d-90fa-9179847e80b7 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:08.737518 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7f6c9-7b6c-4c3d-90fa-9179847e80b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:08.751712 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1034/2105] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:05:08 2022] POST /identity/v3/projects => generated 363 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:08.752722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d63115-06cf-4dad-a9ed-6f5d5df02f0d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:08.753008 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d63115-06cf-4dad-a9ed-6f5d5df02f0d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:08.753357 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d63115-06cf-4dad-a9ed-6f5d5df02f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:08.757650 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a7d7f6c9-7b6c-4c3d-90fa-9179847e80b7 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:08.758924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a7d7f6c9-7b6c-4c3d-90fa-9179847e80b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:08.773583 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f2d63115-06cf-4dad-a9ed-6f5d5df02f0d None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:08.774792 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f2d63115-06cf-4dad-a9ed-6f5d5df02f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:08.819287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1072/2106] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:08.820216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7f6c9-7b6c-4c3d-90fa-9179847e80b7 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:08.821826 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a7d7f6c9-7b6c-4c3d-90fa-9179847e80b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:08.833875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7f6c9-7b6c-4c3d-90fa-9179847e80b7 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:08.836223 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1035/2107] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:08.836935 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d63115-06cf-4dad-a9ed-6f5d5df02f0d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:08.838192 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f2d63115-06cf-4dad-a9ed-6f5d5df02f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:08.841522 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f99df-d934-43b8-8215-4f31005f4d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:08.849713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f99df-d934-43b8-8215-4f31005f4d97 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:08.849713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f99df-d934-43b8-8215-4f31005f4d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:08.849713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f99df-d934-43b8-8215-4f31005f4d97 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:08.849713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f99df-d934-43b8-8215-4f31005f4d97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:08.849713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f99df-d934-43b8-8215-4f31005f4d97 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:08.852480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:08.906943 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d63115-06cf-4dad-a9ed-6f5d5df02f0d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:08.910495 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c90528-61b9-4b77-a8df-60e4bb37de29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:08.911129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c90528-61b9-4b77-a8df-60e4bb37de29 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:08.912463 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c90528-61b9-4b77-a8df-60e4bb37de29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:08.912463 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c90528-61b9-4b77-a8df-60e4bb37de29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:08.921797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c90528-61b9-4b77-a8df-60e4bb37de29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:08.923489 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c90528-61b9-4b77-a8df-60e4bb37de29 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:08.934056 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1036/2108] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:08.936724 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c2ebd-aed7-45b8-a660-1ae8c1b19d77 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:08.937207 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c2ebd-aed7-45b8-a660-1ae8c1b19d77 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:08.937630 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c2ebd-aed7-45b8-a660-1ae8c1b19d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:08.961833 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d00c2ebd-aed7-45b8-a660-1ae8c1b19d77 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:08.963193 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d00c2ebd-aed7-45b8-a660-1ae8c1b19d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:08.972657 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1037/2109] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:08.977285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c2ebd-aed7-45b8-a660-1ae8c1b19d77 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:08.987961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c2ebd-aed7-45b8-a660-1ae8c1b19d77 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:08.999775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0db4f-af9d-48f5-81ed-3e401f94a8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:09.000443 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0db4f-af9d-48f5-81ed-3e401f94a8fb admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:09.000725 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0db4f-af9d-48f5-81ed-3e401f94a8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:09.001038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0db4f-af9d-48f5-81ed-3e401f94a8fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:09.004366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0db4f-af9d-48f5-81ed-3e401f94a8fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:05:09.004366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0db4f-af9d-48f5-81ed-3e401f94a8fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:09.005263 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1073/2110] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:05:08 2022] POST /identity/v3/users => generated 282 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:09.008178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0db4f-af9d-48f5-81ed-3e401f94a8fb admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:09.012124 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f99df-d934-43b8-8215-4f31005f4d97 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:09.028919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1038/2111] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 11:05:09.036306 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0db4f-af9d-48f5-81ed-3e401f94a8fb admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:09.038006 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f99df-d934-43b8-8215-4f31005f4d97 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:09.044214 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745029e-0130-4824-ad93-e0b0d009caa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:09.044982 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745029e-0130-4824-ad93-e0b0d009caa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:09.045582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745029e-0130-4824-ad93-e0b0d009caa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:09.045867 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745029e-0130-4824-ad93-e0b0d009caa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:09.046534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745029e-0130-4824-ad93-e0b0d009caa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:09.048518 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745029e-0130-4824-ad93-e0b0d009caa7 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:09.051994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0db4f-af9d-48f5-81ed-3e401f94a8fb admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:09.057408 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e0a86-f260-4e14-bed4-0d53a5ee1224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:09.058149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e0a86-f260-4e14-bed4-0d53a5ee1224 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:09.058504 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e0a86-f260-4e14-bed4-0d53a5ee1224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:09.058909 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e0a86-f260-4e14-bed4-0d53a5ee1224 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:09.059657 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e0a86-f260-4e14-bed4-0d53a5ee1224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:09.060095 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1074/2112] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:09.063092 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e0a86-f260-4e14-bed4-0d53a5ee1224 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:09.064716 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745029e-0130-4824-ad93-e0b0d009caa7 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:09.074242 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745029e-0130-4824-ad93-e0b0d009caa7 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:09.079456 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b7aba-5dea-4b17-83f4-61d9221ec94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:09.080043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b7aba-5dea-4b17-83f4-61d9221ec94b admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:09.080326 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b7aba-5dea-4b17-83f4-61d9221ec94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:09.080600 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b7aba-5dea-4b17-83f4-61d9221ec94b admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:09.081261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b7aba-5dea-4b17-83f4-61d9221ec94b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:09.082881 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b7aba-5dea-4b17-83f4-61d9221ec94b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:09.092549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1075/2113] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:05:09.096503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b7aba-5dea-4b17-83f4-61d9221ec94b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:09.105566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b7aba-5dea-4b17-83f4-61d9221ec94b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:09.110941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b23e7e-dd55-4a81-bd54-2ec636f13c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:09.111589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b23e7e-dd55-4a81-bd54-2ec636f13c1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:09.111863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b23e7e-dd55-4a81-bd54-2ec636f13c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:09.112138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b23e7e-dd55-4a81-bd54-2ec636f13c1d admin admin] PATH_INFO: `/v3/projects/33690a8b11eb4509a07590dabcdf8a83/users/063767cca57f431091c6b6d7dbb9597e/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:09.126827 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b23e7e-dd55-4a81-bd54-2ec636f13c1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=33690a8b11eb4509a07590dabcdf8a83, user_id=063767cca57f431091c6b6d7dbb9597e, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:09.129497 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b23e7e-dd55-4a81-bd54-2ec636f13c1d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:09.187340 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1039/2114] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:05:09 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:05:09.191732 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e0a86-f260-4e14-bed4-0d53a5ee1224 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:09.220079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1076/2115] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:09 2022] PUT /identity/v3/projects/33690a8b11eb4509a07590dabcdf8a83/users/063767cca57f431091c6b6d7dbb9597e/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:05:09.236180 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2018bfd-80fe-4486-a38f-3e55e2f139df None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:09.236478 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2018bfd-80fe-4486-a38f-3e55e2f139df None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:09.236757 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2018bfd-80fe-4486-a38f-3e55e2f139df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:09.270600 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a2018bfd-80fe-4486-a38f-3e55e2f139df None None] MFA Rules not processed for user `063767cca57f431091c6b6d7dbb9597e`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:09.272053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a2018bfd-80fe-4486-a38f-3e55e2f139df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:09.311853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e0a86-f260-4e14-bed4-0d53a5ee1224 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:09.384461 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1077/2116] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:05:09.389701 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2018bfd-80fe-4486-a38f-3e55e2f139df None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:09.408342 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d0aa3-b673-48fa-b2ed-e24d3a15a798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:09.408965 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d0aa3-b673-48fa-b2ed-e24d3a15a798 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:09.409249 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d0aa3-b673-48fa-b2ed-e24d3a15a798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:09.409524 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d0aa3-b673-48fa-b2ed-e24d3a15a798 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:09.410284 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d0aa3-b673-48fa-b2ed-e24d3a15a798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:09.412391 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d0aa3-b673-48fa-b2ed-e24d3a15a798 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:09.459036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2018bfd-80fe-4486-a38f-3e55e2f139df None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:09.463884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4e7c6-87a6-41c1-ad60-82fc12e61de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:09.464507 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4e7c6-87a6-41c1-ad60-82fc12e61de6 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:09.464769 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4e7c6-87a6-41c1-ad60-82fc12e61de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:09.465042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4e7c6-87a6-41c1-ad60-82fc12e61de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:09.465672 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4e7c6-87a6-41c1-ad60-82fc12e61de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:09.468303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4e7c6-87a6-41c1-ad60-82fc12e61de6 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:09.538821 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1040/2117] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:05:09 2022] POST /identity/v3/users => generated 287 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:05:09.539674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d0aa3-b673-48fa-b2ed-e24d3a15a798 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:09.541271 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7b2d0aa3-b673-48fa-b2ed-e24d3a15a798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:09.553860 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d0aa3-b673-48fa-b2ed-e24d3a15a798 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:09.558677 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979574f-0aa6-4b53-8868-eca736916f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:09.561995 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979574f-0aa6-4b53-8868-eca736916f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:09.564693 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979574f-0aa6-4b53-8868-eca736916f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:09.564693 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979574f-0aa6-4b53-8868-eca736916f1d admin admin] PATH_INFO: `/v3/projects/2b8ebc2b64ea4d948075e862615958f2` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:09.565855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979574f-0aa6-4b53-8868-eca736916f1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b8ebc2b64ea4d948075e862615958f2)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:09.567818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a979574f-0aa6-4b53-8868-eca736916f1d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:09.569082 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1078/2118] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:05:09 2022] POST /identity/v3/projects => generated 365 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:05:09.570006 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4e7c6-87a6-41c1-ad60-82fc12e61de6 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:09.654724 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4e7c6-87a6-41c1-ad60-82fc12e61de6 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:09.659500 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c913e1-503f-4a78-a732-4a411a885818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:09.660105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c913e1-503f-4a78-a732-4a411a885818 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:09.660382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c913e1-503f-4a78-a732-4a411a885818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:09.660652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c913e1-503f-4a78-a732-4a411a885818 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:09.661295 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c913e1-503f-4a78-a732-4a411a885818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:09.663070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c913e1-503f-4a78-a732-4a411a885818 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:09.673537 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1079/2119] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:09.674315 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c913e1-503f-4a78-a732-4a411a885818 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:09.683540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c913e1-503f-4a78-a732-4a411a885818 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:09.688531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60ce4f-f96e-4416-a6db-2e6bf7d15ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:09.689116 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60ce4f-f96e-4416-a6db-2e6bf7d15ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:09.689395 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60ce4f-f96e-4416-a6db-2e6bf7d15ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:09.689666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60ce4f-f96e-4416-a6db-2e6bf7d15ed1 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:09.690275 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60ce4f-f96e-4416-a6db-2e6bf7d15ed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:09.692233 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60ce4f-f96e-4416-a6db-2e6bf7d15ed1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:09.704809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a979574f-0aa6-4b53-8868-eca736916f1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b8ebc2b64ea4d948075e862615958f2', 'request_id': 'req-a979574f-0aa6-4b53-8868-eca736916f1d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:09.710540 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a979574f-0aa6-4b53-8868-eca736916f1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b8ebc2b64ea4d948075e862615958f2', 'request_id': 'req-a979574f-0aa6-4b53-8868-eca736916f1d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:09.718550 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a979574f-0aa6-4b53-8868-eca736916f1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b8ebc2b64ea4d948075e862615958f2', 'request_id': 'req-a979574f-0aa6-4b53-8868-eca736916f1d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:09.783873 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1080/2120] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:05:09 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:09.785337 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60ce4f-f96e-4416-a6db-2e6bf7d15ed1 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:09.795684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60ce4f-f96e-4416-a6db-2e6bf7d15ed1 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:09.817616 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a979574f-0aa6-4b53-8868-eca736916f1d admin admin] The token cache is being invalidate because project 2b8ebc2b64ea4d948075e862615958f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:09.817979 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a979574f-0aa6-4b53-8868-eca736916f1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:09.819452 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a979574f-0aa6-4b53-8868-eca736916f1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:09.821781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1041/2121] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:09 2022] DELETE /identity/v3/projects/2b8ebc2b64ea4d948075e862615958f2 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:09.823238 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979574f-0aa6-4b53-8868-eca736916f1d admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:09.825670 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a979574f-0aa6-4b53-8868-eca736916f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:09.875580 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940ec2b-ebd5-4db1-8512-d8420c36cb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:09.876299 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940ec2b-ebd5-4db1-8512-d8420c36cb51 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:09.876863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940ec2b-ebd5-4db1-8512-d8420c36cb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:09.877001 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940ec2b-ebd5-4db1-8512-d8420c36cb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:09.877748 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940ec2b-ebd5-4db1-8512-d8420c36cb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:09.879579 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940ec2b-ebd5-4db1-8512-d8420c36cb51 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:09.893517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1081/2122] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:09.893517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940ec2b-ebd5-4db1-8512-d8420c36cb51 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:09.895270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e940ec2b-ebd5-4db1-8512-d8420c36cb51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:09.906396 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979574f-0aa6-4b53-8868-eca736916f1d admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:09.908251 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940ec2b-ebd5-4db1-8512-d8420c36cb51 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:09.911418 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13ce42-6c6a-409f-83f6-a9a6cbe8bee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:09.912216 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13ce42-6c6a-409f-83f6-a9a6cbe8bee2 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:09.912683 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13ce42-6c6a-409f-83f6-a9a6cbe8bee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:09.913321 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f09be-4ef2-4917-8648-0189c18ee10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:09.913448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13ce42-6c6a-409f-83f6-a9a6cbe8bee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:09.914359 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13ce42-6c6a-409f-83f6-a9a6cbe8bee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:09.916035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13ce42-6c6a-409f-83f6-a9a6cbe8bee2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:09.919240 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f09be-4ef2-4917-8648-0189c18ee10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:09.919939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f09be-4ef2-4917-8648-0189c18ee10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:09.920545 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f09be-4ef2-4917-8648-0189c18ee10c admin admin] PATH_INFO: `/v3/users/3221f74ed11349cba3cd03173e1500ed` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:09.922604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f09be-4ef2-4917-8648-0189c18ee10c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3221f74ed11349cba3cd03173e1500ed)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:09.928395 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f09be-4ef2-4917-8648-0189c18ee10c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:09.928540 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1042/2123] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:09.929250 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13ce42-6c6a-409f-83f6-a9a6cbe8bee2 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:09.931367 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4a13ce42-6c6a-409f-83f6-a9a6cbe8bee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:09.950457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13ce42-6c6a-409f-83f6-a9a6cbe8bee2 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:09.957675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eac23f-d42f-4fb6-85f1-49ca13223832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:09.958917 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eac23f-d42f-4fb6-85f1-49ca13223832 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:09.958917 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eac23f-d42f-4fb6-85f1-49ca13223832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:09.959169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eac23f-d42f-4fb6-85f1-49ca13223832 admin admin] PATH_INFO: `/v3/projects/1d45b78aacd1429e9f2886a53841b5b0/users/837249fdd7e942fba6e4358f82b1e1ff/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:09.974680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eac23f-d42f-4fb6-85f1-49ca13223832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d45b78aacd1429e9f2886a53841b5b0, user_id=837249fdd7e942fba6e4358f82b1e1ff, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:09.977485 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eac23f-d42f-4fb6-85f1-49ca13223832 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:10.138864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1043/2124] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:09 2022] PUT /identity/v3/projects/1d45b78aacd1429e9f2886a53841b5b0/users/837249fdd7e942fba6e4358f82b1e1ff/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:10.149291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eac23f-d42f-4fb6-85f1-49ca13223832 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:10.200265 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-338f09be-4ef2-4917-8648-0189c18ee10c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3221f74ed11349cba3cd03173e1500ed'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:10.201309 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-338f09be-4ef2-4917-8648-0189c18ee10c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3221f74ed11349cba3cd03173e1500ed'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:10.214257 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eac23f-d42f-4fb6-85f1-49ca13223832 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:10.215435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-338f09be-4ef2-4917-8648-0189c18ee10c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3221f74ed11349cba3cd03173e1500ed'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:10.220411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27507e-9835-4ca8-9b32-e57495f20a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:10.221085 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27507e-9835-4ca8-9b32-e57495f20a60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:10.221368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27507e-9835-4ca8-9b32-e57495f20a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:10.221647 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27507e-9835-4ca8-9b32-e57495f20a60 admin admin] PATH_INFO: `/v3/projects/e4e2d25429fa4858af2d3825ef8823bc/users/c1e4461f7f174ba6a9deb954dfe1c52f/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:10.223918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-338f09be-4ef2-4917-8648-0189c18ee10c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3221f74ed11349cba3cd03173e1500ed'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:10.238469 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27507e-9835-4ca8-9b32-e57495f20a60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e2d25429fa4858af2d3825ef8823bc, user_id=c1e4461f7f174ba6a9deb954dfe1c52f, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:10.241365 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d27507e-9835-4ca8-9b32-e57495f20a60 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:10.297786 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:10.377708 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-338f09be-4ef2-4917-8648-0189c18ee10c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3221f74ed11349cba3cd03173e1500ed'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:10.384555 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1082/2125] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:09 2022] DELETE /identity/v3/users/3221f74ed11349cba3cd03173e1500ed => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:10.385853 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e8fe8-e808-4bf3-9a4e-a7c2b896e457 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:10.386135 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e8fe8-e808-4bf3-9a4e-a7c2b896e457 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:10.386405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e8fe8-e808-4bf3-9a4e-a7c2b896e457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:10.389324 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1044/2126] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:10 2022] PUT /identity/v3/projects/e4e2d25429fa4858af2d3825ef8823bc/users/c1e4461f7f174ba6a9deb954dfe1c52f/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:10.393377 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27507e-9835-4ca8-9b32-e57495f20a60 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:10.395613 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7d27507e-9835-4ca8-9b32-e57495f20a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:10.427896 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-595e8fe8-e808-4bf3-9a4e-a7c2b896e457 None None] MFA Rules not processed for user `837249fdd7e942fba6e4358f82b1e1ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:10.429413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-595e8fe8-e808-4bf3-9a4e-a7c2b896e457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:10.476243 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27507e-9835-4ca8-9b32-e57495f20a60 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:10.502934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1083/2127] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:10.518010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e8fe8-e808-4bf3-9a4e-a7c2b896e457 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:10.520278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-595e8fe8-e808-4bf3-9a4e-a7c2b896e457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:10.547484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cfc42-ca4c-4e0d-b6f7-47c28c97242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:10.548177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cfc42-ca4c-4e0d-b6f7-47c28c97242f admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:10.548671 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cfc42-ca4c-4e0d-b6f7-47c28c97242f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:10.548947 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cfc42-ca4c-4e0d-b6f7-47c28c97242f admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:10.550114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2cfc42-ca4c-4e0d-b6f7-47c28c97242f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:10.551786 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2cfc42-ca4c-4e0d-b6f7-47c28c97242f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:10.566437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1045/2128] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:10.569751 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cfc42-ca4c-4e0d-b6f7-47c28c97242f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:10.590057 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cfc42-ca4c-4e0d-b6f7-47c28c97242f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:10.601741 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca03092-0752-4f45-b613-840d65489ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:10.603374 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca03092-0752-4f45-b613-840d65489ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:10.603811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca03092-0752-4f45-b613-840d65489ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:10.604763 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca03092-0752-4f45-b613-840d65489ca4 admin admin] PATH_INFO: `/v3/projects/e4e2d25429fa4858af2d3825ef8823bc/users/c1e4461f7f174ba6a9deb954dfe1c52f/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:10.610102 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca03092-0752-4f45-b613-840d65489ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e2d25429fa4858af2d3825ef8823bc, user_id=c1e4461f7f174ba6a9deb954dfe1c52f, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:10.613492 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca03092-0752-4f45-b613-840d65489ca4 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:10.616385 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e8fe8-e808-4bf3-9a4e-a7c2b896e457 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:10.620347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d52480-0518-48ff-a725-e1c336b5e90c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:10.621244 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d52480-0518-48ff-a725-e1c336b5e90c service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:10.621574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d52480-0518-48ff-a725-e1c336b5e90c service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:10.621853 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d52480-0518-48ff-a725-e1c336b5e90c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:10.639640 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1046/2129] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:10 2022] PUT /identity/v3/projects/e4e2d25429fa4858af2d3825ef8823bc/users/c1e4461f7f174ba6a9deb954dfe1c52f/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:05:10.640093 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d52480-0518-48ff-a725-e1c336b5e90c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:10.640093 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d52480-0518-48ff-a725-e1c336b5e90c service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:10.642139 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be769f-fb23-4a27-9551-a928e6e131a7 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:10.642432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be769f-fb23-4a27-9551-a928e6e131a7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:10.642732 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be769f-fb23-4a27-9551-a928e6e131a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:10.647038 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1084/2130] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:05:10.673459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d52480-0518-48ff-a725-e1c336b5e90c service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:10.675189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a0d52480-0518-48ff-a725-e1c336b5e90c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:10.693475 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d52480-0518-48ff-a725-e1c336b5e90c service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:10.715634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-62be769f-fb23-4a27-9551-a928e6e131a7 None None] MFA Rules not processed for user `c1e4461f7f174ba6a9deb954dfe1c52f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:10.717856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-62be769f-fb23-4a27-9551-a928e6e131a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:10.774806 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01cd37-bf56-477b-8914-5db0554781cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:10.775851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01cd37-bf56-477b-8914-5db0554781cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:10.776352 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01cd37-bf56-477b-8914-5db0554781cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:10.776808 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01cd37-bf56-477b-8914-5db0554781cd admin admin] PATH_INFO: `/v3/users/837249fdd7e942fba6e4358f82b1e1ff` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:10.778562 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01cd37-bf56-477b-8914-5db0554781cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=837249fdd7e942fba6e4358f82b1e1ff)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:10.784621 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01cd37-bf56-477b-8914-5db0554781cd admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:10.899404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1047/2131] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:05:10.943925 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be769f-fb23-4a27-9551-a928e6e131a7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:10.950147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-62be769f-fb23-4a27-9551-a928e6e131a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:11.047168 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be769f-fb23-4a27-9551-a928e6e131a7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:11.050346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95054e8-7ca1-47e5-8f24-ff9a6cef2dca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:11.051029 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95054e8-7ca1-47e5-8f24-ff9a6cef2dca service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:11.051310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95054e8-7ca1-47e5-8f24-ff9a6cef2dca service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:11.051583 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95054e8-7ca1-47e5-8f24-ff9a6cef2dca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:11.062713 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95054e8-7ca1-47e5-8f24-ff9a6cef2dca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:11.064204 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95054e8-7ca1-47e5-8f24-ff9a6cef2dca service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:11.074933 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1048/2132] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:11.115601 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-de01cd37-bf56-477b-8914-5db0554781cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '837249fdd7e942fba6e4358f82b1e1ff'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:11.116279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-de01cd37-bf56-477b-8914-5db0554781cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '837249fdd7e942fba6e4358f82b1e1ff'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:11.129253 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-de01cd37-bf56-477b-8914-5db0554781cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '837249fdd7e942fba6e4358f82b1e1ff'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:11.136143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-de01cd37-bf56-477b-8914-5db0554781cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '837249fdd7e942fba6e4358f82b1e1ff'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:11.158115 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95054e8-7ca1-47e5-8f24-ff9a6cef2dca service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:11.159800 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b95054e8-7ca1-47e5-8f24-ff9a6cef2dca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:11.176313 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95054e8-7ca1-47e5-8f24-ff9a6cef2dca service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:11.181234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0177e4-3961-425d-96db-f434c95d06e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:11.181878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0177e4-3961-425d-96db-f434c95d06e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:11.182208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0177e4-3961-425d-96db-f434c95d06e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:11.182490 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0177e4-3961-425d-96db-f434c95d06e5 admin admin] PATH_INFO: `/v3/projects/0df1de99050c4ef8aefa8ec050fd44e8` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:11.183673 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0177e4-3961-425d-96db-f434c95d06e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0df1de99050c4ef8aefa8ec050fd44e8)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:11.185826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0177e4-3961-425d-96db-f434c95d06e5 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:11.256918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-de01cd37-bf56-477b-8914-5db0554781cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '837249fdd7e942fba6e4358f82b1e1ff'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:11.266985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1085/2133] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:10 2022] DELETE /identity/v3/users/837249fdd7e942fba6e4358f82b1e1ff => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:05:11.273938 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c953423-a48e-4cb2-861e-56369c723108 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:11.274229 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c953423-a48e-4cb2-861e-56369c723108 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:11.274507 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c953423-a48e-4cb2-861e-56369c723108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:11.297367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0c953423-a48e-4cb2-861e-56369c723108 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:11.299218 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0c953423-a48e-4cb2-861e-56369c723108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:11.350212 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-df0177e4-3961-425d-96db-f434c95d06e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0df1de99050c4ef8aefa8ec050fd44e8', 'request_id': 'req-df0177e4-3961-425d-96db-f434c95d06e5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:11.356636 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-df0177e4-3961-425d-96db-f434c95d06e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0df1de99050c4ef8aefa8ec050fd44e8', 'request_id': 'req-df0177e4-3961-425d-96db-f434c95d06e5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:11.367372 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-df0177e4-3961-425d-96db-f434c95d06e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0df1de99050c4ef8aefa8ec050fd44e8', 'request_id': 'req-df0177e4-3961-425d-96db-f434c95d06e5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:11.381494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1086/2134] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:05:11.392881 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c953423-a48e-4cb2-861e-56369c723108 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:11.397147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0c953423-a48e-4cb2-861e-56369c723108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:11.460115 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-df0177e4-3961-425d-96db-f434c95d06e5 admin admin] The token cache is being invalidate because project 0df1de99050c4ef8aefa8ec050fd44e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:11.460721 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-df0177e4-3961-425d-96db-f434c95d06e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:11.461663 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-df0177e4-3961-425d-96db-f434c95d06e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:11.465534 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1049/2135] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:11 2022] DELETE /identity/v3/projects/0df1de99050c4ef8aefa8ec050fd44e8 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:05:11.471897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c953423-a48e-4cb2-861e-56369c723108 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:11.474222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0177e4-3961-425d-96db-f434c95d06e5 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:11.478406 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-df0177e4-3961-425d-96db-f434c95d06e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:11.516509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:11.547291 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46deb3-a921-4cf3-85cc-1a5d8f1b00be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:11.547986 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46deb3-a921-4cf3-85cc-1a5d8f1b00be service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:11.548269 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46deb3-a921-4cf3-85cc-1a5d8f1b00be service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:11.548549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46deb3-a921-4cf3-85cc-1a5d8f1b00be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:11.556962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-bd46deb3-a921-4cf3-85cc-1a5d8f1b00be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:11.630192 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0177e4-3961-425d-96db-f434c95d06e5 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:11.639694 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf96f8-c3da-41cc-9a8d-7aa08e26cc65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:11.641033 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf96f8-c3da-41cc-9a8d-7aa08e26cc65 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:11.641291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf96f8-c3da-41cc-9a8d-7aa08e26cc65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:11.641624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf96f8-c3da-41cc-9a8d-7aa08e26cc65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:11.644610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ecbf96f8-c3da-41cc-9a8d-7aa08e26cc65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:11.696226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46deb3-a921-4cf3-85cc-1a5d8f1b00be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:11.697747 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46deb3-a921-4cf3-85cc-1a5d8f1b00be service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:11.710232 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1087/2136] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:11.711132 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46deb3-a921-4cf3-85cc-1a5d8f1b00be service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:11.712489 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-bd46deb3-a921-4cf3-85cc-1a5d8f1b00be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:11.730921 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46deb3-a921-4cf3-85cc-1a5d8f1b00be service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:11.736345 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e96f6c-544a-4c73-9e6f-cce0ffb95f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:11.737136 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e96f6c-544a-4c73-9e6f-cce0ffb95f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:11.737519 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e96f6c-544a-4c73-9e6f-cce0ffb95f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:11.737691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e96f6c-544a-4c73-9e6f-cce0ffb95f5d admin admin] PATH_INFO: `/v3/users/bc95e332aaea4cffaa2f7eb16b553dc0` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:11.741677 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e96f6c-544a-4c73-9e6f-cce0ffb95f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc95e332aaea4cffaa2f7eb16b553dc0)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:11.743825 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e96f6c-544a-4c73-9e6f-cce0ffb95f5d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:11.751127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf96f8-c3da-41cc-9a8d-7aa08e26cc65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:11.752915 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf96f8-c3da-41cc-9a8d-7aa08e26cc65 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:11.778374 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1050/2137] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:12.087653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d7e96f6c-544a-4c73-9e6f-cce0ffb95f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc95e332aaea4cffaa2f7eb16b553dc0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:12.089799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d7e96f6c-544a-4c73-9e6f-cce0ffb95f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc95e332aaea4cffaa2f7eb16b553dc0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:12.093237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:12.135130 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d7e96f6c-544a-4c73-9e6f-cce0ffb95f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc95e332aaea4cffaa2f7eb16b553dc0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:12.149788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d7e96f6c-544a-4c73-9e6f-cce0ffb95f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc95e332aaea4cffaa2f7eb16b553dc0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:12.275473 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d7e96f6c-544a-4c73-9e6f-cce0ffb95f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc95e332aaea4cffaa2f7eb16b553dc0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:12.284266 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1088/2138] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:11 2022] DELETE /identity/v3/users/bc95e332aaea4cffaa2f7eb16b553dc0 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:12.366292 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf96f8-c3da-41cc-9a8d-7aa08e26cc65 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:12.367937 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ecbf96f8-c3da-41cc-9a8d-7aa08e26cc65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:12.397257 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf96f8-c3da-41cc-9a8d-7aa08e26cc65 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:12.491427 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518a655-f361-4da4-a1e1-4bddb6efd7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:12.492193 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518a655-f361-4da4-a1e1-4bddb6efd7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:12.492590 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518a655-f361-4da4-a1e1-4bddb6efd7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:12.492893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518a655-f361-4da4-a1e1-4bddb6efd7e5 admin admin] PATH_INFO: `/v3/projects/1d45b78aacd1429e9f2886a53841b5b0` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:12.494493 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518a655-f361-4da4-a1e1-4bddb6efd7e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d45b78aacd1429e9f2886a53841b5b0)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:12.498951 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518a655-f361-4da4-a1e1-4bddb6efd7e5 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:12.651420 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-9518a655-f361-4da4-a1e1-4bddb6efd7e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d45b78aacd1429e9f2886a53841b5b0', 'request_id': 'req-9518a655-f361-4da4-a1e1-4bddb6efd7e5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:12.658103 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-9518a655-f361-4da4-a1e1-4bddb6efd7e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d45b78aacd1429e9f2886a53841b5b0', 'request_id': 'req-9518a655-f361-4da4-a1e1-4bddb6efd7e5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:12.666525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-9518a655-f361-4da4-a1e1-4bddb6efd7e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d45b78aacd1429e9f2886a53841b5b0', 'request_id': 'req-9518a655-f361-4da4-a1e1-4bddb6efd7e5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:12.803156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-9518a655-f361-4da4-a1e1-4bddb6efd7e5 admin admin] The token cache is being invalidate because project 1d45b78aacd1429e9f2886a53841b5b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:12.803483 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-9518a655-f361-4da4-a1e1-4bddb6efd7e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:12.804212 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-9518a655-f361-4da4-a1e1-4bddb6efd7e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:12.806098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1051/2139] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:12 2022] DELETE /identity/v3/projects/1d45b78aacd1429e9f2886a53841b5b0 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:12.811732 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814505b-66a8-4558-9c11-91a9650f211f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:12.812323 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814505b-66a8-4558-9c11-91a9650f211f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:12.812781 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814505b-66a8-4558-9c11-91a9650f211f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:12.835099 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1814505b-66a8-4558-9c11-91a9650f211f None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:12.836751 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1814505b-66a8-4558-9c11-91a9650f211f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:12.855243 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518a655-f361-4da4-a1e1-4bddb6efd7e5 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:12.857851 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9518a655-f361-4da4-a1e1-4bddb6efd7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:12.919131 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1089/2140] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:12.924211 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e624e-4830-4b41-8f32-a3912944e78e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:12.925223 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e624e-4830-4b41-8f32-a3912944e78e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:12.925568 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e624e-4830-4b41-8f32-a3912944e78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:12.954245 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-352e624e-4830-4b41-8f32-a3912944e78e None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:12.956111 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-352e624e-4830-4b41-8f32-a3912944e78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:12.965807 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1090/2141] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:12.972562 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e624e-4830-4b41-8f32-a3912944e78e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:12.987936 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e624e-4830-4b41-8f32-a3912944e78e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:12.991622 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518a655-f361-4da4-a1e1-4bddb6efd7e5 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:12.999865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979d0f3-4ede-47f3-93c8-4430951b8f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:13.000462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18552af2-54af-4c4f-8028-51d8b172eddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:13.000910 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979d0f3-4ede-47f3-93c8-4430951b8f9b admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:13.001292 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18552af2-54af-4c4f-8028-51d8b172eddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:13.001641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979d0f3-4ede-47f3-93c8-4430951b8f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:13.001756 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18552af2-54af-4c4f-8028-51d8b172eddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:13.002105 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18552af2-54af-4c4f-8028-51d8b172eddd admin admin] PATH_INFO: `/v3/projects/771391c632de4ed291a887c1e916407f` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:13.002316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979d0f3-4ede-47f3-93c8-4430951b8f9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:13.003252 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979d0f3-4ede-47f3-93c8-4430951b8f9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:05:13.003764 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18552af2-54af-4c4f-8028-51d8b172eddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=771391c632de4ed291a887c1e916407f)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:13.004012 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979d0f3-4ede-47f3-93c8-4430951b8f9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:13.005787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979d0f3-4ede-47f3-93c8-4430951b8f9b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:13.006131 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18552af2-54af-4c4f-8028-51d8b172eddd admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:13.031077 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1091/2142] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:05:13.032471 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979d0f3-4ede-47f3-93c8-4430951b8f9b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:13.057511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979d0f3-4ede-47f3-93c8-4430951b8f9b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:13.065494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c60cc2-e5d0-4798-b42b-3c0e481b3c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:13.066152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c60cc2-e5d0-4798-b42b-3c0e481b3c0b admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:13.066437 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c60cc2-e5d0-4798-b42b-3c0e481b3c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:13.066717 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c60cc2-e5d0-4798-b42b-3c0e481b3c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:13.067475 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c60cc2-e5d0-4798-b42b-3c0e481b3c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:13.069422 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c60cc2-e5d0-4798-b42b-3c0e481b3c0b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:13.172305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-18552af2-54af-4c4f-8028-51d8b172eddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '771391c632de4ed291a887c1e916407f', 'request_id': 'req-18552af2-54af-4c4f-8028-51d8b172eddd'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:13.181657 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-18552af2-54af-4c4f-8028-51d8b172eddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '771391c632de4ed291a887c1e916407f', 'request_id': 'req-18552af2-54af-4c4f-8028-51d8b172eddd'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:13.191036 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-18552af2-54af-4c4f-8028-51d8b172eddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '771391c632de4ed291a887c1e916407f', 'request_id': 'req-18552af2-54af-4c4f-8028-51d8b172eddd'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:13.236616 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1092/2143] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:05:13 2022] POST /identity/v3/projects => generated 361 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:13.237553 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c60cc2-e5d0-4798-b42b-3c0e481b3c0b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:13.316010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c60cc2-e5d0-4798-b42b-3c0e481b3c0b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:13.323423 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf34de-02df-407a-b0b9-a9ce068df747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:13.324224 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf34de-02df-407a-b0b9-a9ce068df747 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:13.324561 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf34de-02df-407a-b0b9-a9ce068df747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:13.333228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf34de-02df-407a-b0b9-a9ce068df747 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:13.333228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf34de-02df-407a-b0b9-a9ce068df747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:13.333228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf34de-02df-407a-b0b9-a9ce068df747 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:13.355850 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-18552af2-54af-4c4f-8028-51d8b172eddd admin admin] The token cache is being invalidate because project 771391c632de4ed291a887c1e916407f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:13.356212 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-18552af2-54af-4c4f-8028-51d8b172eddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:13.357856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-18552af2-54af-4c4f-8028-51d8b172eddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:13.363035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1052/2144] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:12 2022] DELETE /identity/v3/projects/771391c632de4ed291a887c1e916407f => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:13.366720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b837b-3ca0-4712-978a-74f9d7937db1 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:13.367262 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b837b-3ca0-4712-978a-74f9d7937db1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:13.367778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b837b-3ca0-4712-978a-74f9d7937db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:13.395024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-131b837b-3ca0-4712-978a-74f9d7937db1 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:13.397299 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-131b837b-3ca0-4712-978a-74f9d7937db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:13.407993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1053/2145] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:05:13.417616 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548eca9-fcae-4708-b6e7-f1a62cfe0220 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:13.417986 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548eca9-fcae-4708-b6e7-f1a62cfe0220 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:13.418362 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548eca9-fcae-4708-b6e7-f1a62cfe0220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:13.439827 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1093/2146] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:05:13 2022] POST /identity/v3/users => generated 281 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:13.441641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf34de-02df-407a-b0b9-a9ce068df747 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:13.444874 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fcdf34de-02df-407a-b0b9-a9ce068df747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:13.473241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c548eca9-fcae-4708-b6e7-f1a62cfe0220 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:13.474465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c548eca9-fcae-4708-b6e7-f1a62cfe0220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:13.475540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf34de-02df-407a-b0b9-a9ce068df747 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:13.486492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3026c-a96a-483d-97a8-f1bbd52ac689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:13.488328 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3026c-a96a-483d-97a8-f1bbd52ac689 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:13.488618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3026c-a96a-483d-97a8-f1bbd52ac689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:13.488898 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3026c-a96a-483d-97a8-f1bbd52ac689 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:13.491276 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3026c-a96a-483d-97a8-f1bbd52ac689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:13.494107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3026c-a96a-483d-97a8-f1bbd52ac689 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:13.501092 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1054/2147] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:13.502342 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548eca9-fcae-4708-b6e7-f1a62cfe0220 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:13.524487 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548eca9-fcae-4708-b6e7-f1a62cfe0220 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:13.526014 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1094/2148] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:05:13.527900 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3026c-a96a-483d-97a8-f1bbd52ac689 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:13.537596 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9f74b-2dd4-4830-a79a-4da13127ca62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:13.538246 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9f74b-2dd4-4830-a79a-4da13127ca62 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:13.538525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9f74b-2dd4-4830-a79a-4da13127ca62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:13.540112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9f74b-2dd4-4830-a79a-4da13127ca62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:13.540998 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9f74b-2dd4-4830-a79a-4da13127ca62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:05:13.543159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9f74b-2dd4-4830-a79a-4da13127ca62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:13.544849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9f74b-2dd4-4830-a79a-4da13127ca62 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:13.552551 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3026c-a96a-483d-97a8-f1bbd52ac689 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:13.559441 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd02c64-7180-481e-885f-2dce95f0e292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:13.560596 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd02c64-7180-481e-885f-2dce95f0e292 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:13.560871 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd02c64-7180-481e-885f-2dce95f0e292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:13.561140 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd02c64-7180-481e-885f-2dce95f0e292 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:13.561981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd02c64-7180-481e-885f-2dce95f0e292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:13.564007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd02c64-7180-481e-885f-2dce95f0e292 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:13.574701 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1055/2149] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:05:13.587455 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1095/2150] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:13.587648 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9f74b-2dd4-4830-a79a-4da13127ca62 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:13.591622 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd02c64-7180-481e-885f-2dce95f0e292 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:13.600124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9f74b-2dd4-4830-a79a-4da13127ca62 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:13.606190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc59740-792f-4c62-b895-97a9fc7dad07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:13.607602 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc59740-792f-4c62-b895-97a9fc7dad07 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:13.608600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc59740-792f-4c62-b895-97a9fc7dad07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:13.610982 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc59740-792f-4c62-b895-97a9fc7dad07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:13.612567 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc59740-792f-4c62-b895-97a9fc7dad07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:13.615121 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc59740-792f-4c62-b895-97a9fc7dad07 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:13.619557 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd02c64-7180-481e-885f-2dce95f0e292 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:13.634981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035d355-b876-4fdf-8b12-0ca846783d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:13.636205 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035d355-b876-4fdf-8b12-0ca846783d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:13.636973 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035d355-b876-4fdf-8b12-0ca846783d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:13.636973 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035d355-b876-4fdf-8b12-0ca846783d47 admin admin] PATH_INFO: `/v3/projects/d2282541ffb84ea68539c505d04f82af/users/2b0de7b40dff4770ab74880aa22ae215/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:13.659519 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035d355-b876-4fdf-8b12-0ca846783d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2282541ffb84ea68539c505d04f82af, user_id=2b0de7b40dff4770ab74880aa22ae215, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:13.662247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035d355-b876-4fdf-8b12-0ca846783d47 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:13.741321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1056/2151] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:05:13 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:13.745075 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc59740-792f-4c62-b895-97a9fc7dad07 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:13.783119 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:13.797697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1096/2152] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:13 2022] PUT /identity/v3/projects/d2282541ffb84ea68539c505d04f82af/users/2b0de7b40dff4770ab74880aa22ae215/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:13.807349 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5542e-a239-43fb-abdd-b6d99acfef6d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:13.808654 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5542e-a239-43fb-abdd-b6d99acfef6d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:13.808654 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5542e-a239-43fb-abdd-b6d99acfef6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:13.823333 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc59740-792f-4c62-b895-97a9fc7dad07 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:13.893367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-84a5542e-a239-43fb-abdd-b6d99acfef6d None None] MFA Rules not processed for user `2b0de7b40dff4770ab74880aa22ae215`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:13.895271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-84a5542e-a239-43fb-abdd-b6d99acfef6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:13.925085 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac124bf-c96a-46bc-b2e1-6079a71c13d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:13.926911 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac124bf-c96a-46bc-b2e1-6079a71c13d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:13.927203 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac124bf-c96a-46bc-b2e1-6079a71c13d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:13.927466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac124bf-c96a-46bc-b2e1-6079a71c13d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:13.930271 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac124bf-c96a-46bc-b2e1-6079a71c13d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:13.935064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac124bf-c96a-46bc-b2e1-6079a71c13d0 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:14.067029 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1097/2153] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:05:14.080844 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1057/2154] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:05:13 2022] POST /identity/v3/users => generated 286 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:05:14.085313 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5542e-a239-43fb-abdd-b6d99acfef6d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:14.110448 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5542e-a239-43fb-abdd-b6d99acfef6d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:14.121924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a18a9-1d06-4c0b-b2eb-52fe6ef1ede1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:14.124094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a18a9-1d06-4c0b-b2eb-52fe6ef1ede1 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:14.124986 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a18a9-1d06-4c0b-b2eb-52fe6ef1ede1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:14.125523 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a18a9-1d06-4c0b-b2eb-52fe6ef1ede1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:14.126403 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a18a9-1d06-4c0b-b2eb-52fe6ef1ede1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:14.129624 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556a18a9-1d06-4c0b-b2eb-52fe6ef1ede1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:14.147184 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1098/2155] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:14.148184 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac124bf-c96a-46bc-b2e1-6079a71c13d0 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:14.161447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac124bf-c96a-46bc-b2e1-6079a71c13d0 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:14.167269 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d398703-ce47-4a4b-88bd-255eba88d84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:14.168079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d398703-ce47-4a4b-88bd-255eba88d84d admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:14.168396 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d398703-ce47-4a4b-88bd-255eba88d84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:14.168742 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d398703-ce47-4a4b-88bd-255eba88d84d admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:14.169529 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d398703-ce47-4a4b-88bd-255eba88d84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:14.171996 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d398703-ce47-4a4b-88bd-255eba88d84d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:14.189676 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1058/2156] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:05:14.192434 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a18a9-1d06-4c0b-b2eb-52fe6ef1ede1 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:14.203627 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a18a9-1d06-4c0b-b2eb-52fe6ef1ede1 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:14.208482 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde396e1-7d3e-4d13-ab8b-224a50f4be24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:14.209224 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde396e1-7d3e-4d13-ab8b-224a50f4be24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:14.209585 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde396e1-7d3e-4d13-ab8b-224a50f4be24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:14.209932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde396e1-7d3e-4d13-ab8b-224a50f4be24 admin admin] PATH_INFO: `/v3/projects/14129c5163af45a09849c34d6ce991c4/users/3e64b86aefeb4a7fb0710b69e7cd1063/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:14.226462 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde396e1-7d3e-4d13-ab8b-224a50f4be24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14129c5163af45a09849c34d6ce991c4, user_id=3e64b86aefeb4a7fb0710b69e7cd1063, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:14.229178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde396e1-7d3e-4d13-ab8b-224a50f4be24 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:14.374334 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1099/2157] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:14 2022] PUT /identity/v3/projects/14129c5163af45a09849c34d6ce991c4/users/3e64b86aefeb4a7fb0710b69e7cd1063/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:14.379577 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5ae00-ae06-40b1-b39f-97345c7e5d99 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:14.379852 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5ae00-ae06-40b1-b39f-97345c7e5d99 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:14.380131 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5ae00-ae06-40b1-b39f-97345c7e5d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:14.406081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a4a5ae00-ae06-40b1-b39f-97345c7e5d99 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:14.408063 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a4a5ae00-ae06-40b1-b39f-97345c7e5d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:14.487395 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1059/2158] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:14.497106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde396e1-7d3e-4d13-ab8b-224a50f4be24 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:14.499473 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-bde396e1-7d3e-4d13-ab8b-224a50f4be24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:14.580307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde396e1-7d3e-4d13-ab8b-224a50f4be24 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:14.585298 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30337720-1b56-4d21-aa9a-c4b339b97f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:14.585911 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30337720-1b56-4d21-aa9a-c4b339b97f04 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:14.586189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30337720-1b56-4d21-aa9a-c4b339b97f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:14.586621 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30337720-1b56-4d21-aa9a-c4b339b97f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:14.600938 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30337720-1b56-4d21-aa9a-c4b339b97f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:14.602641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30337720-1b56-4d21-aa9a-c4b339b97f04 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:14.615379 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5ae00-ae06-40b1-b39f-97345c7e5d99 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:14.616438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a4a5ae00-ae06-40b1-b39f-97345c7e5d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:14.622706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1100/2159] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:14.702308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5ae00-ae06-40b1-b39f-97345c7e5d99 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:14.706291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563684a8-b601-49c5-97d1-f60884e282a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:14.706962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563684a8-b601-49c5-97d1-f60884e282a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:14.708754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563684a8-b601-49c5-97d1-f60884e282a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:14.708754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563684a8-b601-49c5-97d1-f60884e282a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:14.787990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563684a8-b601-49c5-97d1-f60884e282a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:14.789548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563684a8-b601-49c5-97d1-f60884e282a1 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:14.800753 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1060/2160] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:05:14.817872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30337720-1b56-4d21-aa9a-c4b339b97f04 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:14.832469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30337720-1b56-4d21-aa9a-c4b339b97f04 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:14.838000 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7de5a-ae89-4d84-86b5-5e2c3cc30f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:14.838918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7de5a-ae89-4d84-86b5-5e2c3cc30f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:14.839199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7de5a-ae89-4d84-86b5-5e2c3cc30f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:14.839467 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7de5a-ae89-4d84-86b5-5e2c3cc30f6c admin admin] PATH_INFO: `/v3/users/2b0de7b40dff4770ab74880aa22ae215` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:14.840666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7de5a-ae89-4d84-86b5-5e2c3cc30f6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b0de7b40dff4770ab74880aa22ae215)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:14.842896 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7de5a-ae89-4d84-86b5-5e2c3cc30f6c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:15.132561 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1cd7de5a-ae89-4d84-86b5-5e2c3cc30f6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b0de7b40dff4770ab74880aa22ae215'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:15.133714 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1cd7de5a-ae89-4d84-86b5-5e2c3cc30f6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b0de7b40dff4770ab74880aa22ae215'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:15.149597 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1cd7de5a-ae89-4d84-86b5-5e2c3cc30f6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b0de7b40dff4770ab74880aa22ae215'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:15.159315 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1cd7de5a-ae89-4d84-86b5-5e2c3cc30f6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b0de7b40dff4770ab74880aa22ae215'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:15.309342 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1cd7de5a-ae89-4d84-86b5-5e2c3cc30f6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b0de7b40dff4770ab74880aa22ae215'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:15.330388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1101/2161] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:14 2022] DELETE /identity/v3/users/2b0de7b40dff4770ab74880aa22ae215 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:15.334858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd20bac-f696-4d4f-b901-be2c9831f8e6 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:15.336128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd20bac-f696-4d4f-b901-be2c9831f8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:15.336710 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd20bac-f696-4d4f-b901-be2c9831f8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:15.360947 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2cd20bac-f696-4d4f-b901-be2c9831f8e6 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:15.363237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2cd20bac-f696-4d4f-b901-be2c9831f8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:15.459906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1061/2162] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:15.480113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7de5a-ae89-4d84-86b5-5e2c3cc30f6c admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:15.480563 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1cd7de5a-ae89-4d84-86b5-5e2c3cc30f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:15.483460 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd21a4-8a38-4c78-a725-b3006ed42f0d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:15.483754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd21a4-8a38-4c78-a725-b3006ed42f0d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:15.484035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd21a4-8a38-4c78-a725-b3006ed42f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:15.552089 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-28cd21a4-8a38-4c78-a725-b3006ed42f0d None None] MFA Rules not processed for user `ae05a859b3eb47e5ab60e39467b5ab06`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:15.553322 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-28cd21a4-8a38-4c78-a725-b3006ed42f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:15.600429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7de5a-ae89-4d84-86b5-5e2c3cc30f6c admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:15.605456 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8310d0-c2b1-4cb6-8c60-0fa18b940b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:15.606161 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8310d0-c2b1-4cb6-8c60-0fa18b940b06 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:15.606448 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8310d0-c2b1-4cb6-8c60-0fa18b940b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:15.606916 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8310d0-c2b1-4cb6-8c60-0fa18b940b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:15.620859 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8310d0-c2b1-4cb6-8c60-0fa18b940b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:15.623646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8310d0-c2b1-4cb6-8c60-0fa18b940b06 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:15.635138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1102/2163] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:15.647659 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1062/2164] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:15.663814 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8736846-aa7b-4d76-94d7-349387432af6 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:15.664259 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8736846-aa7b-4d76-94d7-349387432af6 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:15.664603 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8736846-aa7b-4d76-94d7-349387432af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:15.694183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a8736846-aa7b-4d76-94d7-349387432af6 None None] MFA Rules not processed for user `ae05a859b3eb47e5ab60e39467b5ab06`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:15.695490 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a8736846-aa7b-4d76-94d7-349387432af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:15.698548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:15.728381 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1103/2165] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:15.755728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd21a4-8a38-4c78-a725-b3006ed42f0d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:15.757843 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-28cd21a4-8a38-4c78-a725-b3006ed42f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:15.931261 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd21a4-8a38-4c78-a725-b3006ed42f0d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:15.941390 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d9b2e-e3f9-48c6-b77a-0139152983ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:15.942561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d9b2e-e3f9-48c6-b77a-0139152983ae service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:15.948703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d9b2e-e3f9-48c6-b77a-0139152983ae service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:15.951201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d9b2e-e3f9-48c6-b77a-0139152983ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:15.968269 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d9b2e-e3f9-48c6-b77a-0139152983ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:15.970801 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d9b2e-e3f9-48c6-b77a-0139152983ae service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:15.980601 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1063/2166] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:15 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:16.229227 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:16.309858 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8736846-aa7b-4d76-94d7-349387432af6 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:16.314176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a8736846-aa7b-4d76-94d7-349387432af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:16.373137 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8736846-aa7b-4d76-94d7-349387432af6 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:16.386731 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79f630-f7d7-4328-ac1d-a1563acf1295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:16.387420 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79f630-f7d7-4328-ac1d-a1563acf1295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:16.387699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79f630-f7d7-4328-ac1d-a1563acf1295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:16.388174 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79f630-f7d7-4328-ac1d-a1563acf1295 admin admin] PATH_INFO: `/v3/projects/d2282541ffb84ea68539c505d04f82af` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:16.391499 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79f630-f7d7-4328-ac1d-a1563acf1295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2282541ffb84ea68539c505d04f82af)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:16.396339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a79f630-f7d7-4328-ac1d-a1563acf1295 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:16.449043 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d9b2e-e3f9-48c6-b77a-0139152983ae service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:16.451712 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f92d9b2e-e3f9-48c6-b77a-0139152983ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:16.475834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d9b2e-e3f9-48c6-b77a-0139152983ae service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:16.481013 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe4636-1ebd-459c-ad31-864525802852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:16.482741 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe4636-1ebd-459c-ad31-864525802852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:16.483239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe4636-1ebd-459c-ad31-864525802852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:16.483519 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe4636-1ebd-459c-ad31-864525802852 admin admin] PATH_INFO: `/v3/users/b1c158b9dbe44e27a2a681001b4cd248` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:16.484957 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe4636-1ebd-459c-ad31-864525802852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1c158b9dbe44e27a2a681001b4cd248)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:16.487256 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe4636-1ebd-459c-ad31-864525802852 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:16.674171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c3fe4636-1ebd-459c-ad31-864525802852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1c158b9dbe44e27a2a681001b4cd248'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:16.688774 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1a79f630-f7d7-4328-ac1d-a1563acf1295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2282541ffb84ea68539c505d04f82af', 'request_id': 'req-1a79f630-f7d7-4328-ac1d-a1563acf1295'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:16.690584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c3fe4636-1ebd-459c-ad31-864525802852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1c158b9dbe44e27a2a681001b4cd248'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:16.695673 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c3fe4636-1ebd-459c-ad31-864525802852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1c158b9dbe44e27a2a681001b4cd248'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:16.698821 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1a79f630-f7d7-4328-ac1d-a1563acf1295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2282541ffb84ea68539c505d04f82af', 'request_id': 'req-1a79f630-f7d7-4328-ac1d-a1563acf1295'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:16.788866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c3fe4636-1ebd-459c-ad31-864525802852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1c158b9dbe44e27a2a681001b4cd248'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:16.799694 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c3fe4636-1ebd-459c-ad31-864525802852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1c158b9dbe44e27a2a681001b4cd248'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:16.815733 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1064/2167] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:16 2022] DELETE /identity/v3/users/b1c158b9dbe44e27a2a681001b4cd248 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:16.817720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3e16c-4206-42ec-adf9-142ba774d68f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:16.818079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3e16c-4206-42ec-adf9-142ba774d68f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:16.818553 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3e16c-4206-42ec-adf9-142ba774d68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:16.887438 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1a79f630-f7d7-4328-ac1d-a1563acf1295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2282541ffb84ea68539c505d04f82af', 'request_id': 'req-1a79f630-f7d7-4328-ac1d-a1563acf1295'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:16.912628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1a79f630-f7d7-4328-ac1d-a1563acf1295 admin admin] The token cache is being invalidate because project d2282541ffb84ea68539c505d04f82af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:16.914652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1a79f630-f7d7-4328-ac1d-a1563acf1295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:16.916850 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1a79f630-f7d7-4328-ac1d-a1563acf1295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:16.921274 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1104/2168] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:16 2022] DELETE /identity/v3/projects/d2282541ffb84ea68539c505d04f82af => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:16.923221 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13842863-6b36-4924-924b-d75c1c52ef55 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:16.923649 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13842863-6b36-4924-924b-d75c1c52ef55 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:16.924128 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13842863-6b36-4924-924b-d75c1c52ef55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:16.968810 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-13842863-6b36-4924-924b-d75c1c52ef55 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:16.971762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-13842863-6b36-4924-924b-d75c1c52ef55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:17.004010 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9cc3e16c-4206-42ec-adf9-142ba774d68f None None] MFA Rules not processed for user `3e64b86aefeb4a7fb0710b69e7cd1063`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:17.005249 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9cc3e16c-4206-42ec-adf9-142ba774d68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:17.078962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1105/2169] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:17.080499 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee91d6-09fc-4dc1-882a-9f90ce133df2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:17.080786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee91d6-09fc-4dc1-882a-9f90ce133df2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:17.081061 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee91d6-09fc-4dc1-882a-9f90ce133df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:17.092601 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1065/2170] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:17.095080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68184449-0157-4ce9-a95f-409fa6ab4269 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:17.095574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68184449-0157-4ce9-a95f-409fa6ab4269 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:17.096317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68184449-0157-4ce9-a95f-409fa6ab4269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:17.103062 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-93ee91d6-09fc-4dc1-882a-9f90ce133df2 None None] MFA Rules not processed for user `ae05a859b3eb47e5ab60e39467b5ab06`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:17.104535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-93ee91d6-09fc-4dc1-882a-9f90ce133df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:17.121765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-68184449-0157-4ce9-a95f-409fa6ab4269 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:17.123561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-68184449-0157-4ce9-a95f-409fa6ab4269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:17.133246 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1066/2171] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:17.134440 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68184449-0157-4ce9-a95f-409fa6ab4269 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:17.135077 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:17.136410 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-68184449-0157-4ce9-a95f-409fa6ab4269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:17.180115 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1106/2172] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:17.181691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee91d6-09fc-4dc1-882a-9f90ce133df2 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:17.183848 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-93ee91d6-09fc-4dc1-882a-9f90ce133df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:17.247754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68184449-0157-4ce9-a95f-409fa6ab4269 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:17.261672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73c352-0821-4b6b-a9e9-04d76aadcbcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:17.262452 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73c352-0821-4b6b-a9e9-04d76aadcbcf service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:17.262587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73c352-0821-4b6b-a9e9-04d76aadcbcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:17.263672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73c352-0821-4b6b-a9e9-04d76aadcbcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:17.275858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73c352-0821-4b6b-a9e9-04d76aadcbcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:17.277906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73c352-0821-4b6b-a9e9-04d76aadcbcf service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:17.280210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee91d6-09fc-4dc1-882a-9f90ce133df2 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:17.286608 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a74ffe-066b-411e-a050-33a297b7252c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:17.287466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a74ffe-066b-411e-a050-33a297b7252c service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:17.288055 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a74ffe-066b-411e-a050-33a297b7252c service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:17.288485 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a74ffe-066b-411e-a050-33a297b7252c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:17.289850 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1067/2173] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:17.291059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cda36-e53d-4587-adea-95eef871c2a7 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:17.291334 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cda36-e53d-4587-adea-95eef871c2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:17.291613 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cda36-e53d-4587-adea-95eef871c2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:17.315382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9f1cda36-e53d-4587-adea-95eef871c2a7 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:17.316604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9f1cda36-e53d-4587-adea-95eef871c2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:17.327702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1068/2174] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:17.335879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cda36-e53d-4587-adea-95eef871c2a7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:17.339915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a74ffe-066b-411e-a050-33a297b7252c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:17.342904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a74ffe-066b-411e-a050-33a297b7252c service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:17.362182 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cda36-e53d-4587-adea-95eef871c2a7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:17.366870 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1107/2175] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:17.371778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6440c9-a2da-40bd-b096-1bfa3b9b3b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:17.372712 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6440c9-a2da-40bd-b096-1bfa3b9b3b30 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:17.373241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6440c9-a2da-40bd-b096-1bfa3b9b3b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:17.373686 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6440c9-a2da-40bd-b096-1bfa3b9b3b30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:17.374652 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6440c9-a2da-40bd-b096-1bfa3b9b3b30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:05:17.375067 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6440c9-a2da-40bd-b096-1bfa3b9b3b30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:17.380436 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6440c9-a2da-40bd-b096-1bfa3b9b3b30 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:17.395887 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1069/2176] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:05:17.399941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a74ffe-066b-411e-a050-33a297b7252c service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:17.417227 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a74ffe-066b-411e-a050-33a297b7252c service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:17.424335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440535b-2864-4493-8a88-d6196a5bb8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:17.425389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440535b-2864-4493-8a88-d6196a5bb8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:17.426280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440535b-2864-4493-8a88-d6196a5bb8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:17.426788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b440535b-2864-4493-8a88-d6196a5bb8c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:17.427891 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440535b-2864-4493-8a88-d6196a5bb8c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:17.431760 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b440535b-2864-4493-8a88-d6196a5bb8c3 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:17.649979 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6440c9-a2da-40bd-b096-1bfa3b9b3b30 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:17.650976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1108/2177] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:05:17 2022] POST /identity/v3/projects => generated 363 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:17.662734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6440c9-a2da-40bd-b096-1bfa3b9b3b30 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:17.770600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d59df-a8f5-446e-be51-f7265f2d18a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:17.771267 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d59df-a8f5-446e-be51-f7265f2d18a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:17.771555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d59df-a8f5-446e-be51-f7265f2d18a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:17.771809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d59df-a8f5-446e-be51-f7265f2d18a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:17.772430 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d59df-a8f5-446e-be51-f7265f2d18a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:17.777113 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d59df-a8f5-446e-be51-f7265f2d18a6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:17.982689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1070/2178] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:05:17 2022] POST /identity/v3/users => generated 282 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:17.982820 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440535b-2864-4493-8a88-d6196a5bb8c3 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:17.996132 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b440535b-2864-4493-8a88-d6196a5bb8c3 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:18.001718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6991a80-7623-49c3-96cb-55e3a6588aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:18.002582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6991a80-7623-49c3-96cb-55e3a6588aff admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:18.003065 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6991a80-7623-49c3-96cb-55e3a6588aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:18.003486 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6991a80-7623-49c3-96cb-55e3a6588aff admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:18.014318 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6991a80-7623-49c3-96cb-55e3a6588aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:18.016070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6991a80-7623-49c3-96cb-55e3a6588aff admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:18.031561 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1109/2179] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:18.032882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d59df-a8f5-446e-be51-f7265f2d18a6 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:18.043073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d59df-a8f5-446e-be51-f7265f2d18a6 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:18.050919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bbb1e-80e0-4060-9735-6cda36a3d1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:18.051850 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bbb1e-80e0-4060-9735-6cda36a3d1fc admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:18.052342 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bbb1e-80e0-4060-9735-6cda36a3d1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:18.052879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bbb1e-80e0-4060-9735-6cda36a3d1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:18.053549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bbb1e-80e0-4060-9735-6cda36a3d1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:18.054075 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6991a80-7623-49c3-96cb-55e3a6588aff admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:18.055351 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bbb1e-80e0-4060-9735-6cda36a3d1fc admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:18.056506 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f6991a80-7623-49c3-96cb-55e3a6588aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:18.067099 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1071/2180] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:18.071510 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6991a80-7623-49c3-96cb-55e3a6588aff admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:18.076011 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bbb1e-80e0-4060-9735-6cda36a3d1fc admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:18.078036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2047c-962d-447a-ae97-058933e9ba72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:18.084237 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2047c-962d-447a-ae97-058933e9ba72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:18.084237 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2047c-962d-447a-ae97-058933e9ba72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:18.084237 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2047c-962d-447a-ae97-058933e9ba72 admin admin] PATH_INFO: `/v3/projects/cadbea2cdcc74bdca36c78f05be3c040` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:18.084237 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2047c-962d-447a-ae97-058933e9ba72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cadbea2cdcc74bdca36c78f05be3c040)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:18.084237 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2047c-962d-447a-ae97-058933e9ba72 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:18.088149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bbb1e-80e0-4060-9735-6cda36a3d1fc admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:18.095872 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2275a0-e9a8-4a4e-a61f-16ec9d0fb056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:18.096583 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2275a0-e9a8-4a4e-a61f-16ec9d0fb056 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:18.096890 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2275a0-e9a8-4a4e-a61f-16ec9d0fb056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:18.097169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2275a0-e9a8-4a4e-a61f-16ec9d0fb056 admin admin] PATH_INFO: `/v3/projects/b87bb6ec54f945b19e98eb3dbea624e2/users/8d0862bc40f74ac59ad17525ddb7d3e4/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:18.114603 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2275a0-e9a8-4a4e-a61f-16ec9d0fb056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87bb6ec54f945b19e98eb3dbea624e2, user_id=8d0862bc40f74ac59ad17525ddb7d3e4, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:18.117357 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2275a0-e9a8-4a4e-a61f-16ec9d0fb056 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:18.349113 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1072/2181] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:18 2022] PUT /identity/v3/projects/b87bb6ec54f945b19e98eb3dbea624e2/users/8d0862bc40f74ac59ad17525ddb7d3e4/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:05:18.360789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0501cc-57f8-4eaa-afc0-5f8b7a090554 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:18.361095 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0501cc-57f8-4eaa-afc0-5f8b7a090554 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:18.361377 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0501cc-57f8-4eaa-afc0-5f8b7a090554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:18.380803 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-84b2047c-962d-447a-ae97-058933e9ba72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cadbea2cdcc74bdca36c78f05be3c040', 'request_id': 'req-84b2047c-962d-447a-ae97-058933e9ba72'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:18.386995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-84b2047c-962d-447a-ae97-058933e9ba72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cadbea2cdcc74bdca36c78f05be3c040', 'request_id': 'req-84b2047c-962d-447a-ae97-058933e9ba72'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:18.394720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-cb0501cc-57f8-4eaa-afc0-5f8b7a090554 None None] MFA Rules not processed for user `8d0862bc40f74ac59ad17525ddb7d3e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:18.395971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cb0501cc-57f8-4eaa-afc0-5f8b7a090554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:18.462847 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1073/2182] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:18.516004 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0501cc-57f8-4eaa-afc0-5f8b7a090554 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:18.537724 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-84b2047c-962d-447a-ae97-058933e9ba72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cadbea2cdcc74bdca36c78f05be3c040', 'request_id': 'req-84b2047c-962d-447a-ae97-058933e9ba72'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:18.556227 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-84b2047c-962d-447a-ae97-058933e9ba72 admin admin] The token cache is being invalidate because project cadbea2cdcc74bdca36c78f05be3c040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:18.556703 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-84b2047c-962d-447a-ae97-058933e9ba72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:18.559385 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-84b2047c-962d-447a-ae97-058933e9ba72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:18.565383 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1110/2183] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:18 2022] DELETE /identity/v3/projects/cadbea2cdcc74bdca36c78f05be3c040 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:18.566539 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2047c-962d-447a-ae97-058933e9ba72 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:18.569714 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-84b2047c-962d-447a-ae97-058933e9ba72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:18.639266 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0501cc-57f8-4eaa-afc0-5f8b7a090554 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:18.643529 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a944a7-1921-4b52-bf4c-19d99b9fcb61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:18.644126 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a944a7-1921-4b52-bf4c-19d99b9fcb61 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:18.644868 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a944a7-1921-4b52-bf4c-19d99b9fcb61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:18.645149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a944a7-1921-4b52-bf4c-19d99b9fcb61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:18.646944 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-51a944a7-1921-4b52-bf4c-19d99b9fcb61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:18.670979 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a944a7-1921-4b52-bf4c-19d99b9fcb61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:18.672458 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a944a7-1921-4b52-bf4c-19d99b9fcb61 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:18.695502 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1074/2184] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:05:18.710028 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2047c-962d-447a-ae97-058933e9ba72 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:18.723040 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3658d4-189f-4f6f-89aa-eb8112bae433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:18.723699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3658d4-189f-4f6f-89aa-eb8112bae433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:18.724147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3658d4-189f-4f6f-89aa-eb8112bae433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:18.736864 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3658d4-189f-4f6f-89aa-eb8112bae433 admin admin] PATH_INFO: `/v3/users/999ff9e9db994494973486c936de9a03` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:18.742935 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3658d4-189f-4f6f-89aa-eb8112bae433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=999ff9e9db994494973486c936de9a03)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:18.751268 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3658d4-189f-4f6f-89aa-eb8112bae433 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:19.143552 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6a3658d4-189f-4f6f-89aa-eb8112bae433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999ff9e9db994494973486c936de9a03'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:19.144353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6a3658d4-189f-4f6f-89aa-eb8112bae433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999ff9e9db994494973486c936de9a03'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:19.181543 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6a3658d4-189f-4f6f-89aa-eb8112bae433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999ff9e9db994494973486c936de9a03'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:19.191715 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6a3658d4-189f-4f6f-89aa-eb8112bae433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999ff9e9db994494973486c936de9a03'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:19.303471 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6a3658d4-189f-4f6f-89aa-eb8112bae433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999ff9e9db994494973486c936de9a03'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:19.313072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1111/2185] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:18 2022] DELETE /identity/v3/users/999ff9e9db994494973486c936de9a03 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:19.335002 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:19.940291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a944a7-1921-4b52-bf4c-19d99b9fcb61 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:19.961218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a944a7-1921-4b52-bf4c-19d99b9fcb61 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:20.059824 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2665712-2e1d-4ce0-88e8-d04eb08ef12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:20.062978 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2665712-2e1d-4ce0-88e8-d04eb08ef12c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:20.065327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2665712-2e1d-4ce0-88e8-d04eb08ef12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:20.065629 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2665712-2e1d-4ce0-88e8-d04eb08ef12c admin admin] PATH_INFO: `/v3/projects/a40f9f7b355347238e1c69f5839dd93c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:20.068270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2665712-2e1d-4ce0-88e8-d04eb08ef12c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a40f9f7b355347238e1c69f5839dd93c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:20.072644 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2665712-2e1d-4ce0-88e8-d04eb08ef12c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:20.292141 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b2665712-2e1d-4ce0-88e8-d04eb08ef12c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a40f9f7b355347238e1c69f5839dd93c', 'request_id': 'req-b2665712-2e1d-4ce0-88e8-d04eb08ef12c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:20.307041 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b2665712-2e1d-4ce0-88e8-d04eb08ef12c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a40f9f7b355347238e1c69f5839dd93c', 'request_id': 'req-b2665712-2e1d-4ce0-88e8-d04eb08ef12c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:20.320064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b2665712-2e1d-4ce0-88e8-d04eb08ef12c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a40f9f7b355347238e1c69f5839dd93c', 'request_id': 'req-b2665712-2e1d-4ce0-88e8-d04eb08ef12c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:20.438804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b2665712-2e1d-4ce0-88e8-d04eb08ef12c admin admin] The token cache is being invalidate because project a40f9f7b355347238e1c69f5839dd93c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:20.439109 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b2665712-2e1d-4ce0-88e8-d04eb08ef12c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:20.440218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b2665712-2e1d-4ce0-88e8-d04eb08ef12c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:20.441954 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1075/2186] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:19 2022] DELETE /identity/v3/projects/a40f9f7b355347238e1c69f5839dd93c => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:20.446827 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a6470-9486-4603-8508-c9bad1f3c979 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:20.447298 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a6470-9486-4603-8508-c9bad1f3c979 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:20.448005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a6470-9486-4603-8508-c9bad1f3c979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:20.469539 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-af5a6470-9486-4603-8508-c9bad1f3c979 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:20.471815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-af5a6470-9486-4603-8508-c9bad1f3c979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:20.538283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1112/2187] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:20.548085 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b42dc6-85ad-430b-833c-8019b2c9629d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:20.548350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b42dc6-85ad-430b-833c-8019b2c9629d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:20.548645 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b42dc6-85ad-430b-833c-8019b2c9629d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:20.569034 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-51b42dc6-85ad-430b-833c-8019b2c9629d None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:20.570509 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-51b42dc6-85ad-430b-833c-8019b2c9629d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:20.579109 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1076/2188] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:05:20.583897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a6470-9486-4603-8508-c9bad1f3c979 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:20.594739 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a6470-9486-4603-8508-c9bad1f3c979 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:20.600684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf0a91-43c1-481d-a43d-d1b00b22cf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:20.600684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf0a91-43c1-481d-a43d-d1b00b22cf8f admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:20.600684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf0a91-43c1-481d-a43d-d1b00b22cf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:20.600943 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf0a91-43c1-481d-a43d-d1b00b22cf8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:20.601589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf0a91-43c1-481d-a43d-d1b00b22cf8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:05:20.601805 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf0a91-43c1-481d-a43d-d1b00b22cf8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:20.603447 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf0a91-43c1-481d-a43d-d1b00b22cf8f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:20.615512 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1113/2189] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:05:20.619823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b42dc6-85ad-430b-833c-8019b2c9629d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:20.629210 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b42dc6-85ad-430b-833c-8019b2c9629d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:20.634777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f84e2-2681-4fbd-ba47-811a9bb6ecc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:20.635408 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f84e2-2681-4fbd-ba47-811a9bb6ecc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:20.635687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f84e2-2681-4fbd-ba47-811a9bb6ecc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:20.635956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f84e2-2681-4fbd-ba47-811a9bb6ecc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:20.636596 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f84e2-2681-4fbd-ba47-811a9bb6ecc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:20.639164 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f84e2-2681-4fbd-ba47-811a9bb6ecc9 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:20.738232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1077/2190] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:05:20 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:20.738937 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf0a91-43c1-481d-a43d-d1b00b22cf8f admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:20.753472 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf0a91-43c1-481d-a43d-d1b00b22cf8f admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:20.803306 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e414ed5-45c1-48c3-8cf3-bd78f8eeaf51 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:20.803639 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e414ed5-45c1-48c3-8cf3-bd78f8eeaf51 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:20.803865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e414ed5-45c1-48c3-8cf3-bd78f8eeaf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:20.826872 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9e414ed5-45c1-48c3-8cf3-bd78f8eeaf51 None None] MFA Rules not processed for user `3e64b86aefeb4a7fb0710b69e7cd1063`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:20.828113 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9e414ed5-45c1-48c3-8cf3-bd78f8eeaf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:20.833196 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfce3c0-16c7-4494-8c86-9b3a2f9c7cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:20.833817 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfce3c0-16c7-4494-8c86-9b3a2f9c7cbe admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:20.834096 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfce3c0-16c7-4494-8c86-9b3a2f9c7cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:20.834374 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfce3c0-16c7-4494-8c86-9b3a2f9c7cbe admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:20.835216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfce3c0-16c7-4494-8c86-9b3a2f9c7cbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:20.837160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfce3c0-16c7-4494-8c86-9b3a2f9c7cbe admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:20.886061 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1078/2191] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:05:21.026335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1114/2192] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:05:20 2022] POST /identity/v3/users => generated 289 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:05:21.035247 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e414ed5-45c1-48c3-8cf3-bd78f8eeaf51 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:21.048514 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e414ed5-45c1-48c3-8cf3-bd78f8eeaf51 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:21.053613 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8115fc-9974-4df3-a0ce-0ce9553ebaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:21.054149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8115fc-9974-4df3-a0ce-0ce9553ebaa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:21.054427 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8115fc-9974-4df3-a0ce-0ce9553ebaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:21.054711 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8115fc-9974-4df3-a0ce-0ce9553ebaa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:21.055770 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8115fc-9974-4df3-a0ce-0ce9553ebaa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:21.057097 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8115fc-9974-4df3-a0ce-0ce9553ebaa2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:21.068409 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1079/2193] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:21.072301 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfce3c0-16c7-4494-8c86-9b3a2f9c7cbe admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:21.083152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfce3c0-16c7-4494-8c86-9b3a2f9c7cbe admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:21.088000 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82e437-6505-426d-942b-8b8d5600df04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:21.088679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82e437-6505-426d-942b-8b8d5600df04 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:21.089032 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82e437-6505-426d-942b-8b8d5600df04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:21.089379 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82e437-6505-426d-942b-8b8d5600df04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:21.090186 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82e437-6505-426d-942b-8b8d5600df04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:21.092547 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82e437-6505-426d-942b-8b8d5600df04 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:21.103388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1115/2194] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:21.107882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8115fc-9974-4df3-a0ce-0ce9553ebaa2 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:21.121104 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8115fc-9974-4df3-a0ce-0ce9553ebaa2 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:21.128177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54daa1-2b04-44be-abf4-fd7e428dcd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:21.128992 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54daa1-2b04-44be-abf4-fd7e428dcd5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:21.129468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54daa1-2b04-44be-abf4-fd7e428dcd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:21.129918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54daa1-2b04-44be-abf4-fd7e428dcd5a admin admin] PATH_INFO: `/v3/projects/3919237b1ba84e168e175dd565b8892b/users/051ab5db293d4c4abad02268e74e80f1/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:21.151918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54daa1-2b04-44be-abf4-fd7e428dcd5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3919237b1ba84e168e175dd565b8892b, user_id=051ab5db293d4c4abad02268e74e80f1, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:21.156829 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54daa1-2b04-44be-abf4-fd7e428dcd5a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:21.281480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:21.288476 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1080/2195] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:21 2022] PUT /identity/v3/projects/3919237b1ba84e168e175dd565b8892b/users/051ab5db293d4c4abad02268e74e80f1/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:05:21.303805 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaef0c4-9d35-4469-8df2-0ba24fea8890 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:21.304260 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaef0c4-9d35-4469-8df2-0ba24fea8890 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:21.304538 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaef0c4-9d35-4469-8df2-0ba24fea8890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:21.338141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-eeaef0c4-9d35-4469-8df2-0ba24fea8890 None None] MFA Rules not processed for user `051ab5db293d4c4abad02268e74e80f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:21.339365 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-eeaef0c4-9d35-4469-8df2-0ba24fea8890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:21.427027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1116/2196] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:21.432865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54daa1-2b04-44be-abf4-fd7e428dcd5a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:21.502433 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54daa1-2b04-44be-abf4-fd7e428dcd5a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:21.524418 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a98f3-8f41-4e7c-bd59-d5e6acbfc68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:21.524418 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a98f3-8f41-4e7c-bd59-d5e6acbfc68e admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:21.524418 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a98f3-8f41-4e7c-bd59-d5e6acbfc68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:21.524418 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a98f3-8f41-4e7c-bd59-d5e6acbfc68e admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:21.524856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a98f3-8f41-4e7c-bd59-d5e6acbfc68e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:21.531410 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a98f3-8f41-4e7c-bd59-d5e6acbfc68e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:21.651464 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1081/2197] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:05:21 2022] POST /identity/v3/projects => generated 377 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:21.652773 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaef0c4-9d35-4469-8df2-0ba24fea8890 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:21.668024 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaef0c4-9d35-4469-8df2-0ba24fea8890 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:21.729565 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6131537-016a-4e0b-bc4c-522a02b93027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:21.730142 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6131537-016a-4e0b-bc4c-522a02b93027 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:21.730418 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6131537-016a-4e0b-bc4c-522a02b93027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:21.730689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6131537-016a-4e0b-bc4c-522a02b93027 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:21.731345 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6131537-016a-4e0b-bc4c-522a02b93027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:21.733310 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6131537-016a-4e0b-bc4c-522a02b93027 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:21.898011 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1117/2198] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:05:21 2022] POST /identity/v3/users => generated 295 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:21.907936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a98f3-8f41-4e7c-bd59-d5e6acbfc68e admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:21.921891 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a98f3-8f41-4e7c-bd59-d5e6acbfc68e admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:21.928883 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5b71e-9a28-4e25-9808-22c2cc396c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:21.929902 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5b71e-9a28-4e25-9808-22c2cc396c80 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:21.930521 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5b71e-9a28-4e25-9808-22c2cc396c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:21.931019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5b71e-9a28-4e25-9808-22c2cc396c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:21.932087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5b71e-9a28-4e25-9808-22c2cc396c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:21.934240 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5b71e-9a28-4e25-9808-22c2cc396c80 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:21.996605 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1082/2199] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:21.998908 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6131537-016a-4e0b-bc4c-522a02b93027 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:22.019996 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6131537-016a-4e0b-bc4c-522a02b93027 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:22.024963 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536f115-d60c-4c2c-9ec5-ee71922c0cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:22.026143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536f115-d60c-4c2c-9ec5-ee71922c0cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:22.026603 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536f115-d60c-4c2c-9ec5-ee71922c0cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:22.027091 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536f115-d60c-4c2c-9ec5-ee71922c0cd1 admin admin] PATH_INFO: `/v3/projects/1da2f5b2e298497face0fabb309c3280/users/04f8f674899f4dc79fb3bf728b010fe1/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:22.067373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536f115-d60c-4c2c-9ec5-ee71922c0cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da2f5b2e298497face0fabb309c3280, user_id=04f8f674899f4dc79fb3bf728b010fe1, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:22.072579 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536f115-d60c-4c2c-9ec5-ee71922c0cd1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:22.169540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1118/2200] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:21 2022] PUT /identity/v3/projects/1da2f5b2e298497face0fabb309c3280/users/04f8f674899f4dc79fb3bf728b010fe1/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:22.172342 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5b71e-9a28-4e25-9808-22c2cc396c80 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:22.183498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5b71e-9a28-4e25-9808-22c2cc396c80 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:22.252342 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e4b67-f3b5-4899-9deb-f4d4e93cfc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:22.253022 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e4b67-f3b5-4899-9deb-f4d4e93cfc34 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:22.253300 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e4b67-f3b5-4899-9deb-f4d4e93cfc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:22.253570 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e4b67-f3b5-4899-9deb-f4d4e93cfc34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:22.254258 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e4b67-f3b5-4899-9deb-f4d4e93cfc34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:22.256123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e4b67-f3b5-4899-9deb-f4d4e93cfc34 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:22.266915 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1083/2201] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:22.271265 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536f115-d60c-4c2c-9ec5-ee71922c0cd1 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:22.282155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536f115-d60c-4c2c-9ec5-ee71922c0cd1 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:22.287050 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899877ea-09fc-4fd1-89a4-c8f1b098174e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:22.287700 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899877ea-09fc-4fd1-89a4-c8f1b098174e admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:22.287981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899877ea-09fc-4fd1-89a4-c8f1b098174e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:22.288281 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899877ea-09fc-4fd1-89a4-c8f1b098174e admin admin] PATH_INFO: `/v3/projects/1da2f5b2e298497face0fabb309c3280/users/04f8f674899f4dc79fb3bf728b010fe1/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:22.290185 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899877ea-09fc-4fd1-89a4-c8f1b098174e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da2f5b2e298497face0fabb309c3280, user_id=04f8f674899f4dc79fb3bf728b010fe1, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:22.292902 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899877ea-09fc-4fd1-89a4-c8f1b098174e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:22.310673 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1119/2202] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:22 2022] PUT /identity/v3/projects/1da2f5b2e298497face0fabb309c3280/users/04f8f674899f4dc79fb3bf728b010fe1/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:22.321887 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff626a-41bb-4a45-92a2-23ab31caed72 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:22.322179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff626a-41bb-4a45-92a2-23ab31caed72 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:22.322461 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff626a-41bb-4a45-92a2-23ab31caed72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:22.354592 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-40ff626a-41bb-4a45-92a2-23ab31caed72 None None] MFA Rules not processed for user `04f8f674899f4dc79fb3bf728b010fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:22.355848 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-40ff626a-41bb-4a45-92a2-23ab31caed72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:22.433972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1084/2203] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:22.446829 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899877ea-09fc-4fd1-89a4-c8f1b098174e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:22.448625 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-899877ea-09fc-4fd1-89a4-c8f1b098174e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:22.524597 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899877ea-09fc-4fd1-89a4-c8f1b098174e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:22.530147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fcdd1-c54a-4ab9-9a38-742683029ee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:22.530866 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fcdd1-c54a-4ab9-9a38-742683029ee3 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:22.531189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fcdd1-c54a-4ab9-9a38-742683029ee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:22.533623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fcdd1-c54a-4ab9-9a38-742683029ee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:22.612176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fcdd1-c54a-4ab9-9a38-742683029ee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:22.614370 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fcdd1-c54a-4ab9-9a38-742683029ee3 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:22.634044 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1120/2204] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:22.817809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:23.891108 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff626a-41bb-4a45-92a2-23ab31caed72 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:23.893319 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-40ff626a-41bb-4a45-92a2-23ab31caed72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:23.970421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff626a-41bb-4a45-92a2-23ab31caed72 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:23.976022 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015a4de-d9c3-434b-8b40-729a684b989d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:23.976817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015a4de-d9c3-434b-8b40-729a684b989d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:23.977172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015a4de-d9c3-434b-8b40-729a684b989d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:23.977806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015a4de-d9c3-434b-8b40-729a684b989d admin admin] PATH_INFO: `/v3/users/063767cca57f431091c6b6d7dbb9597e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:23.979063 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015a4de-d9c3-434b-8b40-729a684b989d admin admin] RBAC: Authorizing `identity:delete_user(user_id=063767cca57f431091c6b6d7dbb9597e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:23.981377 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015a4de-d9c3-434b-8b40-729a684b989d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:24.201896 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:24.215578 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5015a4de-d9c3-434b-8b40-729a684b989d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063767cca57f431091c6b6d7dbb9597e'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:24.229290 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5015a4de-d9c3-434b-8b40-729a684b989d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063767cca57f431091c6b6d7dbb9597e'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:24.230073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5015a4de-d9c3-434b-8b40-729a684b989d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063767cca57f431091c6b6d7dbb9597e'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:24.319868 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5015a4de-d9c3-434b-8b40-729a684b989d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063767cca57f431091c6b6d7dbb9597e'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:24.328489 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5015a4de-d9c3-434b-8b40-729a684b989d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063767cca57f431091c6b6d7dbb9597e'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:24.334735 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1085/2205] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:23 2022] DELETE /identity/v3/users/063767cca57f431091c6b6d7dbb9597e => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:24.339254 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2a0a7-9906-4fc8-ad47-81d1f423b8e7 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:24.339538 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2a0a7-9906-4fc8-ad47-81d1f423b8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:24.339810 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2a0a7-9906-4fc8-ad47-81d1f423b8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:24.359179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-76e2a0a7-9906-4fc8-ad47-81d1f423b8e7 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:24.360435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-76e2a0a7-9906-4fc8-ad47-81d1f423b8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:24.455809 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1121/2206] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:24.468498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015a4de-d9c3-434b-8b40-729a684b989d admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:24.469942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5015a4de-d9c3-434b-8b40-729a684b989d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:24.529034 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015a4de-d9c3-434b-8b40-729a684b989d admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:24.532551 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818e769-9c62-47c1-a5ca-d4e2d21a2383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:24.533149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818e769-9c62-47c1-a5ca-d4e2d21a2383 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:24.533425 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818e769-9c62-47c1-a5ca-d4e2d21a2383 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:24.533774 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818e769-9c62-47c1-a5ca-d4e2d21a2383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:24.542500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818e769-9c62-47c1-a5ca-d4e2d21a2383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:24.544668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818e769-9c62-47c1-a5ca-d4e2d21a2383 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:24.554220 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1086/2207] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:25.075897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2a0a7-9906-4fc8-ad47-81d1f423b8e7 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:25.080528 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-76e2a0a7-9906-4fc8-ad47-81d1f423b8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:25.090150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2a0a7-9906-4fc8-ad47-81d1f423b8e7 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:25.095620 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0db57f-098e-415b-81b8-2dbbca22638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:25.096459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0db57f-098e-415b-81b8-2dbbca22638f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:25.096734 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0db57f-098e-415b-81b8-2dbbca22638f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:25.097154 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0db57f-098e-415b-81b8-2dbbca22638f admin admin] PATH_INFO: `/v3/projects/33690a8b11eb4509a07590dabcdf8a83` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:25.100861 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0db57f-098e-415b-81b8-2dbbca22638f admin admin] RBAC: Authorizing `identity:delete_project(project_id=33690a8b11eb4509a07590dabcdf8a83)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:25.100861 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0db57f-098e-415b-81b8-2dbbca22638f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:25.240983 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-aa0db57f-098e-415b-81b8-2dbbca22638f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33690a8b11eb4509a07590dabcdf8a83', 'request_id': 'req-aa0db57f-098e-415b-81b8-2dbbca22638f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:25.246339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-aa0db57f-098e-415b-81b8-2dbbca22638f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33690a8b11eb4509a07590dabcdf8a83', 'request_id': 'req-aa0db57f-098e-415b-81b8-2dbbca22638f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:25.354017 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-aa0db57f-098e-415b-81b8-2dbbca22638f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33690a8b11eb4509a07590dabcdf8a83', 'request_id': 'req-aa0db57f-098e-415b-81b8-2dbbca22638f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:25.367604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-aa0db57f-098e-415b-81b8-2dbbca22638f admin admin] The token cache is being invalidate because project 33690a8b11eb4509a07590dabcdf8a83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:25.367893 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-aa0db57f-098e-415b-81b8-2dbbca22638f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:25.368517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-aa0db57f-098e-415b-81b8-2dbbca22638f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:25.369984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1122/2208] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:25 2022] DELETE /identity/v3/projects/33690a8b11eb4509a07590dabcdf8a83 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:25.374051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818e769-9c62-47c1-a5ca-d4e2d21a2383 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:25.380413 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:25.385748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818e769-9c62-47c1-a5ca-d4e2d21a2383 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:25.444977 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9318b82-d81f-4b48-a717-94b79257b4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:25.445904 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9318b82-d81f-4b48-a717-94b79257b4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:25.446263 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9318b82-d81f-4b48-a717-94b79257b4db admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:25.446604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9318b82-d81f-4b48-a717-94b79257b4db admin admin] PATH_INFO: `/v3/users/c1e4461f7f174ba6a9deb954dfe1c52f` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:25.448585 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9318b82-d81f-4b48-a717-94b79257b4db admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1e4461f7f174ba6a9deb954dfe1c52f)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:25.450683 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9318b82-d81f-4b48-a717-94b79257b4db admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:25.684527 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a9318b82-d81f-4b48-a717-94b79257b4db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1e4461f7f174ba6a9deb954dfe1c52f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:25.697765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a9318b82-d81f-4b48-a717-94b79257b4db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1e4461f7f174ba6a9deb954dfe1c52f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:25.698440 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a9318b82-d81f-4b48-a717-94b79257b4db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1e4461f7f174ba6a9deb954dfe1c52f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:25.788460 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a9318b82-d81f-4b48-a717-94b79257b4db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1e4461f7f174ba6a9deb954dfe1c52f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:25.796712 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a9318b82-d81f-4b48-a717-94b79257b4db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1e4461f7f174ba6a9deb954dfe1c52f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:25.802646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1087/2209] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:25 2022] DELETE /identity/v3/users/c1e4461f7f174ba6a9deb954dfe1c52f => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:26.327563 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0db57f-098e-415b-81b8-2dbbca22638f admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:26.336005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-aa0db57f-098e-415b-81b8-2dbbca22638f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:26.347283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0db57f-098e-415b-81b8-2dbbca22638f admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:26.407566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f5532-b2c6-479e-b2fa-6e9a0eb0c1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:26.408196 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f5532-b2c6-479e-b2fa-6e9a0eb0c1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:26.408473 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f5532-b2c6-479e-b2fa-6e9a0eb0c1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:26.408741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f5532-b2c6-479e-b2fa-6e9a0eb0c1fa admin admin] PATH_INFO: `/v3/projects/e4e2d25429fa4858af2d3825ef8823bc` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:26.409890 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f5532-b2c6-479e-b2fa-6e9a0eb0c1fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4e2d25429fa4858af2d3825ef8823bc)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:26.411840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f5532-b2c6-479e-b2fa-6e9a0eb0c1fa admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:26.520166 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:26.524498 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0f4f5532-b2c6-479e-b2fa-6e9a0eb0c1fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4e2d25429fa4858af2d3825ef8823bc', 'request_id': 'req-0f4f5532-b2c6-479e-b2fa-6e9a0eb0c1fa'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:26.528913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0f4f5532-b2c6-479e-b2fa-6e9a0eb0c1fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4e2d25429fa4858af2d3825ef8823bc', 'request_id': 'req-0f4f5532-b2c6-479e-b2fa-6e9a0eb0c1fa'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:26.641138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0f4f5532-b2c6-479e-b2fa-6e9a0eb0c1fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4e2d25429fa4858af2d3825ef8823bc', 'request_id': 'req-0f4f5532-b2c6-479e-b2fa-6e9a0eb0c1fa'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:26.652522 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0f4f5532-b2c6-479e-b2fa-6e9a0eb0c1fa admin admin] The token cache is being invalidate because project e4e2d25429fa4858af2d3825ef8823bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:26.652809 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0f4f5532-b2c6-479e-b2fa-6e9a0eb0c1fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:26.653507 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0f4f5532-b2c6-479e-b2fa-6e9a0eb0c1fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:26.655135 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1123/2210] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:26 2022] DELETE /identity/v3/projects/e4e2d25429fa4858af2d3825ef8823bc => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:26.659910 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f93ca-d727-4b6f-af8d-ba7b6ef39c4c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:26.660379 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f93ca-d727-4b6f-af8d-ba7b6ef39c4c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:26.660485 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f93ca-d727-4b6f-af8d-ba7b6ef39c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:26.680523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4e4f93ca-d727-4b6f-af8d-ba7b6ef39c4c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:26.681779 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4e4f93ca-d727-4b6f-af8d-ba7b6ef39c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:26.744907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1088/2211] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:26.760648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea6b26-6558-4d51-ace2-6095cac82e46 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:26.760784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea6b26-6558-4d51-ace2-6095cac82e46 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:26.761064 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea6b26-6558-4d51-ace2-6095cac82e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:26.786343 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-bbea6b26-6558-4d51-ace2-6095cac82e46 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:26.788184 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-bbea6b26-6558-4d51-ace2-6095cac82e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:26.797164 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1124/2212] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:26.803415 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f93ca-d727-4b6f-af8d-ba7b6ef39c4c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:26.814473 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f93ca-d727-4b6f-af8d-ba7b6ef39c4c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:26.819193 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f214d-67a6-412f-b1d3-29b387a2834e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:26.819807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f214d-67a6-412f-b1d3-29b387a2834e admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:26.820092 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f214d-67a6-412f-b1d3-29b387a2834e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:26.820368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f214d-67a6-412f-b1d3-29b387a2834e admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:26.821058 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f214d-67a6-412f-b1d3-29b387a2834e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:05:26.821347 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f214d-67a6-412f-b1d3-29b387a2834e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:26.823025 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f214d-67a6-412f-b1d3-29b387a2834e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:26.835402 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1089/2213] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:05:26.839818 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea6b26-6558-4d51-ace2-6095cac82e46 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:26.849903 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea6b26-6558-4d51-ace2-6095cac82e46 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:26.854710 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2b125-9c78-461e-8899-b3d496b3a9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:26.855633 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2b125-9c78-461e-8899-b3d496b3a9fe admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:26.857418 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2b125-9c78-461e-8899-b3d496b3a9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:26.857418 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2b125-9c78-461e-8899-b3d496b3a9fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:26.857418 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2b125-9c78-461e-8899-b3d496b3a9fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:26.859563 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2b125-9c78-461e-8899-b3d496b3a9fe admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:26.967851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1125/2214] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:05:26 2022] POST /identity/v3/projects => generated 369 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:05:26.972453 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f214d-67a6-412f-b1d3-29b387a2834e admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:26.984674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f214d-67a6-412f-b1d3-29b387a2834e admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:27.070141 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e89d1-a0a1-4b7f-9682-ad397750e095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:27.071025 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e89d1-a0a1-4b7f-9682-ad397750e095 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:27.071378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e89d1-a0a1-4b7f-9682-ad397750e095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:27.071718 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e89d1-a0a1-4b7f-9682-ad397750e095 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:27.072479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e89d1-a0a1-4b7f-9682-ad397750e095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:27.074618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e89d1-a0a1-4b7f-9682-ad397750e095 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:27.227041 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1090/2215] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:05:26 2022] POST /identity/v3/users => generated 285 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:27.228234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2b125-9c78-461e-8899-b3d496b3a9fe admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:27.238936 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2b125-9c78-461e-8899-b3d496b3a9fe admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:27.244200 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5ef8e-90ae-42ac-a5c6-14a0ff547320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:27.244802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5ef8e-90ae-42ac-a5c6-14a0ff547320 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:27.245080 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5ef8e-90ae-42ac-a5c6-14a0ff547320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:27.245485 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5ef8e-90ae-42ac-a5c6-14a0ff547320 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:27.246274 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5ef8e-90ae-42ac-a5c6-14a0ff547320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:27.248142 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5ef8e-90ae-42ac-a5c6-14a0ff547320 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:27.260327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1126/2216] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:27.265393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e89d1-a0a1-4b7f-9682-ad397750e095 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:27.275763 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e89d1-a0a1-4b7f-9682-ad397750e095 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:27.282122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20be11-9dfe-47f4-9bbc-ac02fab5a98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:27.282671 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20be11-9dfe-47f4-9bbc-ac02fab5a98d admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:27.282992 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20be11-9dfe-47f4-9bbc-ac02fab5a98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:27.283420 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20be11-9dfe-47f4-9bbc-ac02fab5a98d admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:27.284256 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20be11-9dfe-47f4-9bbc-ac02fab5a98d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:27.285927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20be11-9dfe-47f4-9bbc-ac02fab5a98d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:27.297972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1091/2217] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:27.302317 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5ef8e-90ae-42ac-a5c6-14a0ff547320 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:27.313270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5ef8e-90ae-42ac-a5c6-14a0ff547320 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:27.318272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c871929-cb4e-46b9-9341-5cf51bc7e8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:27.318969 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c871929-cb4e-46b9-9341-5cf51bc7e8d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:27.322897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c871929-cb4e-46b9-9341-5cf51bc7e8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:27.322897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c871929-cb4e-46b9-9341-5cf51bc7e8d2 admin admin] PATH_INFO: `/v3/projects/40d034b8ae934bc68ff0125a05e5f733/users/62e37d2291614cb9888f91b08313b7da/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:27.335107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c871929-cb4e-46b9-9341-5cf51bc7e8d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40d034b8ae934bc68ff0125a05e5f733, user_id=62e37d2291614cb9888f91b08313b7da, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:27.337751 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c871929-cb4e-46b9-9341-5cf51bc7e8d2 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:27.446464 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1127/2218] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:27 2022] PUT /identity/v3/projects/40d034b8ae934bc68ff0125a05e5f733/users/62e37d2291614cb9888f91b08313b7da/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:27.457693 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282af775-b176-4648-9d12-abdb52a45e18 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:27.457993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282af775-b176-4648-9d12-abdb52a45e18 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:27.458275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282af775-b176-4648-9d12-abdb52a45e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:27.486979 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-282af775-b176-4648-9d12-abdb52a45e18 None None] MFA Rules not processed for user `62e37d2291614cb9888f91b08313b7da`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:27.488383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-282af775-b176-4648-9d12-abdb52a45e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:27.558434 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c871929-cb4e-46b9-9341-5cf51bc7e8d2 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:27.560136 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1092/2219] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:27.629190 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c871929-cb4e-46b9-9341-5cf51bc7e8d2 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:27.635544 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe320b-4fb0-4cc1-bb1c-8186ddeedaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:27.636233 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe320b-4fb0-4cc1-bb1c-8186ddeedaf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:27.636846 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe320b-4fb0-4cc1-bb1c-8186ddeedaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:27.637338 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe320b-4fb0-4cc1-bb1c-8186ddeedaf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:27.639592 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe320b-4fb0-4cc1-bb1c-8186ddeedaf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:27.641953 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe320b-4fb0-4cc1-bb1c-8186ddeedaf4 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:27.721671 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:27.750314 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1128/2220] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:05:27 2022] POST /identity/v3/projects => generated 365 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:05:27.759589 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282af775-b176-4648-9d12-abdb52a45e18 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:27.771715 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282af775-b176-4648-9d12-abdb52a45e18 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:27.834732 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89c534-10d8-4def-8c7c-1de5a4a1cf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:27.835718 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89c534-10d8-4def-8c7c-1de5a4a1cf77 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:27.836153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89c534-10d8-4def-8c7c-1de5a4a1cf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:27.836578 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89c534-10d8-4def-8c7c-1de5a4a1cf77 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:27.837389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89c534-10d8-4def-8c7c-1de5a4a1cf77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:27.839619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89c534-10d8-4def-8c7c-1de5a4a1cf77 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:27.979217 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1093/2221] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:05:27 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:05:27.984224 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe320b-4fb0-4cc1-bb1c-8186ddeedaf4 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:28.002650 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe320b-4fb0-4cc1-bb1c-8186ddeedaf4 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:28.007423 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d06ec-2651-41f3-a7b0-b3e39414bed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:28.008049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d06ec-2651-41f3-a7b0-b3e39414bed7 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:28.008333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d06ec-2651-41f3-a7b0-b3e39414bed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:28.008611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d06ec-2651-41f3-a7b0-b3e39414bed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:28.013256 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d06ec-2651-41f3-a7b0-b3e39414bed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:28.013256 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d06ec-2651-41f3-a7b0-b3e39414bed7 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:28.022268 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1129/2222] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:28.026305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89c534-10d8-4def-8c7c-1de5a4a1cf77 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:28.036923 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89c534-10d8-4def-8c7c-1de5a4a1cf77 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:28.041799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fed84b-c858-490f-8a4a-6806e5de017c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:28.042543 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fed84b-c858-490f-8a4a-6806e5de017c admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:28.042999 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fed84b-c858-490f-8a4a-6806e5de017c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:28.043360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fed84b-c858-490f-8a4a-6806e5de017c admin admin] PATH_INFO: `/v3/projects/2fe3dd78c03f4f7fb37465db7b761141/users/778501efae8644d4ada0f79bca163ab2/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:28.078514 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fed84b-c858-490f-8a4a-6806e5de017c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe3dd78c03f4f7fb37465db7b761141, user_id=778501efae8644d4ada0f79bca163ab2, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:28.082330 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fed84b-c858-490f-8a4a-6806e5de017c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:28.190480 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1094/2223] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:28 2022] PUT /identity/v3/projects/2fe3dd78c03f4f7fb37465db7b761141/users/778501efae8644d4ada0f79bca163ab2/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:05:28.194728 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d06ec-2651-41f3-a7b0-b3e39414bed7 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:28.205850 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d06ec-2651-41f3-a7b0-b3e39414bed7 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:28.270447 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc527da-99de-4da9-85ea-1feeb9db1681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:28.271174 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc527da-99de-4da9-85ea-1feeb9db1681 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:28.271459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc527da-99de-4da9-85ea-1feeb9db1681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:28.271736 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc527da-99de-4da9-85ea-1feeb9db1681 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:28.272410 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc527da-99de-4da9-85ea-1feeb9db1681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:28.274036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc527da-99de-4da9-85ea-1feeb9db1681 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:28.285258 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1130/2224] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:05:28.289058 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fed84b-c858-490f-8a4a-6806e5de017c admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:28.292038 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc527da-99de-4da9-85ea-1feeb9db1681 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:28.294352 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4bc527da-99de-4da9-85ea-1feeb9db1681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:28.301215 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fed84b-c858-490f-8a4a-6806e5de017c admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:28.305830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b643ab58-2df1-4bcc-a46d-80dffd528755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:28.306479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643ab58-2df1-4bcc-a46d-80dffd528755 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:28.307088 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643ab58-2df1-4bcc-a46d-80dffd528755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:28.307404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b643ab58-2df1-4bcc-a46d-80dffd528755 admin admin] PATH_INFO: `/v3/projects/2fe3dd78c03f4f7fb37465db7b761141/users/778501efae8644d4ada0f79bca163ab2/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:28.309923 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643ab58-2df1-4bcc-a46d-80dffd528755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe3dd78c03f4f7fb37465db7b761141, user_id=778501efae8644d4ada0f79bca163ab2, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:28.321417 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b643ab58-2df1-4bcc-a46d-80dffd528755 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:28.326914 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1095/2225] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:28 2022] PUT /identity/v3/projects/2fe3dd78c03f4f7fb37465db7b761141/users/778501efae8644d4ada0f79bca163ab2/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:28.342570 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421429f-b971-4faf-a01f-7707c3fc54e0 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:28.343102 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421429f-b971-4faf-a01f-7707c3fc54e0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:28.343870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421429f-b971-4faf-a01f-7707c3fc54e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:28.358850 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc527da-99de-4da9-85ea-1feeb9db1681 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:28.391790 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7421429f-b971-4faf-a01f-7707c3fc54e0 None None] MFA Rules not processed for user `778501efae8644d4ada0f79bca163ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:28.393926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7421429f-b971-4faf-a01f-7707c3fc54e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:28.430061 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3f6d2-1dbe-47a7-9122-197a41c88a51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:28.430061 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3f6d2-1dbe-47a7-9122-197a41c88a51 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:28.430061 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3f6d2-1dbe-47a7-9122-197a41c88a51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:28.430061 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3f6d2-1dbe-47a7-9122-197a41c88a51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:28.430356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-52c3f6d2-1dbe-47a7-9122-197a41c88a51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:28.514527 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3f6d2-1dbe-47a7-9122-197a41c88a51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:28.516299 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1096/2226] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:28.516423 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3f6d2-1dbe-47a7-9122-197a41c88a51 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:28.527132 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1131/2227] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:05:28.657259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421429f-b971-4faf-a01f-7707c3fc54e0 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:28.667714 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421429f-b971-4faf-a01f-7707c3fc54e0 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:28.669514 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:28.671807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2d272-93a2-461d-8d7f-cf07def91ea6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:28.672495 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2d272-93a2-461d-8d7f-cf07def91ea6 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:28.678275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2d272-93a2-461d-8d7f-cf07def91ea6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:28.678275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2d272-93a2-461d-8d7f-cf07def91ea6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:28.683260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2d272-93a2-461d-8d7f-cf07def91ea6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:28.684728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2d272-93a2-461d-8d7f-cf07def91ea6 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:28.694257 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1097/2228] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:28.818814 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3f6d2-1dbe-47a7-9122-197a41c88a51 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:28.828342 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3f6d2-1dbe-47a7-9122-197a41c88a51 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:28.832476 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc2ed3-7d0f-49e3-a0e2-0a26e8a571e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:28.833188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc2ed3-7d0f-49e3-a0e2-0a26e8a571e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:28.833481 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc2ed3-7d0f-49e3-a0e2-0a26e8a571e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:28.833755 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc2ed3-7d0f-49e3-a0e2-0a26e8a571e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:28.912275 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc2ed3-7d0f-49e3-a0e2-0a26e8a571e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:28.915433 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc2ed3-7d0f-49e3-a0e2-0a26e8a571e4 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:28.924896 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1132/2229] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:29.480008 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:32.686713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:33.057484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:35.056755 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2d272-93a2-461d-8d7f-cf07def91ea6 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:35.060738 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6bb2d272-93a2-461d-8d7f-cf07def91ea6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:35.127155 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:35.144933 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2d272-93a2-461d-8d7f-cf07def91ea6 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:35.149432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca08fce-caf2-447d-917e-5d7efe10a6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:35.150064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca08fce-caf2-447d-917e-5d7efe10a6da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:35.150343 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca08fce-caf2-447d-917e-5d7efe10a6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:35.150617 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca08fce-caf2-447d-917e-5d7efe10a6da admin admin] PATH_INFO: `/v3/users/46622f2abac84ff08b42a5c0d14e9f63` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:35.151771 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca08fce-caf2-447d-917e-5d7efe10a6da admin admin] RBAC: Authorizing `identity:delete_user(user_id=46622f2abac84ff08b42a5c0d14e9f63)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:35.154084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca08fce-caf2-447d-917e-5d7efe10a6da admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:35.396565 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0ca08fce-caf2-447d-917e-5d7efe10a6da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46622f2abac84ff08b42a5c0d14e9f63'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:35.409181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0ca08fce-caf2-447d-917e-5d7efe10a6da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46622f2abac84ff08b42a5c0d14e9f63'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:35.409967 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0ca08fce-caf2-447d-917e-5d7efe10a6da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46622f2abac84ff08b42a5c0d14e9f63'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:35.431551 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc2ed3-7d0f-49e3-a0e2-0a26e8a571e4 service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:35.443266 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc2ed3-7d0f-49e3-a0e2-0a26e8a571e4 service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:35.447775 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b223e9d-b83b-48f1-ba79-d39bb34d5463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:35.448387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b223e9d-b83b-48f1-ba79-d39bb34d5463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:35.448666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b223e9d-b83b-48f1-ba79-d39bb34d5463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:35.452870 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b223e9d-b83b-48f1-ba79-d39bb34d5463 admin admin] PATH_INFO: `/v3/users/62e37d2291614cb9888f91b08313b7da` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:35.452870 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b223e9d-b83b-48f1-ba79-d39bb34d5463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62e37d2291614cb9888f91b08313b7da)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:35.452870 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b223e9d-b83b-48f1-ba79-d39bb34d5463 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:35.501516 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0ca08fce-caf2-447d-917e-5d7efe10a6da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46622f2abac84ff08b42a5c0d14e9f63'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:35.509069 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0ca08fce-caf2-447d-917e-5d7efe10a6da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46622f2abac84ff08b42a5c0d14e9f63'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:35.515020 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1098/2230] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:35 2022] DELETE /identity/v3/users/46622f2abac84ff08b42a5c0d14e9f63 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:35.519308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6309efa-fb53-445c-bf5b-d04d6998948e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:35.519601 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6309efa-fb53-445c-bf5b-d04d6998948e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:35.519874 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6309efa-fb53-445c-bf5b-d04d6998948e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:35.538313 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c6309efa-fb53-445c-bf5b-d04d6998948e None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:35.539540 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c6309efa-fb53-445c-bf5b-d04d6998948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:35.598016 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1099/2231] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:05:35.608139 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6309efa-fb53-445c-bf5b-d04d6998948e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:35.609489 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c6309efa-fb53-445c-bf5b-d04d6998948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:35.666198 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6309efa-fb53-445c-bf5b-d04d6998948e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:35.670611 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107b188-5cc5-43f1-aafc-39354b94be61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:35.671272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107b188-5cc5-43f1-aafc-39354b94be61 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:35.671586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107b188-5cc5-43f1-aafc-39354b94be61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:35.671884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107b188-5cc5-43f1-aafc-39354b94be61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:35.680951 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107b188-5cc5-43f1-aafc-39354b94be61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:35.682367 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107b188-5cc5-43f1-aafc-39354b94be61 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:35.692628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1100/2232] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:05:35.723570 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-5b223e9d-b83b-48f1-ba79-d39bb34d5463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62e37d2291614cb9888f91b08313b7da'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:35.724230 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-5b223e9d-b83b-48f1-ba79-d39bb34d5463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62e37d2291614cb9888f91b08313b7da'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:35.737012 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-5b223e9d-b83b-48f1-ba79-d39bb34d5463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62e37d2291614cb9888f91b08313b7da'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:35.744055 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-5b223e9d-b83b-48f1-ba79-d39bb34d5463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62e37d2291614cb9888f91b08313b7da'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:35.857849 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:35.884443 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-5b223e9d-b83b-48f1-ba79-d39bb34d5463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62e37d2291614cb9888f91b08313b7da'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:35.890962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1133/2233] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:35 2022] DELETE /identity/v3/users/62e37d2291614cb9888f91b08313b7da => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:05:35.895733 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f092f1-b921-4856-9d4b-f74eaa771d75 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:35.901111 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f092f1-b921-4856-9d4b-f74eaa771d75 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:35.901111 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f092f1-b921-4856-9d4b-f74eaa771d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:35.916815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b1f092f1-b921-4856-9d4b-f74eaa771d75 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:35.917953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b1f092f1-b921-4856-9d4b-f74eaa771d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:35.983175 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1101/2234] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:35.993118 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b223e9d-b83b-48f1-ba79-d39bb34d5463 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:35.994573 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5b223e9d-b83b-48f1-ba79-d39bb34d5463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:36.056732 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b223e9d-b83b-48f1-ba79-d39bb34d5463 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:36.060875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc8ade-4061-495d-be27-5aaae4264953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:36.061482 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc8ade-4061-495d-be27-5aaae4264953 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:36.061763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc8ade-4061-495d-be27-5aaae4264953 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:36.062036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc8ade-4061-495d-be27-5aaae4264953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:36.071171 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc8ade-4061-495d-be27-5aaae4264953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:36.072623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc8ade-4061-495d-be27-5aaae4264953 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:36.082798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1134/2235] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:36.225396 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f092f1-b921-4856-9d4b-f74eaa771d75 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:36.226965 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b1f092f1-b921-4856-9d4b-f74eaa771d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:36.245360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f092f1-b921-4856-9d4b-f74eaa771d75 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:36.267594 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002015e-1846-4c94-bf7b-befee2965fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:36.268275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002015e-1846-4c94-bf7b-befee2965fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:36.268551 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002015e-1846-4c94-bf7b-befee2965fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:36.269083 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002015e-1846-4c94-bf7b-befee2965fb6 admin admin] PATH_INFO: `/v3/projects/8ceafbb4e11f45ce8379e1455ecf579f` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:36.277608 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002015e-1846-4c94-bf7b-befee2965fb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ceafbb4e11f45ce8379e1455ecf579f)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:36.277608 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002015e-1846-4c94-bf7b-befee2965fb6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:36.463091 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:36.466349 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2002015e-1846-4c94-bf7b-befee2965fb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ceafbb4e11f45ce8379e1455ecf579f', 'request_id': 'req-2002015e-1846-4c94-bf7b-befee2965fb6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:36.471945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2002015e-1846-4c94-bf7b-befee2965fb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ceafbb4e11f45ce8379e1455ecf579f', 'request_id': 'req-2002015e-1846-4c94-bf7b-befee2965fb6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:36.478344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2002015e-1846-4c94-bf7b-befee2965fb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ceafbb4e11f45ce8379e1455ecf579f', 'request_id': 'req-2002015e-1846-4c94-bf7b-befee2965fb6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:36.604825 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2002015e-1846-4c94-bf7b-befee2965fb6 admin admin] The token cache is being invalidate because project 8ceafbb4e11f45ce8379e1455ecf579f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:36.605123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2002015e-1846-4c94-bf7b-befee2965fb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:36.605765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2002015e-1846-4c94-bf7b-befee2965fb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:36.607476 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1102/2236] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:36 2022] DELETE /identity/v3/projects/8ceafbb4e11f45ce8379e1455ecf579f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:36.612597 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcd0fa-795e-4e10-a1e5-9888e85d9469 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:36.613076 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcd0fa-795e-4e10-a1e5-9888e85d9469 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:36.613168 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcd0fa-795e-4e10-a1e5-9888e85d9469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:36.633008 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3cbcd0fa-795e-4e10-a1e5-9888e85d9469 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:36.634265 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3cbcd0fa-795e-4e10-a1e5-9888e85d9469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:36.705220 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1135/2237] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:36.706919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ec4a8-9d10-40a1-8a73-6240282a091f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:36.707216 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ec4a8-9d10-40a1-8a73-6240282a091f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:36.707502 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ec4a8-9d10-40a1-8a73-6240282a091f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:36.720267 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcd0fa-795e-4e10-a1e5-9888e85d9469 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:36.721697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3cbcd0fa-795e-4e10-a1e5-9888e85d9469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:36.734168 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcd0fa-795e-4e10-a1e5-9888e85d9469 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:36.739488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee9c5b-d9ce-4a37-b6ae-745abee311ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:36.740132 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee9c5b-d9ce-4a37-b6ae-745abee311ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:36.740265 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c89ec4a8-9d10-40a1-8a73-6240282a091f None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:36.740410 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee9c5b-d9ce-4a37-b6ae-745abee311ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:36.740691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee9c5b-d9ce-4a37-b6ae-745abee311ab admin admin] PATH_INFO: `/v3/projects/40d034b8ae934bc68ff0125a05e5f733` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:36.742017 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee9c5b-d9ce-4a37-b6ae-745abee311ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=40d034b8ae934bc68ff0125a05e5f733)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:36.743962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee9c5b-d9ce-4a37-b6ae-745abee311ab admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:36.755108 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c89ec4a8-9d10-40a1-8a73-6240282a091f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:36.767545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1103/2238] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:05:36.771813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ec4a8-9d10-40a1-8a73-6240282a091f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:36.781380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ec4a8-9d10-40a1-8a73-6240282a091f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:36.786492 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fa738-9c80-48bd-903a-307fea0709b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:36.788726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fa738-9c80-48bd-903a-307fea0709b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:36.788726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fa738-9c80-48bd-903a-307fea0709b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:36.788726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68fa738-9c80-48bd-903a-307fea0709b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:36.788726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fa738-9c80-48bd-903a-307fea0709b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:05:36.788726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fa738-9c80-48bd-903a-307fea0709b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:36.790189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68fa738-9c80-48bd-903a-307fea0709b1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:36.803209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1104/2239] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:05:36.807581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fa738-9c80-48bd-903a-307fea0709b1 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:36.818202 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68fa738-9c80-48bd-903a-307fea0709b1 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:36.823308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833abfab-829c-48b0-83df-5ac7ffa06a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:36.823904 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833abfab-829c-48b0-83df-5ac7ffa06a61 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:36.824184 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833abfab-829c-48b0-83df-5ac7ffa06a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:36.824454 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833abfab-829c-48b0-83df-5ac7ffa06a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:36.825792 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833abfab-829c-48b0-83df-5ac7ffa06a61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:36.827964 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833abfab-829c-48b0-83df-5ac7ffa06a61 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:36.876586 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cdee9c5b-d9ce-4a37-b6ae-745abee311ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40d034b8ae934bc68ff0125a05e5f733', 'request_id': 'req-cdee9c5b-d9ce-4a37-b6ae-745abee311ab'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:36.882277 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cdee9c5b-d9ce-4a37-b6ae-745abee311ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40d034b8ae934bc68ff0125a05e5f733', 'request_id': 'req-cdee9c5b-d9ce-4a37-b6ae-745abee311ab'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:36.921933 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1105/2240] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:05:36 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:05:36.925982 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833abfab-829c-48b0-83df-5ac7ffa06a61 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:36.942546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cdee9c5b-d9ce-4a37-b6ae-745abee311ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40d034b8ae934bc68ff0125a05e5f733', 'request_id': 'req-cdee9c5b-d9ce-4a37-b6ae-745abee311ab'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:36.956353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cdee9c5b-d9ce-4a37-b6ae-745abee311ab admin admin] The token cache is being invalidate because project 40d034b8ae934bc68ff0125a05e5f733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:36.956766 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cdee9c5b-d9ce-4a37-b6ae-745abee311ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:36.957434 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cdee9c5b-d9ce-4a37-b6ae-745abee311ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:36.959213 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1136/2241] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:36 2022] DELETE /identity/v3/projects/40d034b8ae934bc68ff0125a05e5f733 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:36.968544 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee9c5b-d9ce-4a37-b6ae-745abee311ab admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:36.970736 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-cdee9c5b-d9ce-4a37-b6ae-745abee311ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:36.991459 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833abfab-829c-48b0-83df-5ac7ffa06a61 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:36.996262 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6901f9-52e0-45ae-8d5c-9cfaaad5552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:36.997525 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6901f9-52e0-45ae-8d5c-9cfaaad5552b admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:36.997815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6901f9-52e0-45ae-8d5c-9cfaaad5552b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:36.998278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6901f9-52e0-45ae-8d5c-9cfaaad5552b admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:36.998933 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6901f9-52e0-45ae-8d5c-9cfaaad5552b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:37.001245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6901f9-52e0-45ae-8d5c-9cfaaad5552b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:37.052238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee9c5b-d9ce-4a37-b6ae-745abee311ab admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:37.057163 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73824e6f-2ab9-46b9-8ae5-4a31401bb4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:37.057803 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73824e6f-2ab9-46b9-8ae5-4a31401bb4cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:37.058085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73824e6f-2ab9-46b9-8ae5-4a31401bb4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:37.058362 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73824e6f-2ab9-46b9-8ae5-4a31401bb4cd admin admin] PATH_INFO: `/v3/users/778501efae8644d4ada0f79bca163ab2` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:37.060228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73824e6f-2ab9-46b9-8ae5-4a31401bb4cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=778501efae8644d4ada0f79bca163ab2)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:37.062442 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73824e6f-2ab9-46b9-8ae5-4a31401bb4cd admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:37.129564 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1106/2242] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:05:36 2022] POST /identity/v3/users => generated 285 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:05:37.131211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6901f9-52e0-45ae-8d5c-9cfaaad5552b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:37.132787 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3f6901f9-52e0-45ae-8d5c-9cfaaad5552b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:37.145284 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6901f9-52e0-45ae-8d5c-9cfaaad5552b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:37.150175 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf224c-9de3-40a0-af38-0c79a4fd816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:37.150799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf224c-9de3-40a0-af38-0c79a4fd816a admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:37.151084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf224c-9de3-40a0-af38-0c79a4fd816a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:37.151351 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf224c-9de3-40a0-af38-0c79a4fd816a admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:37.151987 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf224c-9de3-40a0-af38-0c79a4fd816a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:37.153636 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf224c-9de3-40a0-af38-0c79a4fd816a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:37.163992 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1107/2243] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:37.167861 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf224c-9de3-40a0-af38-0c79a4fd816a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:37.178169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf224c-9de3-40a0-af38-0c79a4fd816a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:37.183025 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b832176-5736-47b6-a6d4-b7c9f4ce423f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:37.185703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b832176-5736-47b6-a6d4-b7c9f4ce423f admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:37.185703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b832176-5736-47b6-a6d4-b7c9f4ce423f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:37.185703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b832176-5736-47b6-a6d4-b7c9f4ce423f admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:37.185703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b832176-5736-47b6-a6d4-b7c9f4ce423f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:37.186964 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b832176-5736-47b6-a6d4-b7c9f4ce423f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:37.197394 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1108/2244] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:05:37.201412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b832176-5736-47b6-a6d4-b7c9f4ce423f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:37.214401 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b832176-5736-47b6-a6d4-b7c9f4ce423f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:37.215182 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f4e3c-b857-47e4-b70c-efd96f336c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:37.216332 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f4e3c-b857-47e4-b70c-efd96f336c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:37.216597 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f4e3c-b857-47e4-b70c-efd96f336c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:37.216864 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f4e3c-b857-47e4-b70c-efd96f336c2c admin admin] PATH_INFO: `/v3/projects/fb0f2e5f9d1747b1ac6f698f730a7e32/users/43561432a5924ad8b655fb6dae333800/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:37.231637 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f4e3c-b857-47e4-b70c-efd96f336c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb0f2e5f9d1747b1ac6f698f730a7e32, user_id=43561432a5924ad8b655fb6dae333800, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:37.234302 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f4e3c-b857-47e4-b70c-efd96f336c2c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:37.276153 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-73824e6f-2ab9-46b9-8ae5-4a31401bb4cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '778501efae8644d4ada0f79bca163ab2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:37.276821 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-73824e6f-2ab9-46b9-8ae5-4a31401bb4cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '778501efae8644d4ada0f79bca163ab2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:37.289370 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-73824e6f-2ab9-46b9-8ae5-4a31401bb4cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '778501efae8644d4ada0f79bca163ab2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:37.296994 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-73824e6f-2ab9-46b9-8ae5-4a31401bb4cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '778501efae8644d4ada0f79bca163ab2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:37.361014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1109/2245] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:37 2022] PUT /identity/v3/projects/fb0f2e5f9d1747b1ac6f698f730a7e32/users/43561432a5924ad8b655fb6dae333800/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:05:37.371244 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801ac89-308d-4f67-b6d6-d35c458dd263 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:37.371620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801ac89-308d-4f67-b6d6-d35c458dd263 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:37.372495 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801ac89-308d-4f67-b6d6-d35c458dd263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:37.409281 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6801ac89-308d-4f67-b6d6-d35c458dd263 None None] MFA Rules not processed for user `43561432a5924ad8b655fb6dae333800`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:37.410607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6801ac89-308d-4f67-b6d6-d35c458dd263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:37.433851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-73824e6f-2ab9-46b9-8ae5-4a31401bb4cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '778501efae8644d4ada0f79bca163ab2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:37.445945 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1137/2246] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:36 2022] DELETE /identity/v3/users/778501efae8644d4ada0f79bca163ab2 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:05:37.509650 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1110/2247] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:37.522316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73824e6f-2ab9-46b9-8ae5-4a31401bb4cd admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:37.523777 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-73824e6f-2ab9-46b9-8ae5-4a31401bb4cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:37.624914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73824e6f-2ab9-46b9-8ae5-4a31401bb4cd admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:37.629666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb2ec7-ff6a-4957-a1be-c5a827561986 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fe013f66e2452eaaf84d4b52eca489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:37.630532 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb2ec7-ff6a-4957-a1be-c5a827561986 service glance] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:37.631031 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb2ec7-ff6a-4957-a1be-c5a827561986 service glance] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:37.634014 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb2ec7-ff6a-4957-a1be-c5a827561986 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:37.693505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb2ec7-ff6a-4957-a1be-c5a827561986 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:37.695118 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb2ec7-ff6a-4957-a1be-c5a827561986 service glance] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:37.705477 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1138/2248] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:38.029408 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801ac89-308d-4f67-b6d6-d35c458dd263 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:38.029408 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6801ac89-308d-4f67-b6d6-d35c458dd263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:38.139021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801ac89-308d-4f67-b6d6-d35c458dd263 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:38.216006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146964f0-61d6-4576-b22f-b794527351ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:38.216430 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146964f0-61d6-4576-b22f-b794527351ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:38.216740 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146964f0-61d6-4576-b22f-b794527351ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:38.217066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146964f0-61d6-4576-b22f-b794527351ab admin admin] PATH_INFO: `/v3/projects/2fe3dd78c03f4f7fb37465db7b761141` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:38.218362 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146964f0-61d6-4576-b22f-b794527351ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fe3dd78c03f4f7fb37465db7b761141)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:38.221952 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146964f0-61d6-4576-b22f-b794527351ab admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:38.390574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-146964f0-61d6-4576-b22f-b794527351ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fe3dd78c03f4f7fb37465db7b761141', 'request_id': 'req-146964f0-61d6-4576-b22f-b794527351ab'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:38.396452 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-146964f0-61d6-4576-b22f-b794527351ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fe3dd78c03f4f7fb37465db7b761141', 'request_id': 'req-146964f0-61d6-4576-b22f-b794527351ab'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:38.404076 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-146964f0-61d6-4576-b22f-b794527351ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fe3dd78c03f4f7fb37465db7b761141', 'request_id': 'req-146964f0-61d6-4576-b22f-b794527351ab'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:38.573380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-146964f0-61d6-4576-b22f-b794527351ab admin admin] The token cache is being invalidate because project 2fe3dd78c03f4f7fb37465db7b761141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:38.575201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-146964f0-61d6-4576-b22f-b794527351ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:38.576395 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-146964f0-61d6-4576-b22f-b794527351ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:38.577946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1111/2249] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:38 2022] DELETE /identity/v3/projects/2fe3dd78c03f4f7fb37465db7b761141 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:38.583061 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867c61f-917d-4610-b4e4-73bca3776685 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:38.583388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867c61f-917d-4610-b4e4-73bca3776685 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:38.583625 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867c61f-917d-4610-b4e4-73bca3776685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:38.618877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-0867c61f-917d-4610-b4e4-73bca3776685 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:38.623368 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0867c61f-917d-4610-b4e4-73bca3776685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:38.668943 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:38.705097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1139/2250] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:38.713107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae81d8c-28fe-439a-a779-701a175cf7b5 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:38.713401 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae81d8c-28fe-439a-a779-701a175cf7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:38.713677 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae81d8c-28fe-439a-a779-701a175cf7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:38.736659 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-aae81d8c-28fe-439a-a779-701a175cf7b5 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:38.737877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-aae81d8c-28fe-439a-a779-701a175cf7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:38.746201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1112/2251] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:38.750846 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867c61f-917d-4610-b4e4-73bca3776685 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:38.760895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867c61f-917d-4610-b4e4-73bca3776685 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:38.765981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7def024-99f9-4b7b-a6b6-7c13f60fbf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:38.766590 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7def024-99f9-4b7b-a6b6-7c13f60fbf0e admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:38.766907 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7def024-99f9-4b7b-a6b6-7c13f60fbf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:38.767180 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7def024-99f9-4b7b-a6b6-7c13f60fbf0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:38.776905 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7def024-99f9-4b7b-a6b6-7c13f60fbf0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:05:38.776905 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7def024-99f9-4b7b-a6b6-7c13f60fbf0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:38.776905 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7def024-99f9-4b7b-a6b6-7c13f60fbf0e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:38.782848 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1140/2252] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:05:38.792986 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae81d8c-28fe-439a-a779-701a175cf7b5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:38.808161 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae81d8c-28fe-439a-a779-701a175cf7b5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:38.817691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bcc46-2b6f-4c30-871d-8b563b58b7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:38.818403 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bcc46-2b6f-4c30-871d-8b563b58b7ed admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:38.818744 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bcc46-2b6f-4c30-871d-8b563b58b7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:38.819615 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bcc46-2b6f-4c30-871d-8b563b58b7ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:38.819826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52bcc46-2b6f-4c30-871d-8b563b58b7ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:38.821950 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52bcc46-2b6f-4c30-871d-8b563b58b7ed admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:38.927932 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1113/2253] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:05:38 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:38.934067 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7def024-99f9-4b7b-a6b6-7c13f60fbf0e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:38.947334 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7def024-99f9-4b7b-a6b6-7c13f60fbf0e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:39.015305 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d196a8f-ed3a-4c68-8ae7-7f7108213dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:39.015816 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d196a8f-ed3a-4c68-8ae7-7f7108213dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:39.016100 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d196a8f-ed3a-4c68-8ae7-7f7108213dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:39.016376 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d196a8f-ed3a-4c68-8ae7-7f7108213dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:39.017007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d196a8f-ed3a-4c68-8ae7-7f7108213dd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:39.019056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d196a8f-ed3a-4c68-8ae7-7f7108213dd5 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:39.139501 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=1,keystone:SELECT=93,keystone:INSERT=6 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:39.149902 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1141/2254] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:05:38 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:05:39.151186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bcc46-2b6f-4c30-871d-8b563b58b7ed admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:39.162498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bcc46-2b6f-4c30-871d-8b563b58b7ed admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:39.167852 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd14f0-6a50-499f-80a5-779d0840b066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:39.168584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd14f0-6a50-499f-80a5-779d0840b066 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:39.168906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd14f0-6a50-499f-80a5-779d0840b066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:39.169646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd14f0-6a50-499f-80a5-779d0840b066 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:39.170437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd14f0-6a50-499f-80a5-779d0840b066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:39.172101 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd14f0-6a50-499f-80a5-779d0840b066 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:39.182479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1114/2255] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:39.186608 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d196a8f-ed3a-4c68-8ae7-7f7108213dd5 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:39.196741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d196a8f-ed3a-4c68-8ae7-7f7108213dd5 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:39.202213 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343e1a8-b396-4860-a1b6-f6907c23ca86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:39.202867 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343e1a8-b396-4860-a1b6-f6907c23ca86 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:39.203162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343e1a8-b396-4860-a1b6-f6907c23ca86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:39.203419 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343e1a8-b396-4860-a1b6-f6907c23ca86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:39.204056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343e1a8-b396-4860-a1b6-f6907c23ca86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:39.205650 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343e1a8-b396-4860-a1b6-f6907c23ca86 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:39.217601 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1142/2256] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:39.221867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd14f0-6a50-499f-80a5-779d0840b066 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:39.232644 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd14f0-6a50-499f-80a5-779d0840b066 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:39.237876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2352f-0fa0-4e2b-b225-2ec93f39f52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:39.238615 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2352f-0fa0-4e2b-b225-2ec93f39f52a admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:39.239017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2352f-0fa0-4e2b-b225-2ec93f39f52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:39.239362 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2352f-0fa0-4e2b-b225-2ec93f39f52a admin admin] PATH_INFO: `/v3/projects/7fcfb48e07974bfbbef8ab23ad25e8f3/users/67c11582ef244e45b9ff692993af5476/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:39.254819 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2352f-0fa0-4e2b-b225-2ec93f39f52a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcfb48e07974bfbbef8ab23ad25e8f3, user_id=67c11582ef244e45b9ff692993af5476, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:39.257517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2352f-0fa0-4e2b-b225-2ec93f39f52a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:39.343572 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1115/2257] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:39 2022] PUT /identity/v3/projects/7fcfb48e07974bfbbef8ab23ad25e8f3/users/67c11582ef244e45b9ff692993af5476/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:39.353928 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abfe36-1ed9-4184-a32e-c818bd4bc667 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:39.360132 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abfe36-1ed9-4184-a32e-c818bd4bc667 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:39.360132 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abfe36-1ed9-4184-a32e-c818bd4bc667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:39.383248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-98abfe36-1ed9-4184-a32e-c818bd4bc667 None None] MFA Rules not processed for user `67c11582ef244e45b9ff692993af5476`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:39.384438 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-98abfe36-1ed9-4184-a32e-c818bd4bc667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:39.450803 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1143/2258] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:05:39.461854 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2352f-0fa0-4e2b-b225-2ec93f39f52a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:39.464974 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-12b2352f-0fa0-4e2b-b225-2ec93f39f52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:39.531531 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2352f-0fa0-4e2b-b225-2ec93f39f52a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:39.535251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937970f4-53d8-46bb-8ea0-d8bcee8eaaf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:39.535859 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937970f4-53d8-46bb-8ea0-d8bcee8eaaf5 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:39.536143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937970f4-53d8-46bb-8ea0-d8bcee8eaaf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:39.536416 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937970f4-53d8-46bb-8ea0-d8bcee8eaaf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:39.545736 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937970f4-53d8-46bb-8ea0-d8bcee8eaaf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:39.547177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937970f4-53d8-46bb-8ea0-d8bcee8eaaf5 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:39.555814 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1116/2259] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:40.177279 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:41.389222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:41.633786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:42.405284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:42.548264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:43.187948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:44.113138 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:44.908368 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:45.160440 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:46.542322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:46.811157 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:47.427790 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:47.827945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:48.730904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:49.579559 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abfe36-1ed9-4184-a32e-c818bd4bc667 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:49.643490 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abfe36-1ed9-4184-a32e-c818bd4bc667 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:49.648231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685587c-5b69-41d4-aabe-967b0905fa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:49.648863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685587c-5b69-41d4-aabe-967b0905fa39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:49.649146 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685587c-5b69-41d4-aabe-967b0905fa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:49.649420 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685587c-5b69-41d4-aabe-967b0905fa39 admin admin] PATH_INFO: `/v3/users/67c11582ef244e45b9ff692993af5476` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:49.650546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685587c-5b69-41d4-aabe-967b0905fa39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67c11582ef244e45b9ff692993af5476)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:49.652604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685587c-5b69-41d4-aabe-967b0905fa39 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:49.887027 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce07428-7d07-46a8-a4ae-dd5a35beebb4 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:49.887027 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce07428-7d07-46a8-a4ae-dd5a35beebb4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:49.887027 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce07428-7d07-46a8-a4ae-dd5a35beebb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:49.902305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-cce07428-7d07-46a8-a4ae-dd5a35beebb4 None None] MFA Rules not processed for user `3e64b86aefeb4a7fb0710b69e7cd1063`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:49.902594 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3685587c-5b69-41d4-aabe-967b0905fa39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67c11582ef244e45b9ff692993af5476'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:49.902594 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3685587c-5b69-41d4-aabe-967b0905fa39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67c11582ef244e45b9ff692993af5476'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:49.903274 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cce07428-7d07-46a8-a4ae-dd5a35beebb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:49.914536 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3685587c-5b69-41d4-aabe-967b0905fa39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67c11582ef244e45b9ff692993af5476'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:49.922448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:49.923420 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3685587c-5b69-41d4-aabe-967b0905fa39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67c11582ef244e45b9ff692993af5476'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:49.961833 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1117/2260] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:05:50.011050 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3685587c-5b69-41d4-aabe-967b0905fa39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67c11582ef244e45b9ff692993af5476'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:50.017789 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1144/2261] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:49 2022] DELETE /identity/v3/users/67c11582ef244e45b9ff692993af5476 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:50.022593 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be2847-bc07-40bd-8e90-4e50f728916c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:50.022975 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be2847-bc07-40bd-8e90-4e50f728916c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:50.023346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be2847-bc07-40bd-8e90-4e50f728916c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:50.043490 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e2be2847-bc07-40bd-8e90-4e50f728916c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:50.044649 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e2be2847-bc07-40bd-8e90-4e50f728916c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:50.103670 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1118/2262] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:50.114035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685587c-5b69-41d4-aabe-967b0905fa39 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:50.115561 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3685587c-5b69-41d4-aabe-967b0905fa39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:50.173724 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685587c-5b69-41d4-aabe-967b0905fa39 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:50.177849 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28b7ca-dbb2-4671-b899-08bf70a8966f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:50.178671 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28b7ca-dbb2-4671-b899-08bf70a8966f service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:50.179083 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28b7ca-dbb2-4671-b899-08bf70a8966f service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:50.179426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28b7ca-dbb2-4671-b899-08bf70a8966f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:50.189926 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28b7ca-dbb2-4671-b899-08bf70a8966f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:50.191441 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28b7ca-dbb2-4671-b899-08bf70a8966f service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:50.201536 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1145/2263] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:50.633492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:50.756874 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be2847-bc07-40bd-8e90-4e50f728916c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:50.758839 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e2be2847-bc07-40bd-8e90-4e50f728916c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:50.773339 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be2847-bc07-40bd-8e90-4e50f728916c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:50.779246 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d38ce-da3d-45eb-8a9c-4f399a268aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:50.780039 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d38ce-da3d-45eb-8a9c-4f399a268aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:50.782551 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d38ce-da3d-45eb-8a9c-4f399a268aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:50.782551 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d38ce-da3d-45eb-8a9c-4f399a268aff admin admin] PATH_INFO: `/v3/projects/7fcfb48e07974bfbbef8ab23ad25e8f3` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:50.782551 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d38ce-da3d-45eb-8a9c-4f399a268aff admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fcfb48e07974bfbbef8ab23ad25e8f3)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:50.783889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d38ce-da3d-45eb-8a9c-4f399a268aff admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:50.919480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28b7ca-dbb2-4671-b899-08bf70a8966f service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:50.920086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:50.921315 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-aa28b7ca-dbb2-4671-b899-08bf70a8966f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:50.929694 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-668d38ce-da3d-45eb-8a9c-4f399a268aff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fcfb48e07974bfbbef8ab23ad25e8f3', 'request_id': 'req-668d38ce-da3d-45eb-8a9c-4f399a268aff'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:50.936154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-668d38ce-da3d-45eb-8a9c-4f399a268aff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fcfb48e07974bfbbef8ab23ad25e8f3', 'request_id': 'req-668d38ce-da3d-45eb-8a9c-4f399a268aff'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:50.936514 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28b7ca-dbb2-4671-b899-08bf70a8966f service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:50.943170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-668d38ce-da3d-45eb-8a9c-4f399a268aff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fcfb48e07974bfbbef8ab23ad25e8f3', 'request_id': 'req-668d38ce-da3d-45eb-8a9c-4f399a268aff'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:50.995737 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2157cc-38bd-43a6-9223-b4daef4d58b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:50.996631 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2157cc-38bd-43a6-9223-b4daef4d58b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:50.997020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2157cc-38bd-43a6-9223-b4daef4d58b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:50.997292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2157cc-38bd-43a6-9223-b4daef4d58b6 admin admin] PATH_INFO: `/v3/users/051ab5db293d4c4abad02268e74e80f1` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:50.998481 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2157cc-38bd-43a6-9223-b4daef4d58b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=051ab5db293d4c4abad02268e74e80f1)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:51.000470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2157cc-38bd-43a6-9223-b4daef4d58b6 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:51.023443 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-668d38ce-da3d-45eb-8a9c-4f399a268aff admin admin] The token cache is being invalidate because project 7fcfb48e07974bfbbef8ab23ad25e8f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:51.024460 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-668d38ce-da3d-45eb-8a9c-4f399a268aff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:51.028854 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-668d38ce-da3d-45eb-8a9c-4f399a268aff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:51.038141 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1119/2264] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:50 2022] DELETE /identity/v3/projects/7fcfb48e07974bfbbef8ab23ad25e8f3 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:51.038141 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974e0db-d9bb-47db-aa9d-1e5b955a5bc1 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:51.038141 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974e0db-d9bb-47db-aa9d-1e5b955a5bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:51.038141 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974e0db-d9bb-47db-aa9d-1e5b955a5bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:51.060425 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a974e0db-d9bb-47db-aa9d-1e5b955a5bc1 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:51.061618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a974e0db-d9bb-47db-aa9d-1e5b955a5bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:51.071132 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1120/2265] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:05:51.079645 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4d93f-3699-47c7-9465-b8885cb3e766 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:51.083820 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4d93f-3699-47c7-9465-b8885cb3e766 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:51.083820 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4d93f-3699-47c7-9465-b8885cb3e766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:51.100279 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-09d4d93f-3699-47c7-9465-b8885cb3e766 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:51.101466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-09d4d93f-3699-47c7-9465-b8885cb3e766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:51.109495 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1121/2266] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:05:51.113798 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4d93f-3699-47c7-9465-b8885cb3e766 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:51.122559 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4d93f-3699-47c7-9465-b8885cb3e766 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:51.127071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c1de9-0b90-4639-a921-326672966897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:51.127641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c1de9-0b90-4639-a921-326672966897 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:51.127916 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c1de9-0b90-4639-a921-326672966897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:51.128185 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c1de9-0b90-4639-a921-326672966897 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:51.128808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c1de9-0b90-4639-a921-326672966897 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:05:51.129103 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c1de9-0b90-4639-a921-326672966897 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:51.130659 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c1de9-0b90-4639-a921-326672966897 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:51.143259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1122/2267] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 11:05:51.155795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c1de9-0b90-4639-a921-326672966897 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:51.167372 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c1de9-0b90-4639-a921-326672966897 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:51.172420 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b637e-cafb-461b-8ebe-c9adeb6bb8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:51.173034 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b637e-cafb-461b-8ebe-c9adeb6bb8bf admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:51.173321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b637e-cafb-461b-8ebe-c9adeb6bb8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:51.173599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b637e-cafb-461b-8ebe-c9adeb6bb8bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:51.174223 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b637e-cafb-461b-8ebe-c9adeb6bb8bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:51.176184 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b637e-cafb-461b-8ebe-c9adeb6bb8bf admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:51.400374 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1123/2268] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:05:51 2022] POST /identity/v3/projects => generated 369 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:05:51.405087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b637e-cafb-461b-8ebe-c9adeb6bb8bf admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:51.447637 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cb2157cc-38bd-43a6-9223-b4daef4d58b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '051ab5db293d4c4abad02268e74e80f1'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:51.448484 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cb2157cc-38bd-43a6-9223-b4daef4d58b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '051ab5db293d4c4abad02268e74e80f1'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:51.463409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cb2157cc-38bd-43a6-9223-b4daef4d58b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '051ab5db293d4c4abad02268e74e80f1'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:51.471245 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cb2157cc-38bd-43a6-9223-b4daef4d58b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '051ab5db293d4c4abad02268e74e80f1'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:51.476063 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b637e-cafb-461b-8ebe-c9adeb6bb8bf admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:51.481029 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb8afa-bbe8-4e47-b7cc-613c16f5a7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:51.481704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb8afa-bbe8-4e47-b7cc-613c16f5a7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:51.481987 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb8afa-bbe8-4e47-b7cc-613c16f5a7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:51.482263 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb8afa-bbe8-4e47-b7cc-613c16f5a7a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:51.483025 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb8afa-bbe8-4e47-b7cc-613c16f5a7a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:51.485590 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb8afa-bbe8-4e47-b7cc-613c16f5a7a7 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:51.605122 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-cb2157cc-38bd-43a6-9223-b4daef4d58b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '051ab5db293d4c4abad02268e74e80f1'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:51.614301 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1146/2269] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:50 2022] DELETE /identity/v3/users/051ab5db293d4c4abad02268e74e80f1 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:05:51.619249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e57b4f-b0f9-4b73-a885-04218015e86c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:51.619679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e57b4f-b0f9-4b73-a885-04218015e86c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:51.619966 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e57b4f-b0f9-4b73-a885-04218015e86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:51.641021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1124/2270] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:05:51 2022] POST /identity/v3/users => generated 285 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:05:51.643940 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-55e57b4f-b0f9-4b73-a885-04218015e86c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:51.645737 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-55e57b4f-b0f9-4b73-a885-04218015e86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:51.645993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb8afa-bbe8-4e47-b7cc-613c16f5a7a7 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:51.648072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-24bb8afa-bbe8-4e47-b7cc-613c16f5a7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:51.661517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb8afa-bbe8-4e47-b7cc-613c16f5a7a7 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:51.721440 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1147/2271] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:05:51.725737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f6ab5-a70e-4c9c-ac24-8ac510994393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:51.726529 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f6ab5-a70e-4c9c-ac24-8ac510994393 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:51.727122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f6ab5-a70e-4c9c-ac24-8ac510994393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:51.727501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f6ab5-a70e-4c9c-ac24-8ac510994393 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:51.728339 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f6ab5-a70e-4c9c-ac24-8ac510994393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:51.731712 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f6ab5-a70e-4c9c-ac24-8ac510994393 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:51.733287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e57b4f-b0f9-4b73-a885-04218015e86c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:51.734703 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-55e57b4f-b0f9-4b73-a885-04218015e86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:51.744387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1125/2272] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:51.751181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f6ab5-a70e-4c9c-ac24-8ac510994393 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:51.767320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f6ab5-a70e-4c9c-ac24-8ac510994393 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:51.772681 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f858e64-acb8-48af-b594-75fcf680b4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:51.773311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f858e64-acb8-48af-b594-75fcf680b4ec admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:51.773599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f858e64-acb8-48af-b594-75fcf680b4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:51.773934 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f858e64-acb8-48af-b594-75fcf680b4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:51.775125 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f858e64-acb8-48af-b594-75fcf680b4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:51.777550 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f858e64-acb8-48af-b594-75fcf680b4ec admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:51.798867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:51.798867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1126/2273] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:51.800462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f858e64-acb8-48af-b594-75fcf680b4ec admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:51.813145 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e57b4f-b0f9-4b73-a885-04218015e86c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:51.813360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f858e64-acb8-48af-b594-75fcf680b4ec admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:51.816800 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:51.818224 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20af837-006a-4476-8d7c-2f42dbc89641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:51.818708 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5370a-4f17-481f-9ed5-c8201b86789d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:51.818988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20af837-006a-4476-8d7c-2f42dbc89641 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:51.819278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20af837-006a-4476-8d7c-2f42dbc89641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:51.819381 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5370a-4f17-481f-9ed5-c8201b86789d service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:51.824048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20af837-006a-4476-8d7c-2f42dbc89641 admin admin] PATH_INFO: `/v3/projects/e9a981ea207d4a6896cf47db3809d50d/users/351c1b68fd534adf9b1f0122aee1c825/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:51.824213 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5370a-4f17-481f-9ed5-c8201b86789d service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:51.824213 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5370a-4f17-481f-9ed5-c8201b86789d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:51.829408 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5370a-4f17-481f-9ed5-c8201b86789d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:51.830885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5370a-4f17-481f-9ed5-c8201b86789d service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:51.835544 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20af837-006a-4476-8d7c-2f42dbc89641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a981ea207d4a6896cf47db3809d50d, user_id=351c1b68fd534adf9b1f0122aee1c825, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:51.838246 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20af837-006a-4476-8d7c-2f42dbc89641 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:51.842063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1148/2274] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:51.909151 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1127/2275] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:51 2022] PUT /identity/v3/projects/e9a981ea207d4a6896cf47db3809d50d/users/351c1b68fd534adf9b1f0122aee1c825/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:51.921145 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44175e03-8b68-43b6-b93f-28bb7f9b869f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:51.921689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44175e03-8b68-43b6-b93f-28bb7f9b869f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:51.921801 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44175e03-8b68-43b6-b93f-28bb7f9b869f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:51.954680 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-44175e03-8b68-43b6-b93f-28bb7f9b869f None None] MFA Rules not processed for user `351c1b68fd534adf9b1f0122aee1c825`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:51.955969 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-44175e03-8b68-43b6-b93f-28bb7f9b869f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:52.025540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1149/2276] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:52.395273 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20af837-006a-4476-8d7c-2f42dbc89641 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:52.397023 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b20af837-006a-4476-8d7c-2f42dbc89641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:52.452431 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:52.472020 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20af837-006a-4476-8d7c-2f42dbc89641 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:52.479416 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f12c9-eb69-4bbe-a853-d21ce47cbfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:52.480741 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f12c9-eb69-4bbe-a853-d21ce47cbfad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:52.481019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f12c9-eb69-4bbe-a853-d21ce47cbfad admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:52.481304 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f12c9-eb69-4bbe-a853-d21ce47cbfad admin admin] PATH_INFO: `/v3/projects/3919237b1ba84e168e175dd565b8892b` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:52.482470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f12c9-eb69-4bbe-a853-d21ce47cbfad admin admin] RBAC: Authorizing `identity:delete_project(project_id=3919237b1ba84e168e175dd565b8892b)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:52.484593 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f12c9-eb69-4bbe-a853-d21ce47cbfad admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:52.536523 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:52.629643 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-123f12c9-eb69-4bbe-a853-d21ce47cbfad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3919237b1ba84e168e175dd565b8892b', 'request_id': 'req-123f12c9-eb69-4bbe-a853-d21ce47cbfad'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:52.635813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-123f12c9-eb69-4bbe-a853-d21ce47cbfad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3919237b1ba84e168e175dd565b8892b', 'request_id': 'req-123f12c9-eb69-4bbe-a853-d21ce47cbfad'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:52.643825 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-123f12c9-eb69-4bbe-a853-d21ce47cbfad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3919237b1ba84e168e175dd565b8892b', 'request_id': 'req-123f12c9-eb69-4bbe-a853-d21ce47cbfad'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:52.736958 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-123f12c9-eb69-4bbe-a853-d21ce47cbfad admin admin] The token cache is being invalidate because project 3919237b1ba84e168e175dd565b8892b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:52.737249 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-123f12c9-eb69-4bbe-a853-d21ce47cbfad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:52.738019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-123f12c9-eb69-4bbe-a853-d21ce47cbfad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:52.740285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1128/2277] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:52 2022] DELETE /identity/v3/projects/3919237b1ba84e168e175dd565b8892b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:52.743932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44175e03-8b68-43b6-b93f-28bb7f9b869f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:52.754843 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44175e03-8b68-43b6-b93f-28bb7f9b869f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:52.814054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256e52f-7ed7-4700-9772-3e1a0531c890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:52.814730 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256e52f-7ed7-4700-9772-3e1a0531c890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:52.815036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256e52f-7ed7-4700-9772-3e1a0531c890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:52.815306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256e52f-7ed7-4700-9772-3e1a0531c890 admin admin] PATH_INFO: `/v3/users/04f8f674899f4dc79fb3bf728b010fe1` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:52.816443 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256e52f-7ed7-4700-9772-3e1a0531c890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04f8f674899f4dc79fb3bf728b010fe1)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:52.818568 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3256e52f-7ed7-4700-9772-3e1a0531c890 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:52.996687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3256e52f-7ed7-4700-9772-3e1a0531c890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04f8f674899f4dc79fb3bf728b010fe1'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:52.997481 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3256e52f-7ed7-4700-9772-3e1a0531c890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04f8f674899f4dc79fb3bf728b010fe1'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:53.009231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3256e52f-7ed7-4700-9772-3e1a0531c890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04f8f674899f4dc79fb3bf728b010fe1'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:53.018315 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3256e52f-7ed7-4700-9772-3e1a0531c890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04f8f674899f4dc79fb3bf728b010fe1'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:53.113123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3256e52f-7ed7-4700-9772-3e1a0531c890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04f8f674899f4dc79fb3bf728b010fe1'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:53.119598 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1150/2278] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:52 2022] DELETE /identity/v3/users/04f8f674899f4dc79fb3bf728b010fe1 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:05:53.330750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:53.359740 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:53.577621 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f12c9-eb69-4bbe-a853-d21ce47cbfad admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:53.579562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-123f12c9-eb69-4bbe-a853-d21ce47cbfad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:53.595427 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f12c9-eb69-4bbe-a853-d21ce47cbfad admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:53.665978 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacac882-50b9-49cd-b6be-2a9145b0cae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:53.666643 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacac882-50b9-49cd-b6be-2a9145b0cae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:53.666958 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacac882-50b9-49cd-b6be-2a9145b0cae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:53.667235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacac882-50b9-49cd-b6be-2a9145b0cae5 admin admin] PATH_INFO: `/v3/projects/1da2f5b2e298497face0fabb309c3280` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:53.669420 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacac882-50b9-49cd-b6be-2a9145b0cae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da2f5b2e298497face0fabb309c3280)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:53.671571 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacac882-50b9-49cd-b6be-2a9145b0cae5 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:53.782809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-eacac882-50b9-49cd-b6be-2a9145b0cae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da2f5b2e298497face0fabb309c3280', 'request_id': 'req-eacac882-50b9-49cd-b6be-2a9145b0cae5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:53.788479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-eacac882-50b9-49cd-b6be-2a9145b0cae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da2f5b2e298497face0fabb309c3280', 'request_id': 'req-eacac882-50b9-49cd-b6be-2a9145b0cae5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:53.796607 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-eacac882-50b9-49cd-b6be-2a9145b0cae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da2f5b2e298497face0fabb309c3280', 'request_id': 'req-eacac882-50b9-49cd-b6be-2a9145b0cae5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:53.898259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-eacac882-50b9-49cd-b6be-2a9145b0cae5 admin admin] The token cache is being invalidate because project 1da2f5b2e298497face0fabb309c3280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:53.898630 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-eacac882-50b9-49cd-b6be-2a9145b0cae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:53.899453 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-eacac882-50b9-49cd-b6be-2a9145b0cae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:53.901397 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1129/2279] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:53 2022] DELETE /identity/v3/projects/1da2f5b2e298497face0fabb309c3280 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:53.907009 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbe1bc-e23c-4883-a9c8-6983d94269b8 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:53.907378 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbe1bc-e23c-4883-a9c8-6983d94269b8 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:53.907768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbe1bc-e23c-4883-a9c8-6983d94269b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:53.931122 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-08bbe1bc-e23c-4883-a9c8-6983d94269b8 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:53.932370 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-08bbe1bc-e23c-4883-a9c8-6983d94269b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:53.954552 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:54.002072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1151/2280] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:54.010914 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52dccb-56fe-4045-9e83-5fe9dd18b19f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:54.011539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52dccb-56fe-4045-9e83-5fe9dd18b19f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:54.012530 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52dccb-56fe-4045-9e83-5fe9dd18b19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:54.051080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1f52dccb-56fe-4045-9e83-5fe9dd18b19f None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:54.052524 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1f52dccb-56fe-4045-9e83-5fe9dd18b19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:54.065090 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1130/2281] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:05:54.066361 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbe1bc-e23c-4883-a9c8-6983d94269b8 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:54.076492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbe1bc-e23c-4883-a9c8-6983d94269b8 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:54.081187 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d82ec-131c-4e81-8be4-550e51584ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:54.081832 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d82ec-131c-4e81-8be4-550e51584ebf admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:54.082115 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d82ec-131c-4e81-8be4-550e51584ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:54.082391 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d82ec-131c-4e81-8be4-550e51584ebf admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:54.083081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d82ec-131c-4e81-8be4-550e51584ebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:05:54.083390 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d82ec-131c-4e81-8be4-550e51584ebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:54.085039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d82ec-131c-4e81-8be4-550e51584ebf admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:54.101416 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1152/2282] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:05:54.102884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52dccb-56fe-4045-9e83-5fe9dd18b19f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:54.114264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52dccb-56fe-4045-9e83-5fe9dd18b19f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:54.120324 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1b465-c7c5-4582-9e2f-d8fa72726e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:54.121795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1b465-c7c5-4582-9e2f-d8fa72726e66 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:54.122231 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1b465-c7c5-4582-9e2f-d8fa72726e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:54.122735 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1b465-c7c5-4582-9e2f-d8fa72726e66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:54.123740 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1b465-c7c5-4582-9e2f-d8fa72726e66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:54.126114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1b465-c7c5-4582-9e2f-d8fa72726e66 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:54.225262 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1131/2283] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:05:54 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:54.229949 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d82ec-131c-4e81-8be4-550e51584ebf admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:54.233917 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:54.243838 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d82ec-131c-4e81-8be4-550e51584ebf admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:54.310423 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62272b79-b4fc-4bcd-b0e5-b383391df5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:54.311275 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62272b79-b4fc-4bcd-b0e5-b383391df5f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:54.311636 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62272b79-b4fc-4bcd-b0e5-b383391df5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:54.312080 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62272b79-b4fc-4bcd-b0e5-b383391df5f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:54.312931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62272b79-b4fc-4bcd-b0e5-b383391df5f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:54.315284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62272b79-b4fc-4bcd-b0e5-b383391df5f6 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:54.433787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1153/2284] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:05:54 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:54.437835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1b465-c7c5-4582-9e2f-d8fa72726e66 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:54.448002 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1b465-c7c5-4582-9e2f-d8fa72726e66 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:54.453337 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374d173-dc7c-4c8f-beaf-995307e883d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:54.453937 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374d173-dc7c-4c8f-beaf-995307e883d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:54.454214 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374d173-dc7c-4c8f-beaf-995307e883d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:54.454528 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374d173-dc7c-4c8f-beaf-995307e883d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:54.455233 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374d173-dc7c-4c8f-beaf-995307e883d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:54.456837 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374d173-dc7c-4c8f-beaf-995307e883d3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:54.467892 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1132/2285] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:54.471958 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62272b79-b4fc-4bcd-b0e5-b383391df5f6 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:54.483882 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62272b79-b4fc-4bcd-b0e5-b383391df5f6 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:54.489104 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b31b6e1-b5ba-4cc2-ac55-18f177356df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:54.490503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31b6e1-b5ba-4cc2-ac55-18f177356df8 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:54.490808 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31b6e1-b5ba-4cc2-ac55-18f177356df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:54.491152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b31b6e1-b5ba-4cc2-ac55-18f177356df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:54.492217 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31b6e1-b5ba-4cc2-ac55-18f177356df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:54.493893 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b31b6e1-b5ba-4cc2-ac55-18f177356df8 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:54.506109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1154/2286] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:54.510416 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374d173-dc7c-4c8f-beaf-995307e883d3 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:54.521226 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374d173-dc7c-4c8f-beaf-995307e883d3 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:54.525978 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a054718-254a-4482-9e61-36c438f34d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:54.526619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a054718-254a-4482-9e61-36c438f34d22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:54.526976 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a054718-254a-4482-9e61-36c438f34d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:54.527242 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a054718-254a-4482-9e61-36c438f34d22 admin admin] PATH_INFO: `/v3/projects/260e2fc634994da0b464f8ba449f15c7/users/efe003f485314f629b363babc75148be/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:54.542155 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a054718-254a-4482-9e61-36c438f34d22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=260e2fc634994da0b464f8ba449f15c7, user_id=efe003f485314f629b363babc75148be, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:54.544927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a054718-254a-4482-9e61-36c438f34d22 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:54.668424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1133/2287] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:54 2022] PUT /identity/v3/projects/260e2fc634994da0b464f8ba449f15c7/users/efe003f485314f629b363babc75148be/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:54.680045 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b98a8-9d86-4f88-8e46-dc370aa7323d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:54.680327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b98a8-9d86-4f88-8e46-dc370aa7323d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:54.680601 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b98a8-9d86-4f88-8e46-dc370aa7323d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:54.711024 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-124b98a8-9d86-4f88-8e46-dc370aa7323d None None] MFA Rules not processed for user `efe003f485314f629b363babc75148be`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:54.712244 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-124b98a8-9d86-4f88-8e46-dc370aa7323d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:54.771197 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:54.782189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1155/2288] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:54.787055 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a054718-254a-4482-9e61-36c438f34d22 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:54.855763 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a054718-254a-4482-9e61-36c438f34d22 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:54.862187 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6b6a1-e5d8-4fff-9c58-38204f72d01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:54.862845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6b6a1-e5d8-4fff-9c58-38204f72d01a admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:54.863133 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6b6a1-e5d8-4fff-9c58-38204f72d01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:54.863438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6b6a1-e5d8-4fff-9c58-38204f72d01a admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:54.864069 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6b6a1-e5d8-4fff-9c58-38204f72d01a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:54.865999 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6b6a1-e5d8-4fff-9c58-38204f72d01a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:54.944108 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1134/2289] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:05:54 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:54.948206 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b98a8-9d86-4f88-8e46-dc370aa7323d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:54.961072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b98a8-9d86-4f88-8e46-dc370aa7323d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:55.022585 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7930a2c-20cf-4fb2-9b66-dc79bbd02920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:55.023253 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7930a2c-20cf-4fb2-9b66-dc79bbd02920 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:55.023432 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7930a2c-20cf-4fb2-9b66-dc79bbd02920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:55.023706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7930a2c-20cf-4fb2-9b66-dc79bbd02920 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:55.024351 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7930a2c-20cf-4fb2-9b66-dc79bbd02920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:55.026280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7930a2c-20cf-4fb2-9b66-dc79bbd02920 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:55.155304 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1156/2290] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:05:54 2022] POST /identity/v3/users => generated 300 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:55.159079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:55.159359 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6b6a1-e5d8-4fff-9c58-38204f72d01a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:55.170075 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6b6a1-e5d8-4fff-9c58-38204f72d01a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:55.174706 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9dd8f-d4f7-4a7a-825e-d3eb02fa506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:55.175333 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9dd8f-d4f7-4a7a-825e-d3eb02fa506e admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:55.180700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9dd8f-d4f7-4a7a-825e-d3eb02fa506e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:55.180700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9dd8f-d4f7-4a7a-825e-d3eb02fa506e admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:55.180700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9dd8f-d4f7-4a7a-825e-d3eb02fa506e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:55.180700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9dd8f-d4f7-4a7a-825e-d3eb02fa506e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:55.188972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1135/2291] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:55.193049 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7930a2c-20cf-4fb2-9b66-dc79bbd02920 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:55.204125 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7930a2c-20cf-4fb2-9b66-dc79bbd02920 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:55.208849 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d61c4-5e98-4688-85ca-3221431553b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:55.209502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d61c4-5e98-4688-85ca-3221431553b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:55.209787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d61c4-5e98-4688-85ca-3221431553b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:55.210159 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d61c4-5e98-4688-85ca-3221431553b9 admin admin] PATH_INFO: `/v3/projects/0ec442f9d75e4d31a2f896ee353fb843/users/ef220db2a45e40538ea1a9de1b6b41b5/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:55.228778 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d61c4-5e98-4688-85ca-3221431553b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec442f9d75e4d31a2f896ee353fb843, user_id=ef220db2a45e40538ea1a9de1b6b41b5, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:55.232429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d61c4-5e98-4688-85ca-3221431553b9 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:55.314635 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1157/2292] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:55 2022] PUT /identity/v3/projects/0ec442f9d75e4d31a2f896ee353fb843/users/ef220db2a45e40538ea1a9de1b6b41b5/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:55.320783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9dd8f-d4f7-4a7a-825e-d3eb02fa506e admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:55.331899 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9dd8f-d4f7-4a7a-825e-d3eb02fa506e admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:55.381593 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:55.398691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1785b1-86d5-48bb-a5e7-f64593fdd4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:55.399344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1785b1-86d5-48bb-a5e7-f64593fdd4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:55.399633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1785b1-86d5-48bb-a5e7-f64593fdd4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:55.399909 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1785b1-86d5-48bb-a5e7-f64593fdd4e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:55.400582 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1785b1-86d5-48bb-a5e7-f64593fdd4e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:55.402231 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1785b1-86d5-48bb-a5e7-f64593fdd4e5 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:55.412319 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1136/2293] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:55.416681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d61c4-5e98-4688-85ca-3221431553b9 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:55.427330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d61c4-5e98-4688-85ca-3221431553b9 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:55.432275 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143d587-f09f-4ad8-8e6e-c9dea10247e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:55.433741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143d587-f09f-4ad8-8e6e-c9dea10247e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:55.434204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143d587-f09f-4ad8-8e6e-c9dea10247e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:55.434576 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143d587-f09f-4ad8-8e6e-c9dea10247e9 admin admin] PATH_INFO: `/v3/projects/0ec442f9d75e4d31a2f896ee353fb843/users/ef220db2a45e40538ea1a9de1b6b41b5/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:55.436647 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143d587-f09f-4ad8-8e6e-c9dea10247e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ec442f9d75e4d31a2f896ee353fb843, user_id=ef220db2a45e40538ea1a9de1b6b41b5, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:55.439324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1143d587-f09f-4ad8-8e6e-c9dea10247e9 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:55.451779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1158/2294] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:55 2022] PUT /identity/v3/projects/0ec442f9d75e4d31a2f896ee353fb843/users/ef220db2a45e40538ea1a9de1b6b41b5/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:05:55.463635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c86baa-5c1b-4168-964b-a6b01ee863fe None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:55.463918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c86baa-5c1b-4168-964b-a6b01ee863fe None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:55.464414 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c86baa-5c1b-4168-964b-a6b01ee863fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:55.493040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-55c86baa-5c1b-4168-964b-a6b01ee863fe None None] MFA Rules not processed for user `ef220db2a45e40538ea1a9de1b6b41b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:55.494233 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-55c86baa-5c1b-4168-964b-a6b01ee863fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:55.567088 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1137/2295] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:55 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:05:55.579576 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143d587-f09f-4ad8-8e6e-c9dea10247e9 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:55.582039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1143d587-f09f-4ad8-8e6e-c9dea10247e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:55.641265 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143d587-f09f-4ad8-8e6e-c9dea10247e9 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:55.645227 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123f6c1-4c5c-4b06-8aa6-a686a6d363d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:55.645844 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123f6c1-4c5c-4b06-8aa6-a686a6d363d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:55.646127 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123f6c1-4c5c-4b06-8aa6-a686a6d363d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:55.646403 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123f6c1-4c5c-4b06-8aa6-a686a6d363d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:55.655864 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123f6c1-4c5c-4b06-8aa6-a686a6d363d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:55.657313 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123f6c1-4c5c-4b06-8aa6-a686a6d363d6 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:55.668398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1159/2296] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:55 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:55.698146 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c86baa-5c1b-4168-964b-a6b01ee863fe None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:55.731491 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:55.766413 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c86baa-5c1b-4168-964b-a6b01ee863fe None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:55.771214 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee0a1b-85b1-4abc-9b1e-95e469fc43ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:55.771850 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee0a1b-85b1-4abc-9b1e-95e469fc43ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:55.772214 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee0a1b-85b1-4abc-9b1e-95e469fc43ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:55.772387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee0a1b-85b1-4abc-9b1e-95e469fc43ec admin admin] PATH_INFO: `/v3/users/efe003f485314f629b363babc75148be` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:55.773610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee0a1b-85b1-4abc-9b1e-95e469fc43ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=efe003f485314f629b363babc75148be)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:55.775618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee0a1b-85b1-4abc-9b1e-95e469fc43ec admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:55.907751 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:55.955919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-dfee0a1b-85b1-4abc-9b1e-95e469fc43ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efe003f485314f629b363babc75148be'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:55.969671 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-dfee0a1b-85b1-4abc-9b1e-95e469fc43ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efe003f485314f629b363babc75148be'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:55.970434 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-dfee0a1b-85b1-4abc-9b1e-95e469fc43ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efe003f485314f629b363babc75148be'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:56.061624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-dfee0a1b-85b1-4abc-9b1e-95e469fc43ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efe003f485314f629b363babc75148be'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:56.069387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-dfee0a1b-85b1-4abc-9b1e-95e469fc43ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efe003f485314f629b363babc75148be'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:56.075661 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1138/2297] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:55 2022] DELETE /identity/v3/users/efe003f485314f629b363babc75148be => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:56.080197 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12082a2d-67e6-4fe0-bd83-c778e3f54cc4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:56.080639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12082a2d-67e6-4fe0-bd83-c778e3f54cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:56.080751 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12082a2d-67e6-4fe0-bd83-c778e3f54cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:56.102076 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-12082a2d-67e6-4fe0-bd83-c778e3f54cc4 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:56.103333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-12082a2d-67e6-4fe0-bd83-c778e3f54cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:56.165949 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1160/2298] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:56.176545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee0a1b-85b1-4abc-9b1e-95e469fc43ec admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:56.177991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-dfee0a1b-85b1-4abc-9b1e-95e469fc43ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:56.238959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee0a1b-85b1-4abc-9b1e-95e469fc43ec admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:56.242841 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff2e45-b8a5-41a8-b71e-8cd2b49388a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:56.243489 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff2e45-b8a5-41a8-b71e-8cd2b49388a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:56.243793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff2e45-b8a5-41a8-b71e-8cd2b49388a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:56.244066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff2e45-b8a5-41a8-b71e-8cd2b49388a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:56.253153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff2e45-b8a5-41a8-b71e-8cd2b49388a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:56.254614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff2e45-b8a5-41a8-b71e-8cd2b49388a3 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:56.264794 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1139/2299] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:05:56.291114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:56.427585 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=81,keystone:DELETE=15,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:56.675769 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12082a2d-67e6-4fe0-bd83-c778e3f54cc4 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:56.678539 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-12082a2d-67e6-4fe0-bd83-c778e3f54cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:56.691359 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12082a2d-67e6-4fe0-bd83-c778e3f54cc4 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:56.696382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbd3c7-cf54-4536-b28c-8a140d58c5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:56.697183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbd3c7-cf54-4536-b28c-8a140d58c5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:56.697475 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbd3c7-cf54-4536-b28c-8a140d58c5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:56.697749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbd3c7-cf54-4536-b28c-8a140d58c5f2 admin admin] PATH_INFO: `/v3/projects/260e2fc634994da0b464f8ba449f15c7` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:56.699502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbd3c7-cf54-4536-b28c-8a140d58c5f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=260e2fc634994da0b464f8ba449f15c7)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:56.701500 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbd3c7-cf54-4536-b28c-8a140d58c5f2 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:56.811642 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8ddbd3c7-cf54-4536-b28c-8a140d58c5f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '260e2fc634994da0b464f8ba449f15c7', 'request_id': 'req-8ddbd3c7-cf54-4536-b28c-8a140d58c5f2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:56.817161 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8ddbd3c7-cf54-4536-b28c-8a140d58c5f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '260e2fc634994da0b464f8ba449f15c7', 'request_id': 'req-8ddbd3c7-cf54-4536-b28c-8a140d58c5f2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:56.919246 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8ddbd3c7-cf54-4536-b28c-8a140d58c5f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '260e2fc634994da0b464f8ba449f15c7', 'request_id': 'req-8ddbd3c7-cf54-4536-b28c-8a140d58c5f2'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:56.931478 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8ddbd3c7-cf54-4536-b28c-8a140d58c5f2 admin admin] The token cache is being invalidate because project 260e2fc634994da0b464f8ba449f15c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:56.931772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8ddbd3c7-cf54-4536-b28c-8a140d58c5f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:56.932424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8ddbd3c7-cf54-4536-b28c-8a140d58c5f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:56.934494 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1161/2300] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:56 2022] DELETE /identity/v3/projects/260e2fc634994da0b464f8ba449f15c7 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:56.939057 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff2e45-b8a5-41a8-b71e-8cd2b49388a3 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:56.949277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff2e45-b8a5-41a8-b71e-8cd2b49388a3 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:56.977649 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbd3c7-cf54-4536-b28c-8a140d58c5f2 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:56.979075 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8ddbd3c7-cf54-4536-b28c-8a140d58c5f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:57.013587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a342a6-d8a7-440c-8897-26bb19338424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:57.014336 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a342a6-d8a7-440c-8897-26bb19338424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:57.014620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a342a6-d8a7-440c-8897-26bb19338424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:57.014924 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a342a6-d8a7-440c-8897-26bb19338424 admin admin] PATH_INFO: `/v3/users/ef220db2a45e40538ea1a9de1b6b41b5` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:57.016049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a342a6-d8a7-440c-8897-26bb19338424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef220db2a45e40538ea1a9de1b6b41b5)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:57.017961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a342a6-d8a7-440c-8897-26bb19338424 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:57.038865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbd3c7-cf54-4536-b28c-8a140d58c5f2 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:57.044702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8feb85-c6be-490e-92f8-3df0e58d4bbc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fe013f66e2452eaaf84d4b52eca489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:57.045395 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8feb85-c6be-490e-92f8-3df0e58d4bbc service glance] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:57.045690 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8feb85-c6be-490e-92f8-3df0e58d4bbc service glance] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:57.046035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8feb85-c6be-490e-92f8-3df0e58d4bbc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:57.047966 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fc8feb85-c6be-490e-92f8-3df0e58d4bbc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:57.108683 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8feb85-c6be-490e-92f8-3df0e58d4bbc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:57.110146 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8feb85-c6be-490e-92f8-3df0e58d4bbc service glance] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:57.119404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1162/2301] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:05:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:05:57.262149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-35a342a6-d8a7-440c-8897-26bb19338424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef220db2a45e40538ea1a9de1b6b41b5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:57.274921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-35a342a6-d8a7-440c-8897-26bb19338424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef220db2a45e40538ea1a9de1b6b41b5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:57.275654 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-35a342a6-d8a7-440c-8897-26bb19338424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef220db2a45e40538ea1a9de1b6b41b5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:57.364760 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-35a342a6-d8a7-440c-8897-26bb19338424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef220db2a45e40538ea1a9de1b6b41b5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:57.372776 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-35a342a6-d8a7-440c-8897-26bb19338424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef220db2a45e40538ea1a9de1b6b41b5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:57.382090 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1140/2302] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:05:56 2022] DELETE /identity/v3/users/ef220db2a45e40538ea1a9de1b6b41b5 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:57.429389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:57.696755 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:57.828868 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8feb85-c6be-490e-92f8-3df0e58d4bbc service glance] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:57.830697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fc8feb85-c6be-490e-92f8-3df0e58d4bbc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:57.859681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8feb85-c6be-490e-92f8-3df0e58d4bbc service glance] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:57.931979 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd09804-bbc5-45dc-9f71-d5259dbc3227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:57.932635 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd09804-bbc5-45dc-9f71-d5259dbc3227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:57.933592 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd09804-bbc5-45dc-9f71-d5259dbc3227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:57.934451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd09804-bbc5-45dc-9f71-d5259dbc3227 admin admin] PATH_INFO: `/v3/projects/0ec442f9d75e4d31a2f896ee353fb843` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:57.935704 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd09804-bbc5-45dc-9f71-d5259dbc3227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ec442f9d75e4d31a2f896ee353fb843)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:57.937637 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd09804-bbc5-45dc-9f71-d5259dbc3227 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:58.073731 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1fd09804-bbc5-45dc-9f71-d5259dbc3227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ec442f9d75e4d31a2f896ee353fb843', 'request_id': 'req-1fd09804-bbc5-45dc-9f71-d5259dbc3227'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:58.079211 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1fd09804-bbc5-45dc-9f71-d5259dbc3227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ec442f9d75e4d31a2f896ee353fb843', 'request_id': 'req-1fd09804-bbc5-45dc-9f71-d5259dbc3227'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:58.192065 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1fd09804-bbc5-45dc-9f71-d5259dbc3227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ec442f9d75e4d31a2f896ee353fb843', 'request_id': 'req-1fd09804-bbc5-45dc-9f71-d5259dbc3227'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:58.204072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1fd09804-bbc5-45dc-9f71-d5259dbc3227 admin admin] The token cache is being invalidate because project 0ec442f9d75e4d31a2f896ee353fb843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:05:58.204384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1fd09804-bbc5-45dc-9f71-d5259dbc3227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:58.205215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1fd09804-bbc5-45dc-9f71-d5259dbc3227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:05:58.206781 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1163/2303] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:05:57 2022] DELETE /identity/v3/projects/0ec442f9d75e4d31a2f896ee353fb843 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:58.216479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189ea74-0700-437f-a17f-5b7a914be9e0 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:58.216982 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189ea74-0700-437f-a17f-5b7a914be9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:58.217071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189ea74-0700-437f-a17f-5b7a914be9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:58.278043 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4189ea74-0700-437f-a17f-5b7a914be9e0 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:58.279453 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4189ea74-0700-437f-a17f-5b7a914be9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:58.359218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1141/2304] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:58.361539 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a53d64-c216-4502-8369-6a548acdb6f1 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:58.361827 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a53d64-c216-4502-8369-6a548acdb6f1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:58.362107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a53d64-c216-4502-8369-6a548acdb6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:58.382740 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-91a53d64-c216-4502-8369-6a548acdb6f1 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:58.383978 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-91a53d64-c216-4502-8369-6a548acdb6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:58.392590 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1164/2305] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:58.397047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189ea74-0700-437f-a17f-5b7a914be9e0 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:58.407750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189ea74-0700-437f-a17f-5b7a914be9e0 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:58.414256 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a48093-717e-4847-a1d7-6ff31a9d8ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:58.415116 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a48093-717e-4847-a1d7-6ff31a9d8ebc admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:58.415444 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a48093-717e-4847-a1d7-6ff31a9d8ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:58.415679 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a48093-717e-4847-a1d7-6ff31a9d8ebc admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:58.416339 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a48093-717e-4847-a1d7-6ff31a9d8ebc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:05:58.416649 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a48093-717e-4847-a1d7-6ff31a9d8ebc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:58.418434 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a48093-717e-4847-a1d7-6ff31a9d8ebc admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:58.431537 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1142/2306] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:05:58.437571 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a53d64-c216-4502-8369-6a548acdb6f1 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:58.456660 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a53d64-c216-4502-8369-6a548acdb6f1 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:58.461706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a92d2-ece0-4a24-bf86-c80d290829b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:58.462616 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a92d2-ece0-4a24-bf86-c80d290829b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:58.463101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a92d2-ece0-4a24-bf86-c80d290829b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:58.463372 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a92d2-ece0-4a24-bf86-c80d290829b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:58.464028 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a92d2-ece0-4a24-bf86-c80d290829b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:58.466498 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a92d2-ece0-4a24-bf86-c80d290829b5 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:58.591438 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1165/2307] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:05:58 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:58.595633 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a48093-717e-4847-a1d7-6ff31a9d8ebc admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:58.608422 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a48093-717e-4847-a1d7-6ff31a9d8ebc admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:58.668837 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886fd58-b106-4c57-9dba-191206472617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:58.669460 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886fd58-b106-4c57-9dba-191206472617 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:58.669746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886fd58-b106-4c57-9dba-191206472617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:58.670024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886fd58-b106-4c57-9dba-191206472617 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:58.670673 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886fd58-b106-4c57-9dba-191206472617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:58.672865 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886fd58-b106-4c57-9dba-191206472617 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:58.815092 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1143/2308] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:05:58 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:58.816361 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a92d2-ece0-4a24-bf86-c80d290829b5 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:58.827410 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a92d2-ece0-4a24-bf86-c80d290829b5 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:58.836521 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4413c-84bc-4d8c-859a-56f75f218814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:58.837750 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4413c-84bc-4d8c-859a-56f75f218814 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:58.838029 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4413c-84bc-4d8c-859a-56f75f218814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:58.838462 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be4413c-84bc-4d8c-859a-56f75f218814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:58.839204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4413c-84bc-4d8c-859a-56f75f218814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:58.840805 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be4413c-84bc-4d8c-859a-56f75f218814 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:58.854187 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1166/2309] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:58.856358 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886fd58-b106-4c57-9dba-191206472617 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:58.866855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886fd58-b106-4c57-9dba-191206472617 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:58.872162 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e65ebd-7693-48ac-9648-f8bc85a0deaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:58.872774 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e65ebd-7693-48ac-9648-f8bc85a0deaa admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:58.873054 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e65ebd-7693-48ac-9648-f8bc85a0deaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:58.873327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e65ebd-7693-48ac-9648-f8bc85a0deaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:58.873967 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e65ebd-7693-48ac-9648-f8bc85a0deaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:58.875606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e65ebd-7693-48ac-9648-f8bc85a0deaa admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:58.886086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1144/2310] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:05:58.890302 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4413c-84bc-4d8c-859a-56f75f218814 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:58.900426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be4413c-84bc-4d8c-859a-56f75f218814 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:58.905193 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7aaf8-ed66-408c-8cc3-235facf70677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:58.905852 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7aaf8-ed66-408c-8cc3-235facf70677 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:58.906296 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7aaf8-ed66-408c-8cc3-235facf70677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:58.906977 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7aaf8-ed66-408c-8cc3-235facf70677 admin admin] PATH_INFO: `/v3/projects/9b02c5eb98a7468986a107e38c2bf533/users/b8040eabf89047778c4d201780efe481/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:58.925236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7aaf8-ed66-408c-8cc3-235facf70677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b02c5eb98a7468986a107e38c2bf533, user_id=b8040eabf89047778c4d201780efe481, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:58.928089 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7aaf8-ed66-408c-8cc3-235facf70677 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:59.056710 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1167/2311] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:58 2022] PUT /identity/v3/projects/9b02c5eb98a7468986a107e38c2bf533/users/b8040eabf89047778c4d201780efe481/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:05:59.077264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733c8ac-cb39-475b-a83c-d8a50ec29ce1 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:59.077558 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733c8ac-cb39-475b-a83c-d8a50ec29ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:59.077839 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733c8ac-cb39-475b-a83c-d8a50ec29ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:59.106664 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5733c8ac-cb39-475b-a83c-d8a50ec29ce1 None None] MFA Rules not processed for user `b8040eabf89047778c4d201780efe481`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:05:59.108024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5733c8ac-cb39-475b-a83c-d8a50ec29ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:05:59.159290 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:59.178575 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1145/2312] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:05:59.179705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7aaf8-ed66-408c-8cc3-235facf70677 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:59.248055 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7aaf8-ed66-408c-8cc3-235facf70677 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:59.252903 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8ec43-244c-4054-a712-5b9b56161c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:59.253548 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8ec43-244c-4054-a712-5b9b56161c1d admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:59.253832 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8ec43-244c-4054-a712-5b9b56161c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:59.254102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8ec43-244c-4054-a712-5b9b56161c1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:59.254731 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8ec43-244c-4054-a712-5b9b56161c1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:59.256667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8ec43-244c-4054-a712-5b9b56161c1d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:59.364146 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1168/2313] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:05:59 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:05:59.366608 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733c8ac-cb39-475b-a83c-d8a50ec29ce1 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:59.378375 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733c8ac-cb39-475b-a83c-d8a50ec29ce1 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:59.437564 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb1094-1fc8-4973-bc80-3cfd7ea4ad6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:59.438351 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb1094-1fc8-4973-bc80-3cfd7ea4ad6b admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:59.438634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb1094-1fc8-4973-bc80-3cfd7ea4ad6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:59.438945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb1094-1fc8-4973-bc80-3cfd7ea4ad6b admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:59.439602 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb1094-1fc8-4973-bc80-3cfd7ea4ad6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:59.442032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb1094-1fc8-4973-bc80-3cfd7ea4ad6b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:59.445757 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:59.628058 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1146/2314] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:05:59 2022] POST /identity/v3/users => generated 299 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:05:59.638508 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8ec43-244c-4054-a712-5b9b56161c1d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:59.649449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8ec43-244c-4054-a712-5b9b56161c1d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:59.655485 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83374c65-eba5-4c65-ae3a-e64e630e2ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:59.656092 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83374c65-eba5-4c65-ae3a-e64e630e2ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:59.656373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83374c65-eba5-4c65-ae3a-e64e630e2ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:59.656650 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83374c65-eba5-4c65-ae3a-e64e630e2ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:59.657297 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83374c65-eba5-4c65-ae3a-e64e630e2ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:59.659081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83374c65-eba5-4c65-ae3a-e64e630e2ed3 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:59.675025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1169/2315] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:59.679177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb1094-1fc8-4973-bc80-3cfd7ea4ad6b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:59.689804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb1094-1fc8-4973-bc80-3cfd7ea4ad6b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:59.694662 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621d9d1-aa0e-4426-b884-2577e72d559b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:59.695351 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621d9d1-aa0e-4426-b884-2577e72d559b admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:59.695660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621d9d1-aa0e-4426-b884-2577e72d559b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:59.695935 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621d9d1-aa0e-4426-b884-2577e72d559b admin admin] PATH_INFO: `/v3/projects/6b6a22f6ace2478a9382fd68afeed3df/users/eb46cd790d144cb8a6afdc3176a458a3/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:59.711497 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621d9d1-aa0e-4426-b884-2577e72d559b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b6a22f6ace2478a9382fd68afeed3df, user_id=eb46cd790d144cb8a6afdc3176a458a3, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:59.714855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621d9d1-aa0e-4426-b884-2577e72d559b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:59.822374 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1147/2316] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:59 2022] PUT /identity/v3/projects/6b6a22f6ace2478a9382fd68afeed3df/users/eb46cd790d144cb8a6afdc3176a458a3/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:05:59.827800 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83374c65-eba5-4c65-ae3a-e64e630e2ed3 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:59.840534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83374c65-eba5-4c65-ae3a-e64e630e2ed3 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:59.906183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6512f47-a416-440d-9390-96bae7de501e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:59.906825 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6512f47-a416-440d-9390-96bae7de501e admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:59.907112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6512f47-a416-440d-9390-96bae7de501e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:59.907395 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6512f47-a416-440d-9390-96bae7de501e admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:59.908043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6512f47-a416-440d-9390-96bae7de501e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:59.909659 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6512f47-a416-440d-9390-96bae7de501e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:59.923605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1170/2317] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:05:59.936569 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621d9d1-aa0e-4426-b884-2577e72d559b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:05:59.944000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621d9d1-aa0e-4426-b884-2577e72d559b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:05:59.951536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401c278-aa9f-46fc-9257-da2cc6f3390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:05:59.952446 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401c278-aa9f-46fc-9257-da2cc6f3390e admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:59.952827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401c278-aa9f-46fc-9257-da2cc6f3390e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:59.953236 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401c278-aa9f-46fc-9257-da2cc6f3390e admin admin] PATH_INFO: `/v3/projects/6b6a22f6ace2478a9382fd68afeed3df/users/eb46cd790d144cb8a6afdc3176a458a3/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:59.955974 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401c278-aa9f-46fc-9257-da2cc6f3390e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b6a22f6ace2478a9382fd68afeed3df, user_id=eb46cd790d144cb8a6afdc3176a458a3, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:05:59.959902 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401c278-aa9f-46fc-9257-da2cc6f3390e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:05:59.973869 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1148/2318] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:05:59 2022] PUT /identity/v3/projects/6b6a22f6ace2478a9382fd68afeed3df/users/eb46cd790d144cb8a6afdc3176a458a3/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:05:59.986864 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477a529-f12f-49fb-9775-1f10d790982b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:05:59.987154 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477a529-f12f-49fb-9775-1f10d790982b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:05:59.987431 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477a529-f12f-49fb-9775-1f10d790982b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:05:59.999390 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:00.019376 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-b477a529-f12f-49fb-9775-1f10d790982b None None] MFA Rules not processed for user `eb46cd790d144cb8a6afdc3176a458a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:00.021107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b477a529-f12f-49fb-9775-1f10d790982b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:00.126815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1171/2319] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:05:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:00.137747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401c278-aa9f-46fc-9257-da2cc6f3390e admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:00.139534 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4401c278-aa9f-46fc-9257-da2cc6f3390e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:00.207229 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401c278-aa9f-46fc-9257-da2cc6f3390e admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:00.211053 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814a3bc-e967-4898-8484-1408f360e69f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:00.211658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814a3bc-e967-4898-8484-1408f360e69f service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:00.211936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814a3bc-e967-4898-8484-1408f360e69f service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:00.212216 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814a3bc-e967-4898-8484-1408f360e69f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:00.226315 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814a3bc-e967-4898-8484-1408f360e69f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:00.228201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814a3bc-e967-4898-8484-1408f360e69f service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:00.239209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1149/2320] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:06:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:06:00.451908 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:00.833622 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:01.336835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:01.599278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:01.716045 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477a529-f12f-49fb-9775-1f10d790982b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:01.782207 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477a529-f12f-49fb-9775-1f10d790982b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:01.786991 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee22bb7-3bcf-4a2b-809c-d43b65203594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:01.793995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee22bb7-3bcf-4a2b-809c-d43b65203594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:01.793995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee22bb7-3bcf-4a2b-809c-d43b65203594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:01.793995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee22bb7-3bcf-4a2b-809c-d43b65203594 admin admin] PATH_INFO: `/v3/users/b8040eabf89047778c4d201780efe481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:01.793995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee22bb7-3bcf-4a2b-809c-d43b65203594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8040eabf89047778c4d201780efe481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:01.793995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee22bb7-3bcf-4a2b-809c-d43b65203594 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:01.816139 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:02.002081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9ee22bb7-3bcf-4a2b-809c-d43b65203594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8040eabf89047778c4d201780efe481'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:02.003108 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9ee22bb7-3bcf-4a2b-809c-d43b65203594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8040eabf89047778c4d201780efe481'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:02.016682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9ee22bb7-3bcf-4a2b-809c-d43b65203594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8040eabf89047778c4d201780efe481'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:02.024389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9ee22bb7-3bcf-4a2b-809c-d43b65203594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8040eabf89047778c4d201780efe481'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:02.119075 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9ee22bb7-3bcf-4a2b-809c-d43b65203594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8040eabf89047778c4d201780efe481'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:02.125837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1172/2321] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:06:01 2022] DELETE /identity/v3/users/b8040eabf89047778c4d201780efe481 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:02.130642 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d9be8-6f57-440b-abe0-d5b297a01fc9 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:02.131150 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d9be8-6f57-440b-abe0-d5b297a01fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:02.131526 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d9be8-6f57-440b-abe0-d5b297a01fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:02.154979 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7d9d9be8-6f57-440b-abe0-d5b297a01fc9 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:02.156399 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7d9d9be8-6f57-440b-abe0-d5b297a01fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:02.234510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1150/2322] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:02.245239 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee22bb7-3bcf-4a2b-809c-d43b65203594 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:02.247395 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9ee22bb7-3bcf-4a2b-809c-d43b65203594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:02.306369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee22bb7-3bcf-4a2b-809c-d43b65203594 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:02.311001 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7fa74-b43d-4861-bf8a-f8bd2c15f84c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:02.311610 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7fa74-b43d-4861-bf8a-f8bd2c15f84c service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:02.311892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7fa74-b43d-4861-bf8a-f8bd2c15f84c service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:02.312167 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7fa74-b43d-4861-bf8a-f8bd2c15f84c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:02.321624 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7fa74-b43d-4861-bf8a-f8bd2c15f84c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:02.323141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7fa74-b43d-4861-bf8a-f8bd2c15f84c service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:02.333930 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1173/2323] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:06:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:06:02.547706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:02.668050 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:02.846042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d9be8-6f57-440b-abe0-d5b297a01fc9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:02.848618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7d9d9be8-6f57-440b-abe0-d5b297a01fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:02.860197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d9be8-6f57-440b-abe0-d5b297a01fc9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:02.865663 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12078ca-b79f-433d-b0c9-0adc0024827b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:02.866386 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12078ca-b79f-433d-b0c9-0adc0024827b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:02.866669 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12078ca-b79f-433d-b0c9-0adc0024827b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:02.866984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12078ca-b79f-433d-b0c9-0adc0024827b admin admin] PATH_INFO: `/v3/projects/9b02c5eb98a7468986a107e38c2bf533` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:02.868136 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12078ca-b79f-433d-b0c9-0adc0024827b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b02c5eb98a7468986a107e38c2bf533)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:02.870636 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12078ca-b79f-433d-b0c9-0adc0024827b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:03.000732 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a12078ca-b79f-433d-b0c9-0adc0024827b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b02c5eb98a7468986a107e38c2bf533', 'request_id': 'req-a12078ca-b79f-433d-b0c9-0adc0024827b'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:03.006415 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a12078ca-b79f-433d-b0c9-0adc0024827b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b02c5eb98a7468986a107e38c2bf533', 'request_id': 'req-a12078ca-b79f-433d-b0c9-0adc0024827b'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:03.013700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a12078ca-b79f-433d-b0c9-0adc0024827b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b02c5eb98a7468986a107e38c2bf533', 'request_id': 'req-a12078ca-b79f-433d-b0c9-0adc0024827b'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:03.187978 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a12078ca-b79f-433d-b0c9-0adc0024827b admin admin] The token cache is being invalidate because project 9b02c5eb98a7468986a107e38c2bf533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:06:03.192277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a12078ca-b79f-433d-b0c9-0adc0024827b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:03.192277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-a12078ca-b79f-433d-b0c9-0adc0024827b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:03.192277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1151/2324] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:06:02 2022] DELETE /identity/v3/projects/9b02c5eb98a7468986a107e38c2bf533 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:03.194546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7fa74-b43d-4861-bf8a-f8bd2c15f84c service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:03.205208 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7fa74-b43d-4861-bf8a-f8bd2c15f84c service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:03.270809 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b45a6-6d69-4162-aa0f-c948b47dabfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:03.271684 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b45a6-6d69-4162-aa0f-c948b47dabfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:03.272067 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b45a6-6d69-4162-aa0f-c948b47dabfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:03.272504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b45a6-6d69-4162-aa0f-c948b47dabfb admin admin] PATH_INFO: `/v3/users/eb46cd790d144cb8a6afdc3176a458a3` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:03.274230 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b45a6-6d69-4162-aa0f-c948b47dabfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb46cd790d144cb8a6afdc3176a458a3)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:03.277153 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b45a6-6d69-4162-aa0f-c948b47dabfb admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:03.596171 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4f7b45a6-6d69-4162-aa0f-c948b47dabfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb46cd790d144cb8a6afdc3176a458a3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:03.596831 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4f7b45a6-6d69-4162-aa0f-c948b47dabfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb46cd790d144cb8a6afdc3176a458a3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:03.611974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4f7b45a6-6d69-4162-aa0f-c948b47dabfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb46cd790d144cb8a6afdc3176a458a3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:03.619284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4f7b45a6-6d69-4162-aa0f-c948b47dabfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb46cd790d144cb8a6afdc3176a458a3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:03.689799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-4f7b45a6-6d69-4162-aa0f-c948b47dabfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb46cd790d144cb8a6afdc3176a458a3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:03.700721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1174/2325] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:06:03 2022] DELETE /identity/v3/users/eb46cd790d144cb8a6afdc3176a458a3 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:03.720158 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:04.010009 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:04.297447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12078ca-b79f-433d-b0c9-0adc0024827b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:04.299848 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a12078ca-b79f-433d-b0c9-0adc0024827b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:04.312778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12078ca-b79f-433d-b0c9-0adc0024827b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:04.369361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2900f-cb29-4123-bc11-b25c8e5ace43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:04.370568 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2900f-cb29-4123-bc11-b25c8e5ace43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:04.370898 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2900f-cb29-4123-bc11-b25c8e5ace43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:04.371177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2900f-cb29-4123-bc11-b25c8e5ace43 admin admin] PATH_INFO: `/v3/projects/6b6a22f6ace2478a9382fd68afeed3df` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:04.372293 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2900f-cb29-4123-bc11-b25c8e5ace43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b6a22f6ace2478a9382fd68afeed3df)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:04.374256 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2900f-cb29-4123-bc11-b25c8e5ace43 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:04.507543 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c5b2900f-cb29-4123-bc11-b25c8e5ace43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b6a22f6ace2478a9382fd68afeed3df', 'request_id': 'req-c5b2900f-cb29-4123-bc11-b25c8e5ace43'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:04.514091 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c5b2900f-cb29-4123-bc11-b25c8e5ace43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b6a22f6ace2478a9382fd68afeed3df', 'request_id': 'req-c5b2900f-cb29-4123-bc11-b25c8e5ace43'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:04.520449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c5b2900f-cb29-4123-bc11-b25c8e5ace43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b6a22f6ace2478a9382fd68afeed3df', 'request_id': 'req-c5b2900f-cb29-4123-bc11-b25c8e5ace43'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:04.632032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c5b2900f-cb29-4123-bc11-b25c8e5ace43 admin admin] The token cache is being invalidate because project 6b6a22f6ace2478a9382fd68afeed3df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:06:04.632428 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c5b2900f-cb29-4123-bc11-b25c8e5ace43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:04.633060 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c5b2900f-cb29-4123-bc11-b25c8e5ace43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:04.634609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1152/2326] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:06:04 2022] DELETE /identity/v3/projects/6b6a22f6ace2478a9382fd68afeed3df => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:04.639686 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864267cc-2866-42ce-8e91-1a92aba40e1c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:04.640143 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864267cc-2866-42ce-8e91-1a92aba40e1c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:04.640833 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864267cc-2866-42ce-8e91-1a92aba40e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:04.659389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-864267cc-2866-42ce-8e91-1a92aba40e1c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:04.660583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-864267cc-2866-42ce-8e91-1a92aba40e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:04.717510 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1175/2327] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:04.725174 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd493d04-2c60-424e-9b06-d76190e9139f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:04.725467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd493d04-2c60-424e-9b06-d76190e9139f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:04.725747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd493d04-2c60-424e-9b06-d76190e9139f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:04.746416 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-dd493d04-2c60-424e-9b06-d76190e9139f None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:04.747634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-dd493d04-2c60-424e-9b06-d76190e9139f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:04.753175 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:04.755622 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1153/2328] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:04.762560 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864267cc-2866-42ce-8e91-1a92aba40e1c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:04.771892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864267cc-2866-42ce-8e91-1a92aba40e1c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:04.776434 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef398a6e-f4df-4ce1-835f-e639199a7060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:04.777109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef398a6e-f4df-4ce1-835f-e639199a7060 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:04.777394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef398a6e-f4df-4ce1-835f-e639199a7060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:04.777671 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef398a6e-f4df-4ce1-835f-e639199a7060 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:04.778324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef398a6e-f4df-4ce1-835f-e639199a7060 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:06:04.778633 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef398a6e-f4df-4ce1-835f-e639199a7060 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:04.780309 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef398a6e-f4df-4ce1-835f-e639199a7060 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:04.791504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1176/2329] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:06:04.797649 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd493d04-2c60-424e-9b06-d76190e9139f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:04.807262 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd493d04-2c60-424e-9b06-d76190e9139f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:04.812968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125226f3-a7cf-4938-989a-2056d953ca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:04.813599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125226f3-a7cf-4938-989a-2056d953ca59 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:04.813875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125226f3-a7cf-4938-989a-2056d953ca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:04.814145 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125226f3-a7cf-4938-989a-2056d953ca59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:04.814800 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125226f3-a7cf-4938-989a-2056d953ca59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:04.816703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125226f3-a7cf-4938-989a-2056d953ca59 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:04.897206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1154/2330] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:06:04 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:06:04.902438 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef398a6e-f4df-4ce1-835f-e639199a7060 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:04.912720 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef398a6e-f4df-4ce1-835f-e639199a7060 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:04.941996 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:04.971522 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81a29b-c6f7-462b-866a-9661ec01de99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:04.972137 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81a29b-c6f7-462b-866a-9661ec01de99 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:04.972424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81a29b-c6f7-462b-866a-9661ec01de99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:04.972701 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81a29b-c6f7-462b-866a-9661ec01de99 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:04.973339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81a29b-c6f7-462b-866a-9661ec01de99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:04.975314 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81a29b-c6f7-462b-866a-9661ec01de99 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:05.148667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1177/2331] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:06:04 2022] POST /identity/v3/users => generated 291 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:06:05.153204 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125226f3-a7cf-4938-989a-2056d953ca59 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:05.171052 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125226f3-a7cf-4938-989a-2056d953ca59 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:05.176166 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249924a-7b5e-4009-8e99-5d84d8192fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:05.176811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249924a-7b5e-4009-8e99-5d84d8192fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:05.177095 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249924a-7b5e-4009-8e99-5d84d8192fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:05.177373 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249924a-7b5e-4009-8e99-5d84d8192fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:05.178019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249924a-7b5e-4009-8e99-5d84d8192fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:05.179637 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249924a-7b5e-4009-8e99-5d84d8192fdc admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:05.189943 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1155/2332] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:06:05.194431 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81a29b-c6f7-462b-866a-9661ec01de99 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:05.204722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81a29b-c6f7-462b-866a-9661ec01de99 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:05.209440 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b74548-0b74-4db7-a327-473eca9b21e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:05.210047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b74548-0b74-4db7-a327-473eca9b21e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:05.210329 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b74548-0b74-4db7-a327-473eca9b21e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:05.210611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b74548-0b74-4db7-a327-473eca9b21e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:05.211322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b74548-0b74-4db7-a327-473eca9b21e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:05.212943 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b74548-0b74-4db7-a327-473eca9b21e4 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:05.225496 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1178/2333] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:06:05.230725 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249924a-7b5e-4009-8e99-5d84d8192fdc admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:05.242566 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249924a-7b5e-4009-8e99-5d84d8192fdc admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:05.247160 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4227d8-aa3d-47b3-81c9-a65d2a9e6edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:05.247845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4227d8-aa3d-47b3-81c9-a65d2a9e6edf admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:05.248169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4227d8-aa3d-47b3-81c9-a65d2a9e6edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:05.248416 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4227d8-aa3d-47b3-81c9-a65d2a9e6edf admin admin] PATH_INFO: `/v3/projects/4f883c458204477989a20b58233c5fe2/users/29888644e1ac411d9f854fea6416ed8f/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:05.264355 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4227d8-aa3d-47b3-81c9-a65d2a9e6edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f883c458204477989a20b58233c5fe2, user_id=29888644e1ac411d9f854fea6416ed8f, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:05.267221 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4227d8-aa3d-47b3-81c9-a65d2a9e6edf admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:05.355260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1156/2334] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:06:05 2022] PUT /identity/v3/projects/4f883c458204477989a20b58233c5fe2/users/29888644e1ac411d9f854fea6416ed8f/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:05.366969 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72127608-fdaf-4201-b827-9635d821f3a5 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:05.367261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72127608-fdaf-4201-b827-9635d821f3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:05.367534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72127608-fdaf-4201-b827-9635d821f3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:05.397017 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-72127608-fdaf-4201-b827-9635d821f3a5 None None] MFA Rules not processed for user `29888644e1ac411d9f854fea6416ed8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:05.398243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-72127608-fdaf-4201-b827-9635d821f3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:05.461949 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1179/2335] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:05.467217 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4227d8-aa3d-47b3-81c9-a65d2a9e6edf admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:05.524590 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:05.531013 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4227d8-aa3d-47b3-81c9-a65d2a9e6edf admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:05.536027 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040e2a9-8616-4690-8bf5-b5d439bc13d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:05.536688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040e2a9-8616-4690-8bf5-b5d439bc13d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:05.536920 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040e2a9-8616-4690-8bf5-b5d439bc13d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:05.537197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040e2a9-8616-4690-8bf5-b5d439bc13d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:05.537818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040e2a9-8616-4690-8bf5-b5d439bc13d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:05.539831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040e2a9-8616-4690-8bf5-b5d439bc13d4 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:05.563324 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:05.674737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1157/2336] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:06:05 2022] POST /identity/v3/projects => generated 381 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:06:05.678674 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72127608-fdaf-4201-b827-9635d821f3a5 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:05.689743 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72127608-fdaf-4201-b827-9635d821f3a5 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:05.747078 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d129bd-8d5c-4265-ab15-e206b8adaa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:05.747682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d129bd-8d5c-4265-ab15-e206b8adaa46 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:05.747961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d129bd-8d5c-4265-ab15-e206b8adaa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:05.748230 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d129bd-8d5c-4265-ab15-e206b8adaa46 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:05.748886 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d129bd-8d5c-4265-ab15-e206b8adaa46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:05.750822 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d129bd-8d5c-4265-ab15-e206b8adaa46 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:05.839043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1180/2337] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:06:05 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:06:05.843408 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040e2a9-8616-4690-8bf5-b5d439bc13d4 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:05.854101 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040e2a9-8616-4690-8bf5-b5d439bc13d4 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:05.859112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4eb98f-5cfd-425d-b130-489ec1c03c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:05.859842 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eb98f-5cfd-425d-b130-489ec1c03c59 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:05.860160 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eb98f-5cfd-425d-b130-489ec1c03c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:05.860782 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4eb98f-5cfd-425d-b130-489ec1c03c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:05.861439 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4eb98f-5cfd-425d-b130-489ec1c03c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:05.863077 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4eb98f-5cfd-425d-b130-489ec1c03c59 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:05.874643 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1158/2338] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:06:05.879073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d129bd-8d5c-4265-ab15-e206b8adaa46 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:05.889862 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d129bd-8d5c-4265-ab15-e206b8adaa46 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:05.895556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb099de-d9b9-4a80-8658-cec1f64c7874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:05.895556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb099de-d9b9-4a80-8658-cec1f64c7874 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:05.895806 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb099de-d9b9-4a80-8658-cec1f64c7874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:05.895936 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb099de-d9b9-4a80-8658-cec1f64c7874 admin admin] PATH_INFO: `/v3/projects/1af42bdae0f84926ab808ecb181fec79/users/7d22280f1ab546f19786eb37cafea7bd/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:05.911215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb099de-d9b9-4a80-8658-cec1f64c7874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af42bdae0f84926ab808ecb181fec79, user_id=7d22280f1ab546f19786eb37cafea7bd, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:05.913867 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb099de-d9b9-4a80-8658-cec1f64c7874 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:06.016661 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1181/2339] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:06:05 2022] PUT /identity/v3/projects/1af42bdae0f84926ab808ecb181fec79/users/7d22280f1ab546f19786eb37cafea7bd/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:06.020854 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4eb98f-5cfd-425d-b130-489ec1c03c59 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:06.027493 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:06.031827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4eb98f-5cfd-425d-b130-489ec1c03c59 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:06.062937 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:06.091265 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3644656-0023-4b42-a133-b9dd1b2a9d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:06.091826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3644656-0023-4b42-a133-b9dd1b2a9d9a admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:06.092117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3644656-0023-4b42-a133-b9dd1b2a9d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:06.092423 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3644656-0023-4b42-a133-b9dd1b2a9d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:06.093069 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3644656-0023-4b42-a133-b9dd1b2a9d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:06.094723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3644656-0023-4b42-a133-b9dd1b2a9d9a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:06.105677 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1159/2340] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:06:06.110711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb099de-d9b9-4a80-8658-cec1f64c7874 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:06.122695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb099de-d9b9-4a80-8658-cec1f64c7874 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:06.127483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee732c-9c5a-4cc4-a9ae-671112c0278e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:06.128139 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee732c-9c5a-4cc4-a9ae-671112c0278e admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:06.128423 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee732c-9c5a-4cc4-a9ae-671112c0278e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:06.128691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee732c-9c5a-4cc4-a9ae-671112c0278e admin admin] PATH_INFO: `/v3/projects/1af42bdae0f84926ab808ecb181fec79/users/7d22280f1ab546f19786eb37cafea7bd/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:06.130576 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee732c-9c5a-4cc4-a9ae-671112c0278e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af42bdae0f84926ab808ecb181fec79, user_id=7d22280f1ab546f19786eb37cafea7bd, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:06.133278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee732c-9c5a-4cc4-a9ae-671112c0278e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:06.143979 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1182/2341] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:06:06 2022] PUT /identity/v3/projects/1af42bdae0f84926ab808ecb181fec79/users/7d22280f1ab546f19786eb37cafea7bd/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:06.155146 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48363dd0-9f9a-437f-a871-f6f4dcd7a161 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:06.157634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48363dd0-9f9a-437f-a871-f6f4dcd7a161 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:06.157634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48363dd0-9f9a-437f-a871-f6f4dcd7a161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:06.190559 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-48363dd0-9f9a-437f-a871-f6f4dcd7a161 None None] MFA Rules not processed for user `7d22280f1ab546f19786eb37cafea7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:06.192036 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-48363dd0-9f9a-437f-a871-f6f4dcd7a161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:06.210794 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:06.252257 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:06.293240 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1160/2342] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:06.303592 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee732c-9c5a-4cc4-a9ae-671112c0278e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:06.305281 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b0ee732c-9c5a-4cc4-a9ae-671112c0278e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:06.365759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee732c-9c5a-4cc4-a9ae-671112c0278e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:06.371290 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711380fe-5fb5-4bbc-bfc0-db39da9559cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:06.371923 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711380fe-5fb5-4bbc-bfc0-db39da9559cd service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:06.372201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711380fe-5fb5-4bbc-bfc0-db39da9559cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:06.372478 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711380fe-5fb5-4bbc-bfc0-db39da9559cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:06.384071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711380fe-5fb5-4bbc-bfc0-db39da9559cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:06.386495 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711380fe-5fb5-4bbc-bfc0-db39da9559cd service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:06.393848 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1183/2343] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:06:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:06:06.434181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:06.627178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:06.984070 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48363dd0-9f9a-437f-a871-f6f4dcd7a161 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:07.046036 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48363dd0-9f9a-437f-a871-f6f4dcd7a161 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:07.050539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4d99f-4e5f-4fd3-afef-d9bffbba4644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:07.051396 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4d99f-4e5f-4fd3-afef-d9bffbba4644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:07.051674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4d99f-4e5f-4fd3-afef-d9bffbba4644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:07.051943 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4d99f-4e5f-4fd3-afef-d9bffbba4644 admin admin] PATH_INFO: `/v3/users/29888644e1ac411d9f854fea6416ed8f` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:07.053068 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4d99f-4e5f-4fd3-afef-d9bffbba4644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29888644e1ac411d9f854fea6416ed8f)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:07.054994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4d99f-4e5f-4fd3-afef-d9bffbba4644 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:07.140470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:07.263683 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:07.326354 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8de4d99f-4e5f-4fd3-afef-d9bffbba4644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29888644e1ac411d9f854fea6416ed8f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:07.338066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8de4d99f-4e5f-4fd3-afef-d9bffbba4644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29888644e1ac411d9f854fea6416ed8f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:07.339304 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8de4d99f-4e5f-4fd3-afef-d9bffbba4644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29888644e1ac411d9f854fea6416ed8f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:07.415462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8de4d99f-4e5f-4fd3-afef-d9bffbba4644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29888644e1ac411d9f854fea6416ed8f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:07.438788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-8de4d99f-4e5f-4fd3-afef-d9bffbba4644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29888644e1ac411d9f854fea6416ed8f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:07.452178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1161/2344] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:06:06 2022] DELETE /identity/v3/users/29888644e1ac411d9f854fea6416ed8f => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:07.457061 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f25ed-b91b-40a6-a930-1943a59462d1 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:07.457174 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f25ed-b91b-40a6-a930-1943a59462d1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:07.457449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f25ed-b91b-40a6-a930-1943a59462d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:07.477526 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-6a7f25ed-b91b-40a6-a930-1943a59462d1 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:07.479217 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6a7f25ed-b91b-40a6-a930-1943a59462d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:07.485100 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:07.546207 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1184/2345] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:06:07.556152 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4d99f-4e5f-4fd3-afef-d9bffbba4644 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:07.557811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8de4d99f-4e5f-4fd3-afef-d9bffbba4644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:07.587319 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:07.616674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4d99f-4e5f-4fd3-afef-d9bffbba4644 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:07.621333 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93e627-cfa6-4f18-a91f-a18df4f86726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:07.621333 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93e627-cfa6-4f18-a91f-a18df4f86726 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:07.636122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93e627-cfa6-4f18-a91f-a18df4f86726 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:07.636122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93e627-cfa6-4f18-a91f-a18df4f86726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:07.636122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:07.636122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93e627-cfa6-4f18-a91f-a18df4f86726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:07.636122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93e627-cfa6-4f18-a91f-a18df4f86726 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:07.646987 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1162/2346] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:06:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:06:07.906318 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:08.078978 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:08.130696 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f25ed-b91b-40a6-a930-1943a59462d1 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:08.132162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6a7f25ed-b91b-40a6-a930-1943a59462d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:08.144565 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f25ed-b91b-40a6-a930-1943a59462d1 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:08.149183 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c8458-ed2e-4bb4-a412-61fb8d38d81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:08.149816 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c8458-ed2e-4bb4-a412-61fb8d38d81c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:08.150097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c8458-ed2e-4bb4-a412-61fb8d38d81c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:08.150374 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c8458-ed2e-4bb4-a412-61fb8d38d81c admin admin] PATH_INFO: `/v3/projects/4f883c458204477989a20b58233c5fe2` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:08.152165 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c8458-ed2e-4bb4-a412-61fb8d38d81c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f883c458204477989a20b58233c5fe2)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:08.154410 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c8458-ed2e-4bb4-a412-61fb8d38d81c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:08.296655 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1a6c8458-ed2e-4bb4-a412-61fb8d38d81c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f883c458204477989a20b58233c5fe2', 'request_id': 'req-1a6c8458-ed2e-4bb4-a412-61fb8d38d81c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:08.302277 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1a6c8458-ed2e-4bb4-a412-61fb8d38d81c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f883c458204477989a20b58233c5fe2', 'request_id': 'req-1a6c8458-ed2e-4bb4-a412-61fb8d38d81c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:08.375355 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1a6c8458-ed2e-4bb4-a412-61fb8d38d81c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f883c458204477989a20b58233c5fe2', 'request_id': 'req-1a6c8458-ed2e-4bb4-a412-61fb8d38d81c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:08.393348 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1a6c8458-ed2e-4bb4-a412-61fb8d38d81c admin admin] The token cache is being invalidate because project 4f883c458204477989a20b58233c5fe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:06:08.393648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1a6c8458-ed2e-4bb4-a412-61fb8d38d81c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:08.394426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1a6c8458-ed2e-4bb4-a412-61fb8d38d81c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:08.395858 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1185/2347] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:06:08 2022] DELETE /identity/v3/projects/4f883c458204477989a20b58233c5fe2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:08.404632 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93e627-cfa6-4f18-a91f-a18df4f86726 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:08.414178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93e627-cfa6-4f18-a91f-a18df4f86726 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:08.458695 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:08.474054 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f18ec-f7af-4cce-8ad8-78664de4cc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:08.475099 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f18ec-f7af-4cce-8ad8-78664de4cc93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:08.475600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f18ec-f7af-4cce-8ad8-78664de4cc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:08.475989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f18ec-f7af-4cce-8ad8-78664de4cc93 admin admin] PATH_INFO: `/v3/users/7d22280f1ab546f19786eb37cafea7bd` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:08.477550 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f18ec-f7af-4cce-8ad8-78664de4cc93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d22280f1ab546f19786eb37cafea7bd)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:08.480518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f18ec-f7af-4cce-8ad8-78664de4cc93 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:08.603712 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:08.718335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-036f18ec-f7af-4cce-8ad8-78664de4cc93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d22280f1ab546f19786eb37cafea7bd'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:08.733784 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-036f18ec-f7af-4cce-8ad8-78664de4cc93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d22280f1ab546f19786eb37cafea7bd'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:08.734827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-036f18ec-f7af-4cce-8ad8-78664de4cc93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d22280f1ab546f19786eb37cafea7bd'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:08.815636 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-036f18ec-f7af-4cce-8ad8-78664de4cc93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d22280f1ab546f19786eb37cafea7bd'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:08.826356 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-036f18ec-f7af-4cce-8ad8-78664de4cc93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d22280f1ab546f19786eb37cafea7bd'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:08.832535 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1163/2348] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:06:08 2022] DELETE /identity/v3/users/7d22280f1ab546f19786eb37cafea7bd => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:09.285648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c8458-ed2e-4bb4-a412-61fb8d38d81c admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:09.294082 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1a6c8458-ed2e-4bb4-a412-61fb8d38d81c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:09.301721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c8458-ed2e-4bb4-a412-61fb8d38d81c admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:09.367459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fa115-48b3-4427-8556-5efb62073b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:09.368184 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fa115-48b3-4427-8556-5efb62073b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:09.368538 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fa115-48b3-4427-8556-5efb62073b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:09.368889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fa115-48b3-4427-8556-5efb62073b64 admin admin] PATH_INFO: `/v3/projects/1af42bdae0f84926ab808ecb181fec79` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:09.371037 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fa115-48b3-4427-8556-5efb62073b64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af42bdae0f84926ab808ecb181fec79)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:09.373438 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fa115-48b3-4427-8556-5efb62073b64 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:09.512875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2f9fa115-48b3-4427-8556-5efb62073b64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af42bdae0f84926ab808ecb181fec79', 'request_id': 'req-2f9fa115-48b3-4427-8556-5efb62073b64'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:09.518197 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2f9fa115-48b3-4427-8556-5efb62073b64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af42bdae0f84926ab808ecb181fec79', 'request_id': 'req-2f9fa115-48b3-4427-8556-5efb62073b64'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:09.609707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2f9fa115-48b3-4427-8556-5efb62073b64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af42bdae0f84926ab808ecb181fec79', 'request_id': 'req-2f9fa115-48b3-4427-8556-5efb62073b64'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:09.623376 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2f9fa115-48b3-4427-8556-5efb62073b64 admin admin] The token cache is being invalidate because project 1af42bdae0f84926ab808ecb181fec79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:06:09.623588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2f9fa115-48b3-4427-8556-5efb62073b64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:09.624224 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-2f9fa115-48b3-4427-8556-5efb62073b64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:09.625706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1186/2349] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:06:09 2022] DELETE /identity/v3/projects/1af42bdae0f84926ab808ecb181fec79 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:09.630744 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720594c-1150-4ccb-8e17-a7a799d37caa None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:09.631242 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720594c-1150-4ccb-8e17-a7a799d37caa None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:09.631409 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720594c-1150-4ccb-8e17-a7a799d37caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:09.653690 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7720594c-1150-4ccb-8e17-a7a799d37caa None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:09.654943 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7720594c-1150-4ccb-8e17-a7a799d37caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:09.720894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1164/2350] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:09.728586 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6353ea-a698-42b4-bc42-e2de9f137871 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:09.728904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6353ea-a698-42b4-bc42-e2de9f137871 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:09.730541 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6353ea-a698-42b4-bc42-e2de9f137871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:09.749557 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5c6353ea-a698-42b4-bc42-e2de9f137871 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:09.753232 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5c6353ea-a698-42b4-bc42-e2de9f137871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:09.759073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1187/2351] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:09.764980 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720594c-1150-4ccb-8e17-a7a799d37caa None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:09.779422 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720594c-1150-4ccb-8e17-a7a799d37caa None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:09.786617 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7463595-6830-43a0-8cef-be54c06cba5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:09.787284 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7463595-6830-43a0-8cef-be54c06cba5c admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:09.788867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7463595-6830-43a0-8cef-be54c06cba5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:09.788867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7463595-6830-43a0-8cef-be54c06cba5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:09.788867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7463595-6830-43a0-8cef-be54c06cba5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:06:09.788867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7463595-6830-43a0-8cef-be54c06cba5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:09.790435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7463595-6830-43a0-8cef-be54c06cba5c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:09.811325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1165/2352] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:06:09.826776 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6353ea-a698-42b4-bc42-e2de9f137871 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:09.841715 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6353ea-a698-42b4-bc42-e2de9f137871 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:09.847232 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42894d3b-2f51-4916-a5e4-d12964c54229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:09.848087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42894d3b-2f51-4916-a5e4-d12964c54229 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:09.848438 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42894d3b-2f51-4916-a5e4-d12964c54229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:09.848825 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42894d3b-2f51-4916-a5e4-d12964c54229 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:09.849739 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42894d3b-2f51-4916-a5e4-d12964c54229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:09.852062 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42894d3b-2f51-4916-a5e4-d12964c54229 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:09.942791 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1188/2353] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:06:09 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:06:09.950419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7463595-6830-43a0-8cef-be54c06cba5c admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:09.960901 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7463595-6830-43a0-8cef-be54c06cba5c admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:09.969920 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:10.019018 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfbd7d-d55e-4238-8f14-fce9ea581de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:10.019699 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfbd7d-d55e-4238-8f14-fce9ea581de3 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:10.019985 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfbd7d-d55e-4238-8f14-fce9ea581de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:10.020261 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfbd7d-d55e-4238-8f14-fce9ea581de3 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:10.020892 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfbd7d-d55e-4238-8f14-fce9ea581de3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:10.022837 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfbd7d-d55e-4238-8f14-fce9ea581de3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:10.118733 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1166/2354] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:06:09 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:06:10.123614 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42894d3b-2f51-4916-a5e4-d12964c54229 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:10.133826 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42894d3b-2f51-4916-a5e4-d12964c54229 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:10.138330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae681f6-af83-4473-96b3-483dad784dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:10.138963 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae681f6-af83-4473-96b3-483dad784dbf admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:10.139246 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae681f6-af83-4473-96b3-483dad784dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:10.139518 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae681f6-af83-4473-96b3-483dad784dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:10.140165 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae681f6-af83-4473-96b3-483dad784dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:10.141746 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae681f6-af83-4473-96b3-483dad784dbf admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:10.151565 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1189/2355] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:06:10.155842 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfbd7d-d55e-4238-8f14-fce9ea581de3 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:10.168211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfbd7d-d55e-4238-8f14-fce9ea581de3 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:10.173024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80950a4c-0ac9-43a8-9675-a2a8a293de65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:10.173627 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80950a4c-0ac9-43a8-9675-a2a8a293de65 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:10.173911 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80950a4c-0ac9-43a8-9675-a2a8a293de65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:10.174222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80950a4c-0ac9-43a8-9675-a2a8a293de65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:10.174902 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80950a4c-0ac9-43a8-9675-a2a8a293de65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:10.176495 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80950a4c-0ac9-43a8-9675-a2a8a293de65 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:10.188149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1167/2356] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:06:10.192511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae681f6-af83-4473-96b3-483dad784dbf admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:10.202814 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae681f6-af83-4473-96b3-483dad784dbf admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:10.207558 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d7683-cc5c-4494-9b65-f98a21d3dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:10.208207 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d7683-cc5c-4494-9b65-f98a21d3dd24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:10.208526 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d7683-cc5c-4494-9b65-f98a21d3dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:10.208808 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d7683-cc5c-4494-9b65-f98a21d3dd24 admin admin] PATH_INFO: `/v3/projects/dabc78c1281c4b8abc6fdff60afd2817/users/808e035e834c4bc89721166c5f23021b/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:10.223422 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d7683-cc5c-4494-9b65-f98a21d3dd24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dabc78c1281c4b8abc6fdff60afd2817, user_id=808e035e834c4bc89721166c5f23021b, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:10.226130 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d7683-cc5c-4494-9b65-f98a21d3dd24 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:10.249855 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:10.300576 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1190/2357] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:06:10 2022] PUT /identity/v3/projects/dabc78c1281c4b8abc6fdff60afd2817/users/808e035e834c4bc89721166c5f23021b/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:10.305516 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba27d8-2261-4dff-b726-6d6a0850a725 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:10.305842 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba27d8-2261-4dff-b726-6d6a0850a725 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:10.306125 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba27d8-2261-4dff-b726-6d6a0850a725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:10.326490 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-37ba27d8-2261-4dff-b726-6d6a0850a725 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:10.327757 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-37ba27d8-2261-4dff-b726-6d6a0850a725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:10.386303 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1168/2358] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:10.395691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d7683-cc5c-4494-9b65-f98a21d3dd24 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:10.398436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d08d7683-cc5c-4494-9b65-f98a21d3dd24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:10.456054 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d7683-cc5c-4494-9b65-f98a21d3dd24 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:10.459930 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4385c9c-cc05-4007-9b97-b8c6aafcbf08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:10.460531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4385c9c-cc05-4007-9b97-b8c6aafcbf08 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:10.460847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4385c9c-cc05-4007-9b97-b8c6aafcbf08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:10.461106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4385c9c-cc05-4007-9b97-b8c6aafcbf08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:10.473732 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4385c9c-cc05-4007-9b97-b8c6aafcbf08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:10.475254 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4385c9c-cc05-4007-9b97-b8c6aafcbf08 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:10.486236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1191/2359] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:06:10.731930 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:11.526613 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:12.087170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b125749-c6c6-4481-8872-598d4111f2db None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:12.087778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b125749-c6c6-4481-8872-598d4111f2db None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:12.088455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b125749-c6c6-4481-8872-598d4111f2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:12.124939 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2b125749-c6c6-4481-8872-598d4111f2db None None] MFA Rules not processed for user `808e035e834c4bc89721166c5f23021b`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:12.126239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2b125749-c6c6-4481-8872-598d4111f2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:12.199271 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1169/2360] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:12.203931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4385c9c-cc05-4007-9b97-b8c6aafcbf08 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:12.215602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4385c9c-cc05-4007-9b97-b8c6aafcbf08 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:12.235776 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72529463-c2ae-4403-a80f-86bd09d00605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:12.236672 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72529463-c2ae-4403-a80f-86bd09d00605 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:12.239247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72529463-c2ae-4403-a80f-86bd09d00605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:12.239870 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:12.240966 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72529463-c2ae-4403-a80f-86bd09d00605 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:12.242193 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72529463-c2ae-4403-a80f-86bd09d00605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:12.244304 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72529463-c2ae-4403-a80f-86bd09d00605 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:12.433284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1192/2361] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:06:12 2022] POST /identity/v3/projects => generated 373 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:06:12.435023 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b125749-c6c6-4481-8872-598d4111f2db None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:12.448799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b125749-c6c6-4481-8872-598d4111f2db None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:12.480969 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:12.508861 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b878973-7cc8-4ff1-8edd-b81bed3ed195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:12.509469 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b878973-7cc8-4ff1-8edd-b81bed3ed195 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:12.509747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b878973-7cc8-4ff1-8edd-b81bed3ed195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:12.510021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b878973-7cc8-4ff1-8edd-b81bed3ed195 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:12.510900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b878973-7cc8-4ff1-8edd-b81bed3ed195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:12.516835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b878973-7cc8-4ff1-8edd-b81bed3ed195 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:12.604992 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1170/2362] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:06:12 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:06:12.609399 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72529463-c2ae-4403-a80f-86bd09d00605 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:12.628649 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72529463-c2ae-4403-a80f-86bd09d00605 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:12.634387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155947d-35ee-4b45-981c-5e8b7056e97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:12.635043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155947d-35ee-4b45-981c-5e8b7056e97a admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:12.635621 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155947d-35ee-4b45-981c-5e8b7056e97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:12.635902 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155947d-35ee-4b45-981c-5e8b7056e97a admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:12.636556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155947d-35ee-4b45-981c-5e8b7056e97a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:12.638303 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155947d-35ee-4b45-981c-5e8b7056e97a admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:12.649639 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1193/2363] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:06:12.654687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b878973-7cc8-4ff1-8edd-b81bed3ed195 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:12.666910 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b878973-7cc8-4ff1-8edd-b81bed3ed195 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:12.673555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d56152-5e96-42c4-9ac9-f4b5fa24dccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:12.674261 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d56152-5e96-42c4-9ac9-f4b5fa24dccf admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:12.674543 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d56152-5e96-42c4-9ac9-f4b5fa24dccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:12.674845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d56152-5e96-42c4-9ac9-f4b5fa24dccf admin admin] PATH_INFO: `/v3/projects/0038e654f15a48d19b53beacc05dbfcc/users/b13fad98c93e4954b41e65518d7d2821/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:12.693568 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d56152-5e96-42c4-9ac9-f4b5fa24dccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0038e654f15a48d19b53beacc05dbfcc, user_id=b13fad98c93e4954b41e65518d7d2821, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:12.696311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d56152-5e96-42c4-9ac9-f4b5fa24dccf admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:12.809856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1171/2364] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:06:12 2022] PUT /identity/v3/projects/0038e654f15a48d19b53beacc05dbfcc/users/b13fad98c93e4954b41e65518d7d2821/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:12.814022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155947d-35ee-4b45-981c-5e8b7056e97a admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:12.824551 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155947d-35ee-4b45-981c-5e8b7056e97a admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:12.882366 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de49be-6578-469a-a933-c3aa04e9a9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:12.882972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de49be-6578-469a-a933-c3aa04e9a9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:12.883257 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de49be-6578-469a-a933-c3aa04e9a9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:12.883532 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de49be-6578-469a-a933-c3aa04e9a9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:12.884190 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de49be-6578-469a-a933-c3aa04e9a9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:12.886509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de49be-6578-469a-a933-c3aa04e9a9c1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:12.896324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1194/2365] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:06:12.900687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d56152-5e96-42c4-9ac9-f4b5fa24dccf admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:12.912769 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d56152-5e96-42c4-9ac9-f4b5fa24dccf admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:12.916891 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac3b95-fcbb-401b-8614-f1976dee01b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:12.917592 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac3b95-fcbb-401b-8614-f1976dee01b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:12.917878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac3b95-fcbb-401b-8614-f1976dee01b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:12.918155 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac3b95-fcbb-401b-8614-f1976dee01b2 admin admin] PATH_INFO: `/v3/projects/0038e654f15a48d19b53beacc05dbfcc/users/b13fad98c93e4954b41e65518d7d2821/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:12.920116 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac3b95-fcbb-401b-8614-f1976dee01b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0038e654f15a48d19b53beacc05dbfcc, user_id=b13fad98c93e4954b41e65518d7d2821, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:12.922784 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac3b95-fcbb-401b-8614-f1976dee01b2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:12.933735 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1172/2366] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:06:12 2022] PUT /identity/v3/projects/0038e654f15a48d19b53beacc05dbfcc/users/b13fad98c93e4954b41e65518d7d2821/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:06:13.685308 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:14.267052 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:14.513129 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:14.606482 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa01184-2681-4f9b-b51d-0020f90e95e5 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:14.607204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa01184-2681-4f9b-b51d-0020f90e95e5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:14.609620 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa01184-2681-4f9b-b51d-0020f90e95e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:14.664680 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5fa01184-2681-4f9b-b51d-0020f90e95e5 None None] MFA Rules not processed for user `b13fad98c93e4954b41e65518d7d2821`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:14.666157 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5fa01184-2681-4f9b-b51d-0020f90e95e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:14.810815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1195/2367] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:14.821469 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ade42-231c-4169-b448-8f0e2c5a70fe None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:14.824587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ade42-231c-4169-b448-8f0e2c5a70fe None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:14.824587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ade42-231c-4169-b448-8f0e2c5a70fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:14.862573 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c26ade42-231c-4169-b448-8f0e2c5a70fe None None] MFA Rules not processed for user `808e035e834c4bc89721166c5f23021b`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:14.864237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c26ade42-231c-4169-b448-8f0e2c5a70fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:14.955641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1173/2368] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:06:15.124762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa01184-2681-4f9b-b51d-0020f90e95e5 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:15.126205 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5fa01184-2681-4f9b-b51d-0020f90e95e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:15.211422 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa01184-2681-4f9b-b51d-0020f90e95e5 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:15.217438 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef51f1-9a4b-4928-9c18-41cc1ffbb974 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:15.218109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef51f1-9a4b-4928-9c18-41cc1ffbb974 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:15.218441 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef51f1-9a4b-4928-9c18-41cc1ffbb974 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:15.218717 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef51f1-9a4b-4928-9c18-41cc1ffbb974 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:15.227032 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef51f1-9a4b-4928-9c18-41cc1ffbb974 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:15.228695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef51f1-9a4b-4928-9c18-41cc1ffbb974 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:15.240782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1196/2369] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:06:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:06:15.632651 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:16.106721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:16.861696 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:17.568976 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:18.124776 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:18.519110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:18.759234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:18.958170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:19.195026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:19.585979 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:19.891701 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:20.204900 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:20.781469 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:21.712518 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:21.992820 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:22.969715 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:23.668446 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:24.920790 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:25.517205 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5ce7a-6157-4aba-9ec9-537b36110bd2 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:25.517720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5ce7a-6157-4aba-9ec9-537b36110bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:25.517849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5ce7a-6157-4aba-9ec9-537b36110bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:25.539632 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5cb5ce7a-6157-4aba-9ec9-537b36110bd2 None None] MFA Rules not processed for user `950e6ba9e8ed4e00843657869bc3a26d`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:25.541251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5cb5ce7a-6157-4aba-9ec9-537b36110bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:25.597927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1174/2370] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:25.919305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:26.002213 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef51f1-9a4b-4928-9c18-41cc1ffbb974 service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:26.004062 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-06ef51f1-9a4b-4928-9c18-41cc1ffbb974 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:26.107792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef51f1-9a4b-4928-9c18-41cc1ffbb974 service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:26.114810 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f9c14-ccb2-47f1-8ac2-818ee333e551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:26.115518 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f9c14-ccb2-47f1-8ac2-818ee333e551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:26.115802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f9c14-ccb2-47f1-8ac2-818ee333e551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:26.116584 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f9c14-ccb2-47f1-8ac2-818ee333e551 admin admin] PATH_INFO: `/v3/users/8d0862bc40f74ac59ad17525ddb7d3e4` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:26.117776 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f9c14-ccb2-47f1-8ac2-818ee333e551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d0862bc40f74ac59ad17525ddb7d3e4)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:26.121076 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f9c14-ccb2-47f1-8ac2-818ee333e551 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:26.412819 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3b8f9c14-ccb2-47f1-8ac2-818ee333e551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d0862bc40f74ac59ad17525ddb7d3e4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:26.414205 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3b8f9c14-ccb2-47f1-8ac2-818ee333e551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d0862bc40f74ac59ad17525ddb7d3e4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:26.432659 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3b8f9c14-ccb2-47f1-8ac2-818ee333e551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d0862bc40f74ac59ad17525ddb7d3e4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:26.440847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3b8f9c14-ccb2-47f1-8ac2-818ee333e551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d0862bc40f74ac59ad17525ddb7d3e4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:26.529549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-3b8f9c14-ccb2-47f1-8ac2-818ee333e551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d0862bc40f74ac59ad17525ddb7d3e4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:26.537064 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1197/2371] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:06:26 2022] DELETE /identity/v3/users/8d0862bc40f74ac59ad17525ddb7d3e4 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:26.547588 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c93e2-8c88-481a-8f7e-1f6428f344e3 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:26.548800 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c93e2-8c88-481a-8f7e-1f6428f344e3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:26.548979 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c93e2-8c88-481a-8f7e-1f6428f344e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:26.574557 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a14c93e2-8c88-481a-8f7e-1f6428f344e3 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:26.576227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a14c93e2-8c88-481a-8f7e-1f6428f344e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:26.663294 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1175/2372] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:26.670549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f9c14-ccb2-47f1-8ac2-818ee333e551 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:26.672393 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3b8f9c14-ccb2-47f1-8ac2-818ee333e551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:26.769320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f9c14-ccb2-47f1-8ac2-818ee333e551 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:26.773661 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72acbd4b-6c88-4f58-9a0b-d1cce672c09a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:26.774277 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acbd4b-6c88-4f58-9a0b-d1cce672c09a service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:26.774604 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acbd4b-6c88-4f58-9a0b-d1cce672c09a service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:26.774930 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acbd4b-6c88-4f58-9a0b-d1cce672c09a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:26.788274 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72acbd4b-6c88-4f58-9a0b-d1cce672c09a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:26.789882 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72acbd4b-6c88-4f58-9a0b-d1cce672c09a service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:26.801931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1198/2373] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:06:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:06:27.003642 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:27.288773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:27.406521 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c93e2-8c88-481a-8f7e-1f6428f344e3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:27.407958 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a14c93e2-8c88-481a-8f7e-1f6428f344e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:27.420070 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c93e2-8c88-481a-8f7e-1f6428f344e3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:27.425251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9eaba7-e4d5-41c3-8618-f4df857d366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:27.426015 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9eaba7-e4d5-41c3-8618-f4df857d366f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:27.426529 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9eaba7-e4d5-41c3-8618-f4df857d366f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:27.427061 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9eaba7-e4d5-41c3-8618-f4df857d366f admin admin] PATH_INFO: `/v3/projects/b87bb6ec54f945b19e98eb3dbea624e2` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:27.428293 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9eaba7-e4d5-41c3-8618-f4df857d366f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b87bb6ec54f945b19e98eb3dbea624e2)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:27.430275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9eaba7-e4d5-41c3-8618-f4df857d366f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:27.663947 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3c9eaba7-e4d5-41c3-8618-f4df857d366f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b87bb6ec54f945b19e98eb3dbea624e2', 'request_id': 'req-3c9eaba7-e4d5-41c3-8618-f4df857d366f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:27.670929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3c9eaba7-e4d5-41c3-8618-f4df857d366f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b87bb6ec54f945b19e98eb3dbea624e2', 'request_id': 'req-3c9eaba7-e4d5-41c3-8618-f4df857d366f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:27.679583 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3c9eaba7-e4d5-41c3-8618-f4df857d366f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b87bb6ec54f945b19e98eb3dbea624e2', 'request_id': 'req-3c9eaba7-e4d5-41c3-8618-f4df857d366f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:27.764500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3c9eaba7-e4d5-41c3-8618-f4df857d366f admin admin] The token cache is being invalidate because project b87bb6ec54f945b19e98eb3dbea624e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:06:27.764803 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3c9eaba7-e4d5-41c3-8618-f4df857d366f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:27.766898 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3c9eaba7-e4d5-41c3-8618-f4df857d366f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:27.769427 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1176/2374] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:06:27 2022] DELETE /identity/v3/projects/b87bb6ec54f945b19e98eb3dbea624e2 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:29.483367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:29.694867 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4042b-0972-43f5-afae-bcf17602f33d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:29.694867 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4042b-0972-43f5-afae-bcf17602f33d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:29.694867 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe4042b-0972-43f5-afae-bcf17602f33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:29.710367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-ebe4042b-0972-43f5-afae-bcf17602f33d None None] MFA Rules not processed for user `9751264123914c27b961009f75067660`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:29.711597 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ebe4042b-0972-43f5-afae-bcf17602f33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:29.775532 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1199/2375] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Aug 11 11:06:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:29.810008 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:29.830531 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9eaba7-e4d5-41c3-8618-f4df857d366f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:29.831745 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3c9eaba7-e4d5-41c3-8618-f4df857d366f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:29.902985 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9eaba7-e4d5-41c3-8618-f4df857d366f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:29.908380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f9fba-4f85-4662-a02b-0e4446638cb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd25d1bde0c4703b61e0edaf5b658d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:29.908988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f9fba-4f85-4662-a02b-0e4446638cb0 service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:29.909264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f9fba-4f85-4662-a02b-0e4446638cb0 service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:29.909537 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f9fba-4f85-4662-a02b-0e4446638cb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:29.918823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f9fba-4f85-4662-a02b-0e4446638cb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:29.920526 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f9fba-4f85-4662-a02b-0e4446638cb0 service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:29.929153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1177/2376] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Aug 11 11:06:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 11:06:30.733308 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4042b-0972-43f5-afae-bcf17602f33d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:30.737488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ebe4042b-0972-43f5-afae-bcf17602f33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:30.834257 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe4042b-0972-43f5-afae-bcf17602f33d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:30.839927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e355d5-cb44-4673-b675-0002bf8f68c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:30.841056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e355d5-cb44-4673-b675-0002bf8f68c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:30.841592 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e355d5-cb44-4673-b675-0002bf8f68c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:30.842253 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e355d5-cb44-4673-b675-0002bf8f68c1 admin admin] PATH_INFO: `/v3/users/43561432a5924ad8b655fb6dae333800` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:30.844018 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e355d5-cb44-4673-b675-0002bf8f68c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43561432a5924ad8b655fb6dae333800)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:30.846851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e355d5-cb44-4673-b675-0002bf8f68c1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:31.198820 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-48e355d5-cb44-4673-b675-0002bf8f68c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43561432a5924ad8b655fb6dae333800'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:31.198820 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-48e355d5-cb44-4673-b675-0002bf8f68c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43561432a5924ad8b655fb6dae333800'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:31.239651 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-48e355d5-cb44-4673-b675-0002bf8f68c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43561432a5924ad8b655fb6dae333800'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:31.253178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-48e355d5-cb44-4673-b675-0002bf8f68c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43561432a5924ad8b655fb6dae333800'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:31.374987 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-48e355d5-cb44-4673-b675-0002bf8f68c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43561432a5924ad8b655fb6dae333800'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:31.407764 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1200/2377] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:06:30 2022] DELETE /identity/v3/users/43561432a5924ad8b655fb6dae333800 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:31.412054 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485c09b-5f82-456a-94ff-8306b3689685 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:31.413018 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485c09b-5f82-456a-94ff-8306b3689685 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:31.413516 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485c09b-5f82-456a-94ff-8306b3689685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:31.468547 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3485c09b-5f82-456a-94ff-8306b3689685 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:31.480064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3485c09b-5f82-456a-94ff-8306b3689685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:31.542964 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:31.594009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1178/2378] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:31.617101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e355d5-cb44-4673-b675-0002bf8f68c1 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:31.619161 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-48e355d5-cb44-4673-b675-0002bf8f68c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:31.770262 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e355d5-cb44-4673-b675-0002bf8f68c1 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:31.774413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b89b94-ab8b-4979-a3db-01b72f49fcdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:31.775722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b89b94-ab8b-4979-a3db-01b72f49fcdc service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:31.776253 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b89b94-ab8b-4979-a3db-01b72f49fcdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:31.776900 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b89b94-ab8b-4979-a3db-01b72f49fcdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:31.797922 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b89b94-ab8b-4979-a3db-01b72f49fcdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:31.800583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b89b94-ab8b-4979-a3db-01b72f49fcdc service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:31.815329 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1201/2379] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:06:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:06:32.498459 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:32.804700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485c09b-5f82-456a-94ff-8306b3689685 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:32.804700 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3485c09b-5f82-456a-94ff-8306b3689685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:32.820505 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485c09b-5f82-456a-94ff-8306b3689685 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:32.835539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565d91d-a5d0-4fb9-a64f-1ce4d321d41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:32.838848 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565d91d-a5d0-4fb9-a64f-1ce4d321d41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:32.838848 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565d91d-a5d0-4fb9-a64f-1ce4d321d41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:32.838848 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565d91d-a5d0-4fb9-a64f-1ce4d321d41e admin admin] PATH_INFO: `/v3/projects/fb0f2e5f9d1747b1ac6f698f730a7e32` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:32.847572 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565d91d-a5d0-4fb9-a64f-1ce4d321d41e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb0f2e5f9d1747b1ac6f698f730a7e32)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:32.849879 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565d91d-a5d0-4fb9-a64f-1ce4d321d41e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:33.095180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c565d91d-a5d0-4fb9-a64f-1ce4d321d41e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb0f2e5f9d1747b1ac6f698f730a7e32', 'request_id': 'req-c565d91d-a5d0-4fb9-a64f-1ce4d321d41e'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:33.105309 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c565d91d-a5d0-4fb9-a64f-1ce4d321d41e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb0f2e5f9d1747b1ac6f698f730a7e32', 'request_id': 'req-c565d91d-a5d0-4fb9-a64f-1ce4d321d41e'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:33.126395 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c565d91d-a5d0-4fb9-a64f-1ce4d321d41e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb0f2e5f9d1747b1ac6f698f730a7e32', 'request_id': 'req-c565d91d-a5d0-4fb9-a64f-1ce4d321d41e'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:33.347913 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c565d91d-a5d0-4fb9-a64f-1ce4d321d41e admin admin] The token cache is being invalidate because project fb0f2e5f9d1747b1ac6f698f730a7e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:06:33.347913 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c565d91d-a5d0-4fb9-a64f-1ce4d321d41e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:33.348275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c565d91d-a5d0-4fb9-a64f-1ce4d321d41e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:33.356858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1179/2380] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:06:32 2022] DELETE /identity/v3/projects/fb0f2e5f9d1747b1ac6f698f730a7e32 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:33.362687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62711d22-7a3f-4558-8d1d-5012a6866e79 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:33.363249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62711d22-7a3f-4558-8d1d-5012a6866e79 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:33.363390 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62711d22-7a3f-4558-8d1d-5012a6866e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:33.398454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-62711d22-7a3f-4558-8d1d-5012a6866e79 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:33.400325 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-62711d22-7a3f-4558-8d1d-5012a6866e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:33.536797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1202/2381] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:33.537963 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1062b21-f902-4cb2-ac5a-7192e46f283a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:33.538853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1062b21-f902-4cb2-ac5a-7192e46f283a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:33.542207 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1062b21-f902-4cb2-ac5a-7192e46f283a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:33.568388 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a1062b21-f902-4cb2-ac5a-7192e46f283a None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:33.573132 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a1062b21-f902-4cb2-ac5a-7192e46f283a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:33.583079 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1180/2382] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:33.588132 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62711d22-7a3f-4558-8d1d-5012a6866e79 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:33.613981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62711d22-7a3f-4558-8d1d-5012a6866e79 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:33.639539 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251419f6-6b9e-4f81-a78a-9b1cf2c6f189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:33.640341 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251419f6-6b9e-4f81-a78a-9b1cf2c6f189 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:33.640629 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251419f6-6b9e-4f81-a78a-9b1cf2c6f189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:33.640996 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251419f6-6b9e-4f81-a78a-9b1cf2c6f189 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:33.641648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251419f6-6b9e-4f81-a78a-9b1cf2c6f189 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:06:33.641962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251419f6-6b9e-4f81-a78a-9b1cf2c6f189 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:33.647931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251419f6-6b9e-4f81-a78a-9b1cf2c6f189 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:33.667076 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1203/2383] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 11:06:33.671552 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1062b21-f902-4cb2-ac5a-7192e46f283a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:33.695752 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1062b21-f902-4cb2-ac5a-7192e46f283a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:33.716972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14784a06-9cce-4468-8784-6ea70c68e994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:33.717904 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14784a06-9cce-4468-8784-6ea70c68e994 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:33.718187 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14784a06-9cce-4468-8784-6ea70c68e994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:33.718459 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14784a06-9cce-4468-8784-6ea70c68e994 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:33.719166 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14784a06-9cce-4468-8784-6ea70c68e994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:33.721088 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14784a06-9cce-4468-8784-6ea70c68e994 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:33.835892 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1181/2384] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:06:33 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:06:33.840113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251419f6-6b9e-4f81-a78a-9b1cf2c6f189 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:33.853924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251419f6-6b9e-4f81-a78a-9b1cf2c6f189 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:33.873969 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:34.063820 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39296606-89fb-47df-9a76-8204911bdeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:34.074416 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39296606-89fb-47df-9a76-8204911bdeb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:34.074416 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39296606-89fb-47df-9a76-8204911bdeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:34.074416 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39296606-89fb-47df-9a76-8204911bdeb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:34.074416 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39296606-89fb-47df-9a76-8204911bdeb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:34.074416 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39296606-89fb-47df-9a76-8204911bdeb4 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:34.271455 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1204/2385] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:06:33 2022] POST /identity/v3/users => generated 286 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:06:34.271781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14784a06-9cce-4468-8784-6ea70c68e994 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:34.279740 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14784a06-9cce-4468-8784-6ea70c68e994 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:34.284472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4e98d-c195-4c93-86b6-dd3fb5ec306f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:34.285101 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4e98d-c195-4c93-86b6-dd3fb5ec306f admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:34.285385 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4e98d-c195-4c93-86b6-dd3fb5ec306f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:34.285668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4e98d-c195-4c93-86b6-dd3fb5ec306f admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:34.286313 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4e98d-c195-4c93-86b6-dd3fb5ec306f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:34.287950 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4e98d-c195-4c93-86b6-dd3fb5ec306f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:34.299388 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1182/2386] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:06:34.305575 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:34.308377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39296606-89fb-47df-9a76-8204911bdeb4 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:34.318411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39296606-89fb-47df-9a76-8204911bdeb4 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:34.323055 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37424918-af3e-4c8d-a993-7641677baf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:34.323709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37424918-af3e-4c8d-a993-7641677baf45 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:34.323944 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37424918-af3e-4c8d-a993-7641677baf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:34.324217 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37424918-af3e-4c8d-a993-7641677baf45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:34.324866 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37424918-af3e-4c8d-a993-7641677baf45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:34.326453 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37424918-af3e-4c8d-a993-7641677baf45 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:34.338789 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1205/2387] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:06:34.342585 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4e98d-c195-4c93-86b6-dd3fb5ec306f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:34.354545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4e98d-c195-4c93-86b6-dd3fb5ec306f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:34.359885 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b91c46-c242-45f3-98b2-fbb0bafb57b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:34.360896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b91c46-c242-45f3-98b2-fbb0bafb57b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:34.361252 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b91c46-c242-45f3-98b2-fbb0bafb57b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:34.361825 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b91c46-c242-45f3-98b2-fbb0bafb57b3 admin admin] PATH_INFO: `/v3/projects/59e7029f5e6f4a8da8529be0057f7421/users/cac245f9fc0e4ee5b2f91e68d15e3779/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:34.406656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b91c46-c242-45f3-98b2-fbb0bafb57b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59e7029f5e6f4a8da8529be0057f7421, user_id=cac245f9fc0e4ee5b2f91e68d15e3779, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:34.409513 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b91c46-c242-45f3-98b2-fbb0bafb57b3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:34.511733 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1183/2388] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:06:34 2022] PUT /identity/v3/projects/59e7029f5e6f4a8da8529be0057f7421/users/cac245f9fc0e4ee5b2f91e68d15e3779/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:34.521895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8ee36-d5b2-4e46-82f7-bc75077b250c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:34.523029 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8ee36-d5b2-4e46-82f7-bc75077b250c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:34.523495 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8ee36-d5b2-4e46-82f7-bc75077b250c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:34.594245 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-b6b8ee36-d5b2-4e46-82f7-bc75077b250c None None] MFA Rules not processed for user `cac245f9fc0e4ee5b2f91e68d15e3779`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:34.595849 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b6b8ee36-d5b2-4e46-82f7-bc75077b250c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:34.705015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1206/2389] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:06:34.711576 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b91c46-c242-45f3-98b2-fbb0bafb57b3 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:34.714839 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c9b91c46-c242-45f3-98b2-fbb0bafb57b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:34.807859 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b91c46-c242-45f3-98b2-fbb0bafb57b3 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:34.812338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23aa32-20d2-4114-b2a5-b980f5a204b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:34.813235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23aa32-20d2-4114-b2a5-b980f5a204b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:34.813706 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23aa32-20d2-4114-b2a5-b980f5a204b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:34.814162 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23aa32-20d2-4114-b2a5-b980f5a204b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:34.825419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23aa32-20d2-4114-b2a5-b980f5a204b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:34.827409 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23aa32-20d2-4114-b2a5-b980f5a204b6 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:34.850174 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1184/2390] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:06:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:06:34.865928 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8ee36-d5b2-4e46-82f7-bc75077b250c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:34.962012 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8ee36-d5b2-4e46-82f7-bc75077b250c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:34.966963 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdb4eb-a06a-4362-a55a-0e30f3923382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:34.967942 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdb4eb-a06a-4362-a55a-0e30f3923382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:34.968515 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdb4eb-a06a-4362-a55a-0e30f3923382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:34.968989 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fdb4eb-a06a-4362-a55a-0e30f3923382 admin admin] PATH_INFO: `/v3/users/cac245f9fc0e4ee5b2f91e68d15e3779` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:34.970427 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fdb4eb-a06a-4362-a55a-0e30f3923382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cac245f9fc0e4ee5b2f91e68d15e3779)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:34.972758 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fdb4eb-a06a-4362-a55a-0e30f3923382 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:35.029079 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:35.211131 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d3fdb4eb-a06a-4362-a55a-0e30f3923382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cac245f9fc0e4ee5b2f91e68d15e3779'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:35.211991 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d3fdb4eb-a06a-4362-a55a-0e30f3923382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cac245f9fc0e4ee5b2f91e68d15e3779'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:35.236786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d3fdb4eb-a06a-4362-a55a-0e30f3923382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cac245f9fc0e4ee5b2f91e68d15e3779'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:35.254659 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d3fdb4eb-a06a-4362-a55a-0e30f3923382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cac245f9fc0e4ee5b2f91e68d15e3779'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:35.387663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d3fdb4eb-a06a-4362-a55a-0e30f3923382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cac245f9fc0e4ee5b2f91e68d15e3779'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:35.400656 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1207/2391] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:06:34 2022] DELETE /identity/v3/users/cac245f9fc0e4ee5b2f91e68d15e3779 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:35.405358 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748891e-dd2a-4204-8102-ab7783688ec4 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:35.405591 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748891e-dd2a-4204-8102-ab7783688ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:35.406063 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748891e-dd2a-4204-8102-ab7783688ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:35.431992 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d748891e-dd2a-4204-8102-ab7783688ec4 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:35.433780 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d748891e-dd2a-4204-8102-ab7783688ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:35.541846 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1185/2392] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:35.550191 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdb4eb-a06a-4362-a55a-0e30f3923382 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:35.552340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d3fdb4eb-a06a-4362-a55a-0e30f3923382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:35.604024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:35.694220 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fdb4eb-a06a-4362-a55a-0e30f3923382 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:35.704566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc382ae-ba65-4f56-be62-1b6880d3b771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:35.705421 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc382ae-ba65-4f56-be62-1b6880d3b771 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:35.705900 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc382ae-ba65-4f56-be62-1b6880d3b771 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:35.706175 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc382ae-ba65-4f56-be62-1b6880d3b771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:35.720669 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc382ae-ba65-4f56-be62-1b6880d3b771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:35.723933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc382ae-ba65-4f56-be62-1b6880d3b771 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:35.736893 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1208/2393] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:06:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:06:35.883397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:36.294882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:36.515723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748891e-dd2a-4204-8102-ab7783688ec4 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:36.517491 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d748891e-dd2a-4204-8102-ab7783688ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:36.537080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748891e-dd2a-4204-8102-ab7783688ec4 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:36.554122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866b5eb-5540-4abf-a723-dbd009acfc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:36.555213 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866b5eb-5540-4abf-a723-dbd009acfc1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:36.557417 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866b5eb-5540-4abf-a723-dbd009acfc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:36.557829 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866b5eb-5540-4abf-a723-dbd009acfc1f admin admin] PATH_INFO: `/v3/projects/59e7029f5e6f4a8da8529be0057f7421` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:36.561107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866b5eb-5540-4abf-a723-dbd009acfc1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=59e7029f5e6f4a8da8529be0057f7421)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:36.565998 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866b5eb-5540-4abf-a723-dbd009acfc1f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:36.783026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2866b5eb-5540-4abf-a723-dbd009acfc1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59e7029f5e6f4a8da8529be0057f7421', 'request_id': 'req-2866b5eb-5540-4abf-a723-dbd009acfc1f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:36.794544 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2866b5eb-5540-4abf-a723-dbd009acfc1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59e7029f5e6f4a8da8529be0057f7421', 'request_id': 'req-2866b5eb-5540-4abf-a723-dbd009acfc1f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:36.804939 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2866b5eb-5540-4abf-a723-dbd009acfc1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59e7029f5e6f4a8da8529be0057f7421', 'request_id': 'req-2866b5eb-5540-4abf-a723-dbd009acfc1f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:36.898679 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2866b5eb-5540-4abf-a723-dbd009acfc1f admin admin] The token cache is being invalidate because project 59e7029f5e6f4a8da8529be0057f7421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:06:36.899430 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2866b5eb-5540-4abf-a723-dbd009acfc1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:36.901673 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2866b5eb-5540-4abf-a723-dbd009acfc1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:36.905816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1186/2394] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:06:36 2022] DELETE /identity/v3/projects/59e7029f5e6f4a8da8529be0057f7421 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:37.016045 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:37.340482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:38.694618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:39.969941 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:40.033917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:41.122118 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc382ae-ba65-4f56-be62-1b6880d3b771 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:41.123632 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-dbc382ae-ba65-4f56-be62-1b6880d3b771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:41.231901 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc382ae-ba65-4f56-be62-1b6880d3b771 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:41.317184 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fe8c3-e3e8-4781-9492-cf7ca79dd0ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:41.317816 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fe8c3-e3e8-4781-9492-cf7ca79dd0ca service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:41.318096 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fe8c3-e3e8-4781-9492-cf7ca79dd0ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:41.318369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fe8c3-e3e8-4781-9492-cf7ca79dd0ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:41.320343 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f73fe8c3-e3e8-4781-9492-cf7ca79dd0ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:41.424461 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fe8c3-e3e8-4781-9492-cf7ca79dd0ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:41.425383 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fe8c3-e3e8-4781-9492-cf7ca79dd0ca service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:41.426467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:41.437914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1209/2395] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:06:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:06:41.626874 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:42.619263 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866b5eb-5540-4abf-a723-dbd009acfc1f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:42.621238 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2866b5eb-5540-4abf-a723-dbd009acfc1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:42.698985 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866b5eb-5540-4abf-a723-dbd009acfc1f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:42.703753 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db5192-c913-4c60-bad0-745d1dd84ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:42.704459 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db5192-c913-4c60-bad0-745d1dd84ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:42.704742 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db5192-c913-4c60-bad0-745d1dd84ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:42.705011 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db5192-c913-4c60-bad0-745d1dd84ede admin admin] PATH_INFO: `/v3/users/351c1b68fd534adf9b1f0122aee1c825` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:42.706467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db5192-c913-4c60-bad0-745d1dd84ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=351c1b68fd534adf9b1f0122aee1c825)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:42.708916 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db5192-c913-4c60-bad0-745d1dd84ede admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:42.712995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:42.905975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:42.986054 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-52db5192-c913-4c60-bad0-745d1dd84ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '351c1b68fd534adf9b1f0122aee1c825'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:43.005433 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-52db5192-c913-4c60-bad0-745d1dd84ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '351c1b68fd534adf9b1f0122aee1c825'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:43.006177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-52db5192-c913-4c60-bad0-745d1dd84ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '351c1b68fd534adf9b1f0122aee1c825'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:43.169230 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-52db5192-c913-4c60-bad0-745d1dd84ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '351c1b68fd534adf9b1f0122aee1c825'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:43.177839 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-52db5192-c913-4c60-bad0-745d1dd84ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '351c1b68fd534adf9b1f0122aee1c825'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:43.188057 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1187/2396] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:06:42 2022] DELETE /identity/v3/users/351c1b68fd534adf9b1f0122aee1c825 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:43.192895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef5bfa-3fbe-4981-a3d4-a904d08ef6a9 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:43.193631 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef5bfa-3fbe-4981-a3d4-a904d08ef6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:43.194240 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef5bfa-3fbe-4981-a3d4-a904d08ef6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:43.218878 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-52ef5bfa-3fbe-4981-a3d4-a904d08ef6a9 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:43.220357 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-52ef5bfa-3fbe-4981-a3d4-a904d08ef6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:43.295820 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1210/2397] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:43.306554 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db5192-c913-4c60-bad0-745d1dd84ede admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:43.308446 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-52db5192-c913-4c60-bad0-745d1dd84ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:43.417853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db5192-c913-4c60-bad0-745d1dd84ede admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:43.424778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae2112-a9d4-4691-ade3-50502a884c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:43.425591 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae2112-a9d4-4691-ade3-50502a884c52 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:43.426019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae2112-a9d4-4691-ade3-50502a884c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:43.426411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae2112-a9d4-4691-ade3-50502a884c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:43.447353 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae2112-a9d4-4691-ade3-50502a884c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:43.463364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae2112-a9d4-4691-ade3-50502a884c52 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:43.488926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1188/2398] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:06:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:06:44.107820 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef5bfa-3fbe-4981-a3d4-a904d08ef6a9 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:44.109691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-52ef5bfa-3fbe-4981-a3d4-a904d08ef6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:44.141200 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef5bfa-3fbe-4981-a3d4-a904d08ef6a9 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:44.149951 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eae31e-7e8c-4c62-abed-a44913967270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:44.151000 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eae31e-7e8c-4c62-abed-a44913967270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:44.151527 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eae31e-7e8c-4c62-abed-a44913967270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:44.153782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eae31e-7e8c-4c62-abed-a44913967270 admin admin] PATH_INFO: `/v3/projects/e9a981ea207d4a6896cf47db3809d50d` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:44.153782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eae31e-7e8c-4c62-abed-a44913967270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a981ea207d4a6896cf47db3809d50d)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:44.156063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eae31e-7e8c-4c62-abed-a44913967270 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:44.307649 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d3eae31e-7e8c-4c62-abed-a44913967270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a981ea207d4a6896cf47db3809d50d', 'request_id': 'req-d3eae31e-7e8c-4c62-abed-a44913967270'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:44.317880 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d3eae31e-7e8c-4c62-abed-a44913967270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a981ea207d4a6896cf47db3809d50d', 'request_id': 'req-d3eae31e-7e8c-4c62-abed-a44913967270'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:44.416932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d3eae31e-7e8c-4c62-abed-a44913967270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a981ea207d4a6896cf47db3809d50d', 'request_id': 'req-d3eae31e-7e8c-4c62-abed-a44913967270'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:44.430162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d3eae31e-7e8c-4c62-abed-a44913967270 admin admin] The token cache is being invalidate because project e9a981ea207d4a6896cf47db3809d50d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:06:44.430483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d3eae31e-7e8c-4c62-abed-a44913967270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:44.433660 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d3eae31e-7e8c-4c62-abed-a44913967270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:44.435343 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1211/2399] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:06:44 2022] DELETE /identity/v3/projects/e9a981ea207d4a6896cf47db3809d50d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:44.440432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eef22d-5307-4c14-829c-9fd649c92d9e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:44.440930 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eef22d-5307-4c14-829c-9fd649c92d9e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:44.441035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eef22d-5307-4c14-829c-9fd649c92d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:44.489287 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c0eef22d-5307-4c14-829c-9fd649c92d9e None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:44.491257 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c0eef22d-5307-4c14-829c-9fd649c92d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:44.499213 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:44.586198 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1189/2400] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:44.587769 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b9987-fedf-4c74-aecc-acc4b662975c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:44.588065 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b9987-fedf-4c74-aecc-acc4b662975c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:44.588348 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b9987-fedf-4c74-aecc-acc4b662975c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:44.616254 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3d5b9987-fedf-4c74-aecc-acc4b662975c None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:44.617507 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3d5b9987-fedf-4c74-aecc-acc4b662975c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:44.630125 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1212/2401] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:06:44.631301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eef22d-5307-4c14-829c-9fd649c92d9e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:44.642606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eef22d-5307-4c14-829c-9fd649c92d9e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:44.649092 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff1af7-5fcd-4f2f-a1fc-4fd23a6b7139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:44.650284 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff1af7-5fcd-4f2f-a1fc-4fd23a6b7139 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:44.650638 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff1af7-5fcd-4f2f-a1fc-4fd23a6b7139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:44.651038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff1af7-5fcd-4f2f-a1fc-4fd23a6b7139 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:44.651758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff1af7-5fcd-4f2f-a1fc-4fd23a6b7139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:06:44.652136 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff1af7-5fcd-4f2f-a1fc-4fd23a6b7139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:44.653892 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff1af7-5fcd-4f2f-a1fc-4fd23a6b7139 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:44.669318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1190/2402] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:06:44.682329 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b9987-fedf-4c74-aecc-acc4b662975c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:44.700562 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b9987-fedf-4c74-aecc-acc4b662975c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:44.719690 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f87d36-dc9c-4574-b6c7-8cea18b8111e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:44.720429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f87d36-dc9c-4574-b6c7-8cea18b8111e admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:44.720774 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f87d36-dc9c-4574-b6c7-8cea18b8111e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:44.721114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f87d36-dc9c-4574-b6c7-8cea18b8111e admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:44.721820 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f87d36-dc9c-4574-b6c7-8cea18b8111e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:44.723900 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f87d36-dc9c-4574-b6c7-8cea18b8111e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:44.731469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:44.845240 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1213/2403] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:06:44 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:06:44.846160 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff1af7-5fcd-4f2f-a1fc-4fd23a6b7139 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:44.863766 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff1af7-5fcd-4f2f-a1fc-4fd23a6b7139 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:44.971114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fa3b7-a308-426d-8825-5966e9981f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:44.971990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fa3b7-a308-426d-8825-5966e9981f1d admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:44.972446 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fa3b7-a308-426d-8825-5966e9981f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:44.972872 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fa3b7-a308-426d-8825-5966e9981f1d admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:44.973662 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fa3b7-a308-426d-8825-5966e9981f1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:44.976345 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fa3b7-a308-426d-8825-5966e9981f1d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:45.090411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1191/2404] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:06:44 2022] POST /identity/v3/users => generated 288 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:06:45.094356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f87d36-dc9c-4574-b6c7-8cea18b8111e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:45.114933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f87d36-dc9c-4574-b6c7-8cea18b8111e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:45.119367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5e858-8e73-44ee-9c57-7fcd7e2b5d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:45.120488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5e858-8e73-44ee-9c57-7fcd7e2b5d38 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:45.120776 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5e858-8e73-44ee-9c57-7fcd7e2b5d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:45.121051 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5e858-8e73-44ee-9c57-7fcd7e2b5d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:45.122008 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5e858-8e73-44ee-9c57-7fcd7e2b5d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:45.124128 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5e858-8e73-44ee-9c57-7fcd7e2b5d38 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:45.142690 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1214/2405] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:06:45.147027 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fa3b7-a308-426d-8825-5966e9981f1d admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:45.161387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fa3b7-a308-426d-8825-5966e9981f1d admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:45.191888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072826c-3112-450e-a3c3-b39d2ed90b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:45.192874 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072826c-3112-450e-a3c3-b39d2ed90b1c admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:45.193349 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072826c-3112-450e-a3c3-b39d2ed90b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:45.193632 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072826c-3112-450e-a3c3-b39d2ed90b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:45.194326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072826c-3112-450e-a3c3-b39d2ed90b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:45.202433 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072826c-3112-450e-a3c3-b39d2ed90b1c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:45.235275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1192/2406] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:06:45.244265 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5e858-8e73-44ee-9c57-7fcd7e2b5d38 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:45.257757 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5e858-8e73-44ee-9c57-7fcd7e2b5d38 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:45.267670 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4187f-85a7-4a2e-9c98-b75a7cc71bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:45.268397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4187f-85a7-4a2e-9c98-b75a7cc71bff admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:45.268872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4187f-85a7-4a2e-9c98-b75a7cc71bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:45.270590 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4187f-85a7-4a2e-9c98-b75a7cc71bff admin admin] PATH_INFO: `/v3/projects/b019c32b9a8f4f8bb3ec621260ed6e98/users/e20113c737c74d309c4628be79a53c0d/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:45.349035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4187f-85a7-4a2e-9c98-b75a7cc71bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b019c32b9a8f4f8bb3ec621260ed6e98, user_id=e20113c737c74d309c4628be79a53c0d, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:45.355432 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4187f-85a7-4a2e-9c98-b75a7cc71bff admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:45.496977 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1215/2407] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:06:45 2022] PUT /identity/v3/projects/b019c32b9a8f4f8bb3ec621260ed6e98/users/e20113c737c74d309c4628be79a53c0d/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:45.507568 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c916b-7215-464c-afaa-2d9b4f98427b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:45.508171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c916b-7215-464c-afaa-2d9b4f98427b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:45.508171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c916b-7215-464c-afaa-2d9b4f98427b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:45.537060 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e06c916b-7215-464c-afaa-2d9b4f98427b None None] MFA Rules not processed for user `e20113c737c74d309c4628be79a53c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:45.538466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e06c916b-7215-464c-afaa-2d9b4f98427b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:45.624571 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1193/2408] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:45.631993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4187f-85a7-4a2e-9c98-b75a7cc71bff admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:45.633923 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-77e4187f-85a7-4a2e-9c98-b75a7cc71bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:45.707347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4187f-85a7-4a2e-9c98-b75a7cc71bff admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:45.714105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7d811-de29-4c1f-9cc5-633a92ced440 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:45.733335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7d811-de29-4c1f-9cc5-633a92ced440 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:45.733335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7d811-de29-4c1f-9cc5-633a92ced440 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:45.733335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7d811-de29-4c1f-9cc5-633a92ced440 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:45.733335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7d811-de29-4c1f-9cc5-633a92ced440 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:45.733335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7d811-de29-4c1f-9cc5-633a92ced440 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:45.740998 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1216/2409] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:06:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:06:48.825421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c1f73-f846-404f-97f4-6050fd7ed967 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:48.826094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c1f73-f846-404f-97f4-6050fd7ed967 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:48.826094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c1f73-f846-404f-97f4-6050fd7ed967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:48.866033 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:48.872808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a92c1f73-f846-404f-97f4-6050fd7ed967 None None] MFA Rules not processed for user `e20113c737c74d309c4628be79a53c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:48.874073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a92c1f73-f846-404f-97f4-6050fd7ed967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:48.881498 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1194/2410] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:06:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:49.997681 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de35655-ddad-4b36-866f-e7df3656d8b9 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:49.998207 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de35655-ddad-4b36-866f-e7df3656d8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:49.998417 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de35655-ddad-4b36-866f-e7df3656d8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:50.020429 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3de35655-ddad-4b36-866f-e7df3656d8b9 None None] MFA Rules not processed for user `9751264123914c27b961009f75067660`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:50.021829 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3de35655-ddad-4b36-866f-e7df3656d8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:50.101606 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1217/2411] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Aug 11 11:06:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:06:50.114936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c1f73-f846-404f-97f4-6050fd7ed967 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:50.116511 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a92c1f73-f846-404f-97f4-6050fd7ed967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:50.190995 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c1f73-f846-404f-97f4-6050fd7ed967 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:50.196750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975897e-b2f7-453a-9c69-e4a68bd51034 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd25d1bde0c4703b61e0edaf5b658d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:50.197400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975897e-b2f7-453a-9c69-e4a68bd51034 service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:50.197681 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975897e-b2f7-453a-9c69-e4a68bd51034 service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:50.197955 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975897e-b2f7-453a-9c69-e4a68bd51034 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:50.206816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975897e-b2f7-453a-9c69-e4a68bd51034 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:50.208385 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975897e-b2f7-453a-9c69-e4a68bd51034 service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:50.217905 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1195/2412] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Aug 11 11:06:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 11:06:52.171507 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed15427-ca92-48b7-965e-03e84f28284f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:52.172806 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed15427-ca92-48b7-965e-03e84f28284f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:52.173275 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed15427-ca92-48b7-965e-03e84f28284f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:52.224102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-eed15427-ca92-48b7-965e-03e84f28284f None None] MFA Rules not processed for user `9751264123914c27b961009f75067660`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:06:52.228879 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-eed15427-ca92-48b7-965e-03e84f28284f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:52.274988 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1218/2413] 10.222.0.43 () {58 vars in 967 bytes} [Thu Aug 11 11:06:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:06:52.284124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975897e-b2f7-453a-9c69-e4a68bd51034 service swift] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:52.301276 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975897e-b2f7-453a-9c69-e4a68bd51034 service swift] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:52.311053 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f677b95-9309-4b4a-bb4f-358986018531 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd25d1bde0c4703b61e0edaf5b658d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:52.322472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f677b95-9309-4b4a-bb4f-358986018531 service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:52.322472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f677b95-9309-4b4a-bb4f-358986018531 service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:52.322472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f677b95-9309-4b4a-bb4f-358986018531 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:52.367688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f677b95-9309-4b4a-bb4f-358986018531 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:52.373591 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f677b95-9309-4b4a-bb4f-358986018531 service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:52.397433 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1196/2414] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Aug 11 11:06:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 11:06:58.404919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed15427-ca92-48b7-965e-03e84f28284f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:58.409622 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-eed15427-ca92-48b7-965e-03e84f28284f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:06:58.493279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:58.511421 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed15427-ca92-48b7-965e-03e84f28284f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:58.517683 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae989467-f7f9-4f63-9dff-dc41d88a763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:58.518569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae989467-f7f9-4f63-9dff-dc41d88a763d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:58.519070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae989467-f7f9-4f63-9dff-dc41d88a763d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:58.519528 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae989467-f7f9-4f63-9dff-dc41d88a763d admin admin] PATH_INFO: `/v3/users/3e64b86aefeb4a7fb0710b69e7cd1063` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:58.521058 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae989467-f7f9-4f63-9dff-dc41d88a763d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e64b86aefeb4a7fb0710b69e7cd1063)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:58.523253 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae989467-f7f9-4f63-9dff-dc41d88a763d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:58.765820 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ae989467-f7f9-4f63-9dff-dc41d88a763d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e64b86aefeb4a7fb0710b69e7cd1063'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:58.766676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ae989467-f7f9-4f63-9dff-dc41d88a763d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e64b86aefeb4a7fb0710b69e7cd1063'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:58.796699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ae989467-f7f9-4f63-9dff-dc41d88a763d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e64b86aefeb4a7fb0710b69e7cd1063'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:58.817290 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ae989467-f7f9-4f63-9dff-dc41d88a763d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e64b86aefeb4a7fb0710b69e7cd1063'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:58.962776 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ae989467-f7f9-4f63-9dff-dc41d88a763d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e64b86aefeb4a7fb0710b69e7cd1063'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:58.993089 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1219/2415] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:06:58 2022] DELETE /identity/v3/users/3e64b86aefeb4a7fb0710b69e7cd1063 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:06:59.517562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f677b95-9309-4b4a-bb4f-358986018531 service swift] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:06:59.549968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f677b95-9309-4b4a-bb4f-358986018531 service swift] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:06:59.695010 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3495fe1-df37-4b9e-9336-2cb3b8a24ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:06:59.696856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3495fe1-df37-4b9e-9336-2cb3b8a24ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:06:59.697461 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3495fe1-df37-4b9e-9336-2cb3b8a24ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:06:59.697906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3495fe1-df37-4b9e-9336-2cb3b8a24ac3 admin admin] PATH_INFO: `/v3/projects/14129c5163af45a09849c34d6ce991c4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:06:59.701495 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3495fe1-df37-4b9e-9336-2cb3b8a24ac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14129c5163af45a09849c34d6ce991c4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:06:59.703723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3495fe1-df37-4b9e-9336-2cb3b8a24ac3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:06:59.854601 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f3495fe1-df37-4b9e-9336-2cb3b8a24ac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14129c5163af45a09849c34d6ce991c4', 'request_id': 'req-f3495fe1-df37-4b9e-9336-2cb3b8a24ac3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:59.864595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f3495fe1-df37-4b9e-9336-2cb3b8a24ac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14129c5163af45a09849c34d6ce991c4', 'request_id': 'req-f3495fe1-df37-4b9e-9336-2cb3b8a24ac3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:59.873817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f3495fe1-df37-4b9e-9336-2cb3b8a24ac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14129c5163af45a09849c34d6ce991c4', 'request_id': 'req-f3495fe1-df37-4b9e-9336-2cb3b8a24ac3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:59.996832 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f3495fe1-df37-4b9e-9336-2cb3b8a24ac3 admin admin] The token cache is being invalidate because project 14129c5163af45a09849c34d6ce991c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:06:59.997127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f3495fe1-df37-4b9e-9336-2cb3b8a24ac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:06:59.997792 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f3495fe1-df37-4b9e-9336-2cb3b8a24ac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:00.002681 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1197/2416] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:06:59 2022] DELETE /identity/v3/projects/14129c5163af45a09849c34d6ce991c4 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:07:00.004680 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4636b-42d5-4279-abde-17647d205e98 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:00.005178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4636b-42d5-4279-abde-17647d205e98 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:00.005278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd4636b-42d5-4279-abde-17647d205e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:00.051057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-2dd4636b-42d5-4279-abde-17647d205e98 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:07:00.052851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2dd4636b-42d5-4279-abde-17647d205e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:00.141835 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1220/2417] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:07:00.143301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba3de-dae7-4cf7-9129-a4eb0e54a3bb None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:00.143596 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba3de-dae7-4cf7-9129-a4eb0e54a3bb None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:00.143881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba3de-dae7-4cf7-9129-a4eb0e54a3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:00.156825 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:00.204370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-76cba3de-dae7-4cf7-9129-a4eb0e54a3bb None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:07:00.208962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-76cba3de-dae7-4cf7-9129-a4eb0e54a3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:00.231218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1198/2418] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:07:00.235766 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4636b-42d5-4279-abde-17647d205e98 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:00.249832 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd4636b-42d5-4279-abde-17647d205e98 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:00.263409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34852552-b31b-44c7-84a9-3f8ee6da9e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:00.263409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34852552-b31b-44c7-84a9-3f8ee6da9e5b admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:00.263409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34852552-b31b-44c7-84a9-3f8ee6da9e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:00.263409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34852552-b31b-44c7-84a9-3f8ee6da9e5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:00.263703 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34852552-b31b-44c7-84a9-3f8ee6da9e5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:07:00.264242 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34852552-b31b-44c7-84a9-3f8ee6da9e5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:00.267423 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34852552-b31b-44c7-84a9-3f8ee6da9e5b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:00.332577 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1221/2419] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:07:00.333518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cba3de-dae7-4cf7-9129-a4eb0e54a3bb None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:00.344823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cba3de-dae7-4cf7-9129-a4eb0e54a3bb None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:00.350501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bd976-8654-411e-b018-32e039567401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:00.351998 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bd976-8654-411e-b018-32e039567401 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:00.352438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bd976-8654-411e-b018-32e039567401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:00.353011 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bd976-8654-411e-b018-32e039567401 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:00.353797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bd976-8654-411e-b018-32e039567401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:00.356023 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bd976-8654-411e-b018-32e039567401 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:00.462516 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1199/2420] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:07:00 2022] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:07:00.467205 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34852552-b31b-44c7-84a9-3f8ee6da9e5b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:00.482920 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34852552-b31b-44c7-84a9-3f8ee6da9e5b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:00.572873 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:00.580850 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4feb958-fb0d-4b02-bd06-58fceb4601b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:00.581529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4feb958-fb0d-4b02-bd06-58fceb4601b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:00.582047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4feb958-fb0d-4b02-bd06-58fceb4601b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:00.582162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4feb958-fb0d-4b02-bd06-58fceb4601b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:00.582884 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4feb958-fb0d-4b02-bd06-58fceb4601b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:00.584984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4feb958-fb0d-4b02-bd06-58fceb4601b8 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:00.697512 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1222/2421] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:07:00 2022] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:07:00.701907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bd976-8654-411e-b018-32e039567401 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:00.717840 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bd976-8654-411e-b018-32e039567401 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:00.734666 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773844a-b87b-4fcc-88f7-82153c18382b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:00.735885 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773844a-b87b-4fcc-88f7-82153c18382b admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:00.736127 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773844a-b87b-4fcc-88f7-82153c18382b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:00.736408 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773844a-b87b-4fcc-88f7-82153c18382b admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:00.739491 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773844a-b87b-4fcc-88f7-82153c18382b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:00.741752 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773844a-b87b-4fcc-88f7-82153c18382b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:00.770410 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1200/2422] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:07:00.770588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4feb958-fb0d-4b02-bd06-58fceb4601b8 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:00.784452 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4feb958-fb0d-4b02-bd06-58fceb4601b8 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:00.808025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31f87c-a54a-4796-a908-4a43964faf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:00.820686 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31f87c-a54a-4796-a908-4a43964faf40 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:00.820686 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31f87c-a54a-4796-a908-4a43964faf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:00.820686 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31f87c-a54a-4796-a908-4a43964faf40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:00.820686 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31f87c-a54a-4796-a908-4a43964faf40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:00.820686 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31f87c-a54a-4796-a908-4a43964faf40 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:00.864706 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1223/2423] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:07:00.865889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773844a-b87b-4fcc-88f7-82153c18382b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:00.881942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773844a-b87b-4fcc-88f7-82153c18382b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:00.899693 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21744323-bf08-4c0a-be15-49ca6ca2d9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:00.902220 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21744323-bf08-4c0a-be15-49ca6ca2d9fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:00.902656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21744323-bf08-4c0a-be15-49ca6ca2d9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:00.904462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21744323-bf08-4c0a-be15-49ca6ca2d9fe admin admin] PATH_INFO: `/v3/projects/9206aabb32384f78aa9e9632e43bbf2f/users/c656365b03324a80bb6f7f955176ae9a/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:00.937466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21744323-bf08-4c0a-be15-49ca6ca2d9fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9206aabb32384f78aa9e9632e43bbf2f, user_id=c656365b03324a80bb6f7f955176ae9a, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:00.940428 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21744323-bf08-4c0a-be15-49ca6ca2d9fe admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:01.051311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1201/2424] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:07:00 2022] PUT /identity/v3/projects/9206aabb32384f78aa9e9632e43bbf2f/users/c656365b03324a80bb6f7f955176ae9a/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:07:01.052921 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fac1f-3e26-4f0e-b2b5-f1efe936e077 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:01.053365 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fac1f-3e26-4f0e-b2b5-f1efe936e077 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:01.053467 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fac1f-3e26-4f0e-b2b5-f1efe936e077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:01.081650 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-836fac1f-3e26-4f0e-b2b5-f1efe936e077 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:07:01.083080 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-836fac1f-3e26-4f0e-b2b5-f1efe936e077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:01.168669 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1224/2425] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:07:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:07:01.178970 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21744323-bf08-4c0a-be15-49ca6ca2d9fe admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:01.183966 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-21744323-bf08-4c0a-be15-49ca6ca2d9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:01.269304 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21744323-bf08-4c0a-be15-49ca6ca2d9fe admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:01.276837 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d512c3-ab2b-4391-ac60-2308269c6ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:01.277527 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d512c3-ab2b-4391-ac60-2308269c6ebf service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:01.277827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d512c3-ab2b-4391-ac60-2308269c6ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:01.278171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d512c3-ab2b-4391-ac60-2308269c6ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:01.295723 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d512c3-ab2b-4391-ac60-2308269c6ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:01.297199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d512c3-ab2b-4391-ac60-2308269c6ebf service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:01.316146 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1202/2426] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:07:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:07:03.258768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560be261-2d6f-4981-8cad-15ef5a618038 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:03.259382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560be261-2d6f-4981-8cad-15ef5a618038 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:03.260076 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560be261-2d6f-4981-8cad-15ef5a618038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:03.322842 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-560be261-2d6f-4981-8cad-15ef5a618038 None None] MFA Rules not processed for user `c656365b03324a80bb6f7f955176ae9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:07:03.324379 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-560be261-2d6f-4981-8cad-15ef5a618038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:03.525294 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1225/2427] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:07:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:07:03.547616 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d512c3-ab2b-4391-ac60-2308269c6ebf service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:03.549781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-15d512c3-ab2b-4391-ac60-2308269c6ebf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:03.638582 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d512c3-ab2b-4391-ac60-2308269c6ebf service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:03.642370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b44ad-e763-4642-835e-a4d1672c8b45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:03.643113 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b44ad-e763-4642-835e-a4d1672c8b45 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:03.643455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b44ad-e763-4642-835e-a4d1672c8b45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:03.643977 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b44ad-e763-4642-835e-a4d1672c8b45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:03.653759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b44ad-e763-4642-835e-a4d1672c8b45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:03.655586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b44ad-e763-4642-835e-a4d1672c8b45 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:03.666118 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1203/2428] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:07:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:07:05.590579 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcee74b-e2a6-404b-8b62-544980337cc5 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:05.591118 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcee74b-e2a6-404b-8b62-544980337cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:05.591455 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcee74b-e2a6-404b-8b62-544980337cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:05.613987 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5bcee74b-e2a6-404b-8b62-544980337cc5 None None] MFA Rules not processed for user `c656365b03324a80bb6f7f955176ae9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:07:05.615422 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5bcee74b-e2a6-404b-8b62-544980337cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:05.623651 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1226/2429] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:07:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:07:06.480189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95e0ec-78b0-4025-9e95-3e95a5f4aba9 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:06.486233 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95e0ec-78b0-4025-9e95-3e95a5f4aba9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:06.486233 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95e0ec-78b0-4025-9e95-3e95a5f4aba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:06.513101 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8b95e0ec-78b0-4025-9e95-3e95a5f4aba9 None None] MFA Rules not processed for user `ae05a859b3eb47e5ab60e39467b5ab06`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:07:06.514814 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8b95e0ec-78b0-4025-9e95-3e95a5f4aba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:06.561179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:06.579043 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1204/2430] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:07:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:07:08.451968 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcee74b-e2a6-404b-8b62-544980337cc5 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:08.453800 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5bcee74b-e2a6-404b-8b62-544980337cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:08.527096 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:08.533688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcee74b-e2a6-404b-8b62-544980337cc5 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:08.539147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43468f-ca57-407c-bc37-4fa103e39a29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db99589bb504e8fa4068925badf3942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:08.550380 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43468f-ca57-407c-bc37-4fa103e39a29 service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:08.550380 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43468f-ca57-407c-bc37-4fa103e39a29 service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:08.550380 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43468f-ca57-407c-bc37-4fa103e39a29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:08.550380 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ab43468f-ca57-407c-bc37-4fa103e39a29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:08.556310 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43468f-ca57-407c-bc37-4fa103e39a29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:08.558000 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43468f-ca57-407c-bc37-4fa103e39a29 service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:08.574136 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1227/2431] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:07:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:07:11.716565 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bb50b-164d-412c-bc00-c5b90a0a9b36 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:11.717061 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bb50b-164d-412c-bc00-c5b90a0a9b36 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:11.717061 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bb50b-164d-412c-bc00-c5b90a0a9b36 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:11.718928 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1205/2432] 10.222.0.43 () {54 vars in 921 bytes} [Thu Aug 11 11:07:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:07:11.726680 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471f66f-5a52-4488-bd0e-bca8bdb17ca2 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:11.727201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471f66f-5a52-4488-bd0e-bca8bdb17ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:11.727690 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471f66f-5a52-4488-bd0e-bca8bdb17ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:11.791363 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-b471f66f-5a52-4488-bd0e-bca8bdb17ca2 None None] MFA Rules not processed for user `9267752ac6724013bc1edcdecff48dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:07:11.792593 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b471f66f-5a52-4488-bd0e-bca8bdb17ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:11.873083 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1228/2433] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Aug 11 11:07:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:07:11.886868 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bb50b-164d-412c-bc00-c5b90a0a9b36 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:11.894888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-988bb50b-164d-412c-bc00-c5b90a0a9b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:11.962884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bb50b-164d-412c-bc00-c5b90a0a9b36 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:11.968231 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffa04a-6f62-4c76-9ecc-65e64a21d2e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fe013f66e2452eaaf84d4b52eca489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:11.968857 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffa04a-6f62-4c76-9ecc-65e64a21d2e5 service glance] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:11.969206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffa04a-6f62-4c76-9ecc-65e64a21d2e5 service glance] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:11.969774 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffa04a-6f62-4c76-9ecc-65e64a21d2e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:11.982248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffa04a-6f62-4c76-9ecc-65e64a21d2e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:11.983716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffa04a-6f62-4c76-9ecc-65e64a21d2e5 service glance] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:11.995671 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1206/2434] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:07:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:07:12.209759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbeb4a9-ba93-4025-b30e-073e56ed827e None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:12.210683 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbeb4a9-ba93-4025-b30e-073e56ed827e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:12.211051 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbeb4a9-ba93-4025-b30e-073e56ed827e None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:12.212620 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1229/2435] 10.222.0.43 () {54 vars in 921 bytes} [Thu Aug 11 11:07:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:07:12.217767 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108eced-84a5-4b57-9ebe-137a2450f007 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:12.218465 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108eced-84a5-4b57-9ebe-137a2450f007 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:12.218786 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108eced-84a5-4b57-9ebe-137a2450f007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:12.240021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1108eced-84a5-4b57-9ebe-137a2450f007 None None] MFA Rules not processed for user `6302b1f98544470a8986055a68bcd948`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:07:12.241667 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1108eced-84a5-4b57-9ebe-137a2450f007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:12.249441 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1207/2436] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Aug 11 11:07:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:07:12.262289 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbeb4a9-ba93-4025-b30e-073e56ed827e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:12.264178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6fbeb4a9-ba93-4025-b30e-073e56ed827e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:12.278930 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbeb4a9-ba93-4025-b30e-073e56ed827e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:12.282628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6931c-fdda-4bf6-a129-d56533f091d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:12.283257 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6931c-fdda-4bf6-a129-d56533f091d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:12.283540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6931c-fdda-4bf6-a129-d56533f091d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:12.283814 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6931c-fdda-4bf6-a129-d56533f091d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:12.291748 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6931c-fdda-4bf6-a129-d56533f091d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:12.293184 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6931c-fdda-4bf6-a129-d56533f091d5 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:12.300928 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1230/2437] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:07:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:07:12.389554 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10360505-56cb-4b03-9985-c73f7477966a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:12.389845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10360505-56cb-4b03-9985-c73f7477966a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:12.390119 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10360505-56cb-4b03-9985-c73f7477966a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:12.391546 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1208/2438] 10.222.0.43 () {54 vars in 921 bytes} [Thu Aug 11 11:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:07:12.396979 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fa3dc-b984-41b0-9706-8c4bae50b718 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:12.397230 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fa3dc-b984-41b0-9706-8c4bae50b718 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:12.398594 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fa3dc-b984-41b0-9706-8c4bae50b718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:12.423720 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-733fa3dc-b984-41b0-9706-8c4bae50b718 None None] MFA Rules not processed for user `9267752ac6724013bc1edcdecff48dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:07:12.424956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-733fa3dc-b984-41b0-9706-8c4bae50b718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:12.438433 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1231/2439] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Aug 11 11:07:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:07:12.451174 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10360505-56cb-4b03-9985-c73f7477966a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:12.481267 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10360505-56cb-4b03-9985-c73f7477966a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:12.481267 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e53583-a233-4179-935e-7feea83e2661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:12.481267 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e53583-a233-4179-935e-7feea83e2661 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:12.481267 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e53583-a233-4179-935e-7feea83e2661 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:12.481683 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e53583-a233-4179-935e-7feea83e2661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:12.486403 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e53583-a233-4179-935e-7feea83e2661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:12.487875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e53583-a233-4179-935e-7feea83e2661 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:12.500811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1209/2440] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:07:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:07:17.515467 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f762c-215e-423e-ba0e-c792507b3dde None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:17.515898 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f762c-215e-423e-ba0e-c792507b3dde None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:17.515898 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f762c-215e-423e-ba0e-c792507b3dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:17.540649 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3b6f762c-215e-423e-ba0e-c792507b3dde None None] MFA Rules not processed for user `9751264123914c27b961009f75067660`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:07:17.542020 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3b6f762c-215e-423e-ba0e-c792507b3dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:17.616030 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1232/2441] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Aug 11 11:07:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:07:17.633699 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e53583-a233-4179-935e-7feea83e2661 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:17.636064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c9e53583-a233-4179-935e-7feea83e2661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:17.729884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e53583-a233-4179-935e-7feea83e2661 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:17.741539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c5b57-91aa-4810-9439-232e085e867d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd25d1bde0c4703b61e0edaf5b658d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:17.741539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c5b57-91aa-4810-9439-232e085e867d service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:17.741539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c5b57-91aa-4810-9439-232e085e867d service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:17.741539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c5b57-91aa-4810-9439-232e085e867d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:17.749331 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c5b57-91aa-4810-9439-232e085e867d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:17.751066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c5b57-91aa-4810-9439-232e085e867d service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:17.760926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1210/2442] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Aug 11 11:07:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 11:07:18.874064 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd09504-a3ec-4f3f-bb65-443376f99120 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:18.875032 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd09504-a3ec-4f3f-bb65-443376f99120 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:18.875304 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd09504-a3ec-4f3f-bb65-443376f99120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:18.900502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-acd09504-a3ec-4f3f-bb65-443376f99120 None None] MFA Rules not processed for user `9751264123914c27b961009f75067660`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:07:18.901558 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-acd09504-a3ec-4f3f-bb65-443376f99120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:18.916313 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1233/2443] 10.222.0.43 () {58 vars in 967 bytes} [Thu Aug 11 11:07:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:07:18.935404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c5b57-91aa-4810-9439-232e085e867d service swift] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:18.947518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c5b57-91aa-4810-9439-232e085e867d service swift] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:18.953818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4352d-5b44-42ad-80af-2da043b97aa1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd25d1bde0c4703b61e0edaf5b658d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:18.954434 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4352d-5b44-42ad-80af-2da043b97aa1 service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:18.954738 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4352d-5b44-42ad-80af-2da043b97aa1 service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:18.955037 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4352d-5b44-42ad-80af-2da043b97aa1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:18.964711 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4352d-5b44-42ad-80af-2da043b97aa1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:18.966304 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4352d-5b44-42ad-80af-2da043b97aa1 service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:18.974884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1211/2444] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Aug 11 11:07:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 11:07:19.614453 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd09504-a3ec-4f3f-bb65-443376f99120 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:19.615916 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-acd09504-a3ec-4f3f-bb65-443376f99120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:19.630591 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd09504-a3ec-4f3f-bb65-443376f99120 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:19.635991 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3ebd9a-ee45-4e2a-9271-cb981ea0a157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:19.636623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ebd9a-ee45-4e2a-9271-cb981ea0a157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:19.636908 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ebd9a-ee45-4e2a-9271-cb981ea0a157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:19.637182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3ebd9a-ee45-4e2a-9271-cb981ea0a157 admin admin] PATH_INFO: `/v3/users/808e035e834c4bc89721166c5f23021b` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:19.638323 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ebd9a-ee45-4e2a-9271-cb981ea0a157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=808e035e834c4bc89721166c5f23021b)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:19.640359 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3ebd9a-ee45-4e2a-9271-cb981ea0a157 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:19.702915 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8b2ba-9380-4b82-90fd-1bf381baebc8 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:19.703256 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8b2ba-9380-4b82-90fd-1bf381baebc8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:19.703538 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8b2ba-9380-4b82-90fd-1bf381baebc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:19.723748 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0ed8b2ba-9380-4b82-90fd-1bf381baebc8 None None] MFA Rules not processed for user `9751264123914c27b961009f75067660`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:07:19.724946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0ed8b2ba-9380-4b82-90fd-1bf381baebc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:19.732828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1212/2445] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Aug 11 11:07:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:07:19.745231 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8b2ba-9380-4b82-90fd-1bf381baebc8 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:19.757361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8b2ba-9380-4b82-90fd-1bf381baebc8 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:19.762657 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa22817-5c2b-46b1-9b04-faeec092e395 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd25d1bde0c4703b61e0edaf5b658d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:19.763305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa22817-5c2b-46b1-9b04-faeec092e395 service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:19.763577 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa22817-5c2b-46b1-9b04-faeec092e395 service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:19.763849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa22817-5c2b-46b1-9b04-faeec092e395 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:19.772205 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa22817-5c2b-46b1-9b04-faeec092e395 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:19.774334 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa22817-5c2b-46b1-9b04-faeec092e395 service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:19.782355 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1213/2446] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Aug 11 11:07:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 11 11:07:19.884015 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9d3ebd9a-ee45-4e2a-9271-cb981ea0a157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '808e035e834c4bc89721166c5f23021b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:19.884647 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9d3ebd9a-ee45-4e2a-9271-cb981ea0a157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '808e035e834c4bc89721166c5f23021b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:19.889917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:19.897003 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9d3ebd9a-ee45-4e2a-9271-cb981ea0a157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '808e035e834c4bc89721166c5f23021b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:19.904949 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9d3ebd9a-ee45-4e2a-9271-cb981ea0a157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '808e035e834c4bc89721166c5f23021b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:20.012989 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9d3ebd9a-ee45-4e2a-9271-cb981ea0a157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '808e035e834c4bc89721166c5f23021b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:20.019226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1234/2447] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:07:19 2022] DELETE /identity/v3/users/808e035e834c4bc89721166c5f23021b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:07:20.306999 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa22817-5c2b-46b1-9b04-faeec092e395 service swift] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:20.318845 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa22817-5c2b-46b1-9b04-faeec092e395 service swift] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:20.367480 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:20.406502 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b248634-4ab3-4c44-877e-ecd2abab687f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:20.407364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b248634-4ab3-4c44-877e-ecd2abab687f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:20.407788 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b248634-4ab3-4c44-877e-ecd2abab687f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:20.408365 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b248634-4ab3-4c44-877e-ecd2abab687f admin admin] PATH_INFO: `/v3/projects/dabc78c1281c4b8abc6fdff60afd2817` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:20.409626 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b248634-4ab3-4c44-877e-ecd2abab687f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dabc78c1281c4b8abc6fdff60afd2817)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:20.411689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b248634-4ab3-4c44-877e-ecd2abab687f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:20.504132 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bb9ca-dd29-4968-8eb1-abcc494b324f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:20.504421 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bb9ca-dd29-4968-8eb1-abcc494b324f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:20.504697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bb9ca-dd29-4968-8eb1-abcc494b324f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:20.527831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1b248634-4ab3-4c44-877e-ecd2abab687f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dabc78c1281c4b8abc6fdff60afd2817', 'request_id': 'req-1b248634-4ab3-4c44-877e-ecd2abab687f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:20.533929 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f63bb9ca-dd29-4968-8eb1-abcc494b324f None None] MFA Rules not processed for user `9751264123914c27b961009f75067660`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:07:20.534150 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1b248634-4ab3-4c44-877e-ecd2abab687f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dabc78c1281c4b8abc6fdff60afd2817', 'request_id': 'req-1b248634-4ab3-4c44-877e-ecd2abab687f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:20.535178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f63bb9ca-dd29-4968-8eb1-abcc494b324f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:20.544702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1b248634-4ab3-4c44-877e-ecd2abab687f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dabc78c1281c4b8abc6fdff60afd2817', 'request_id': 'req-1b248634-4ab3-4c44-877e-ecd2abab687f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:20.610191 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1b248634-4ab3-4c44-877e-ecd2abab687f admin admin] The token cache is being invalidate because project dabc78c1281c4b8abc6fdff60afd2817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:07:20.610939 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1b248634-4ab3-4c44-877e-ecd2abab687f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:20.612126 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-1b248634-4ab3-4c44-877e-ecd2abab687f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:20.614054 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1214/2448] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:07:20 2022] DELETE /identity/v3/projects/dabc78c1281c4b8abc6fdff60afd2817 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:07:20.619021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b248634-4ab3-4c44-877e-ecd2abab687f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:20.620930 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1b248634-4ab3-4c44-877e-ecd2abab687f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:20.624188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1235/2449] 10.222.0.43 () {58 vars in 967 bytes} [Thu Aug 11 11:07:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:07:20.637969 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bb9ca-dd29-4968-8eb1-abcc494b324f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:20.640264 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f63bb9ca-dd29-4968-8eb1-abcc494b324f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:20.712244 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b248634-4ab3-4c44-877e-ecd2abab687f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:20.717724 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3793f-8561-4b08-9c27-afcc64cb09d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:20.718692 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3793f-8561-4b08-9c27-afcc64cb09d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:20.719008 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3793f-8561-4b08-9c27-afcc64cb09d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:20.719431 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3793f-8561-4b08-9c27-afcc64cb09d0 admin admin] PATH_INFO: `/v3/users/b13fad98c93e4954b41e65518d7d2821` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:20.720565 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3793f-8561-4b08-9c27-afcc64cb09d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b13fad98c93e4954b41e65518d7d2821)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:20.722628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3793f-8561-4b08-9c27-afcc64cb09d0 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:20.749110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bb9ca-dd29-4968-8eb1-abcc494b324f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:20.754329 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d978e24-8f7b-4345-a4aa-a8057e6ee3a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd25d1bde0c4703b61e0edaf5b658d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:20.754977 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d978e24-8f7b-4345-a4aa-a8057e6ee3a6 service swift] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:20.755644 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d978e24-8f7b-4345-a4aa-a8057e6ee3a6 service swift] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:20.755644 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d978e24-8f7b-4345-a4aa-a8057e6ee3a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:20.765069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d978e24-8f7b-4345-a4aa-a8057e6ee3a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:20.766662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d978e24-8f7b-4345-a4aa-a8057e6ee3a6 service swift] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:20.774704 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1236/2450] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Aug 11 11:07:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 11 11:07:20.907341 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2dd3793f-8561-4b08-9c27-afcc64cb09d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b13fad98c93e4954b41e65518d7d2821'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:20.921548 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:20.922958 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2dd3793f-8561-4b08-9c27-afcc64cb09d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b13fad98c93e4954b41e65518d7d2821'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:20.926046 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2dd3793f-8561-4b08-9c27-afcc64cb09d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b13fad98c93e4954b41e65518d7d2821'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:21.010363 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2dd3793f-8561-4b08-9c27-afcc64cb09d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b13fad98c93e4954b41e65518d7d2821'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:21.018611 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2dd3793f-8561-4b08-9c27-afcc64cb09d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b13fad98c93e4954b41e65518d7d2821'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:21.025591 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1215/2451] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:07:20 2022] DELETE /identity/v3/users/b13fad98c93e4954b41e65518d7d2821 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:07:21.084565 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd78da8-a4f9-4881-900b-cdc0d122d99a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:21.086703 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd78da8-a4f9-4881-900b-cdc0d122d99a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:21.086703 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd78da8-a4f9-4881-900b-cdc0d122d99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:21.108992 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4dd78da8-a4f9-4881-900b-cdc0d122d99a None None] MFA Rules not processed for user `9751264123914c27b961009f75067660`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:07:21.110474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4dd78da8-a4f9-4881-900b-cdc0d122d99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:21.259301 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1237/2452] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Aug 11 11:07:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:07:21.275766 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3793f-8561-4b08-9c27-afcc64cb09d0 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:21.278000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2dd3793f-8561-4b08-9c27-afcc64cb09d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:21.399816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3793f-8561-4b08-9c27-afcc64cb09d0 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:21.408337 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84321a-372b-485b-838a-abc89b1dd982 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd25d1bde0c4703b61e0edaf5b658d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:21.408337 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84321a-372b-485b-838a-abc89b1dd982 service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:21.408337 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84321a-372b-485b-838a-abc89b1dd982 service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:21.408337 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84321a-372b-485b-838a-abc89b1dd982 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:21.409882 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd78da8-a4f9-4881-900b-cdc0d122d99a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:21.411977 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4dd78da8-a4f9-4881-900b-cdc0d122d99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:21.417939 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84321a-372b-485b-838a-abc89b1dd982 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:21.419561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84321a-372b-485b-838a-abc89b1dd982 service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:21.429147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1216/2453] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Aug 11 11:07:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 11 11:07:21.435641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:21.559756 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd78da8-a4f9-4881-900b-cdc0d122d99a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:21.572909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da818dc-9381-49bf-a80b-df4ae3a4cc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:21.573810 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da818dc-9381-49bf-a80b-df4ae3a4cc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:21.574161 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da818dc-9381-49bf-a80b-df4ae3a4cc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:21.575050 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da818dc-9381-49bf-a80b-df4ae3a4cc8c admin admin] PATH_INFO: `/v3/projects/0038e654f15a48d19b53beacc05dbfcc` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:21.587549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da818dc-9381-49bf-a80b-df4ae3a4cc8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0038e654f15a48d19b53beacc05dbfcc)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:21.589615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da818dc-9381-49bf-a80b-df4ae3a4cc8c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:21.728138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9da818dc-9381-49bf-a80b-df4ae3a4cc8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0038e654f15a48d19b53beacc05dbfcc', 'request_id': 'req-9da818dc-9381-49bf-a80b-df4ae3a4cc8c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:21.744371 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9da818dc-9381-49bf-a80b-df4ae3a4cc8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0038e654f15a48d19b53beacc05dbfcc', 'request_id': 'req-9da818dc-9381-49bf-a80b-df4ae3a4cc8c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:21.841595 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9da818dc-9381-49bf-a80b-df4ae3a4cc8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0038e654f15a48d19b53beacc05dbfcc', 'request_id': 'req-9da818dc-9381-49bf-a80b-df4ae3a4cc8c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:21.857690 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9da818dc-9381-49bf-a80b-df4ae3a4cc8c admin admin] The token cache is being invalidate because project 0038e654f15a48d19b53beacc05dbfcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:07:21.857987 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9da818dc-9381-49bf-a80b-df4ae3a4cc8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:21.858723 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9da818dc-9381-49bf-a80b-df4ae3a4cc8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:21.860492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1238/2454] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:07:21 2022] DELETE /identity/v3/projects/0038e654f15a48d19b53beacc05dbfcc => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:07:21.865490 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d859dde-3abf-4f27-814e-092bfccb7ecb None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:21.865778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d859dde-3abf-4f27-814e-092bfccb7ecb None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:21.866056 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d859dde-3abf-4f27-814e-092bfccb7ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:21.892303 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3d859dde-3abf-4f27-814e-092bfccb7ecb None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:07:21.892303 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3d859dde-3abf-4f27-814e-092bfccb7ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:21.962982 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1217/2455] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:07:21.970918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f8ef2-0995-41fe-986c-4b3b76cb0668 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:21.971211 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f8ef2-0995-41fe-986c-4b3b76cb0668 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:21.971491 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f8ef2-0995-41fe-986c-4b3b76cb0668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:21.992057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5f2f8ef2-0995-41fe-986c-4b3b76cb0668 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:07:21.993286 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5f2f8ef2-0995-41fe-986c-4b3b76cb0668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:22.001310 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1239/2456] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:07:22.005562 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d859dde-3abf-4f27-814e-092bfccb7ecb None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:22.015451 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d859dde-3abf-4f27-814e-092bfccb7ecb None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:22.020150 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573eff70-5a8f-4291-90cd-11e124bf9b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:22.020754 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573eff70-5a8f-4291-90cd-11e124bf9b32 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:22.021054 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573eff70-5a8f-4291-90cd-11e124bf9b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:22.021323 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573eff70-5a8f-4291-90cd-11e124bf9b32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:22.021961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573eff70-5a8f-4291-90cd-11e124bf9b32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:07:22.022260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573eff70-5a8f-4291-90cd-11e124bf9b32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:22.024411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573eff70-5a8f-4291-90cd-11e124bf9b32 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:22.036112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1218/2457] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:07:22.041484 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f8ef2-0995-41fe-986c-4b3b76cb0668 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:22.052902 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f8ef2-0995-41fe-986c-4b3b76cb0668 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:22.057727 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d583e71-3bd4-434c-9df1-93cc87c6c8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:22.058326 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d583e71-3bd4-434c-9df1-93cc87c6c8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:22.058609 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d583e71-3bd4-434c-9df1-93cc87c6c8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:22.058916 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d583e71-3bd4-434c-9df1-93cc87c6c8a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:22.059546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d583e71-3bd4-434c-9df1-93cc87c6c8a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:22.061451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d583e71-3bd4-434c-9df1-93cc87c6c8a9 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:22.159457 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1240/2458] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:07:22 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:07:22.166448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573eff70-5a8f-4291-90cd-11e124bf9b32 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:22.178128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573eff70-5a8f-4291-90cd-11e124bf9b32 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:22.235860 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:22.242265 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99f221-c55e-48d6-ab9f-c405871b4352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:22.242915 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99f221-c55e-48d6-ab9f-c405871b4352 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:22.243192 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99f221-c55e-48d6-ab9f-c405871b4352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:22.243463 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99f221-c55e-48d6-ab9f-c405871b4352 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:22.244072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99f221-c55e-48d6-ab9f-c405871b4352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:22.247094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99f221-c55e-48d6-ab9f-c405871b4352 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:22.355824 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1219/2459] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:07:22 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:07:22.360203 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d583e71-3bd4-434c-9df1-93cc87c6c8a9 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:22.371233 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d583e71-3bd4-434c-9df1-93cc87c6c8a9 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:22.376140 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faaf112-077d-4f73-ac2b-0f83699d2dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:22.376748 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaf112-077d-4f73-ac2b-0f83699d2dff admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:22.377136 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaf112-077d-4f73-ac2b-0f83699d2dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:22.377413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaf112-077d-4f73-ac2b-0f83699d2dff admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:22.378056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faaf112-077d-4f73-ac2b-0f83699d2dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:22.379723 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faaf112-077d-4f73-ac2b-0f83699d2dff admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:22.390749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1241/2460] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:07:22.394892 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99f221-c55e-48d6-ab9f-c405871b4352 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:22.409196 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99f221-c55e-48d6-ab9f-c405871b4352 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:22.414734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22098a9e-3c8d-4f9f-8bd5-2e6e30a7af1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:22.415392 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22098a9e-3c8d-4f9f-8bd5-2e6e30a7af1e admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:22.415672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22098a9e-3c8d-4f9f-8bd5-2e6e30a7af1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:22.415945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22098a9e-3c8d-4f9f-8bd5-2e6e30a7af1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:22.416588 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22098a9e-3c8d-4f9f-8bd5-2e6e30a7af1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:22.418238 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22098a9e-3c8d-4f9f-8bd5-2e6e30a7af1e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:22.429280 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1220/2461] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:07:22.433973 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faaf112-077d-4f73-ac2b-0f83699d2dff admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:22.444579 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faaf112-077d-4f73-ac2b-0f83699d2dff admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:22.449973 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85142e26-eea8-4b3d-94d3-8a22332ae0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:22.450633 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85142e26-eea8-4b3d-94d3-8a22332ae0de admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:22.451069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85142e26-eea8-4b3d-94d3-8a22332ae0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:22.451397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85142e26-eea8-4b3d-94d3-8a22332ae0de admin admin] PATH_INFO: `/v3/projects/f76b582d1624437ca9cdf6e833fd61f6/users/537893a03e5e4c36aae9136eefa46648/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:22.468903 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85142e26-eea8-4b3d-94d3-8a22332ae0de admin admin] RBAC: Authorizing `identity:create_grant(project_id=f76b582d1624437ca9cdf6e833fd61f6, user_id=537893a03e5e4c36aae9136eefa46648, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:22.471568 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85142e26-eea8-4b3d-94d3-8a22332ae0de admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:22.579133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1242/2462] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:07:22 2022] PUT /identity/v3/projects/f76b582d1624437ca9cdf6e833fd61f6/users/537893a03e5e4c36aae9136eefa46648/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:07:22.655958 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c5319-4d0e-4868-8518-a4cd4d25f4cf None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:22.656251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c5319-4d0e-4868-8518-a4cd4d25f4cf None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:22.656528 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c5319-4d0e-4868-8518-a4cd4d25f4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:22.686280 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-427c5319-4d0e-4868-8518-a4cd4d25f4cf None None] MFA Rules not processed for user `537893a03e5e4c36aae9136eefa46648`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:07:22.687533 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-427c5319-4d0e-4868-8518-a4cd4d25f4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:22.757289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1221/2463] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:07:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:07:22.769579 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85142e26-eea8-4b3d-94d3-8a22332ae0de admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:22.771313 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-85142e26-eea8-4b3d-94d3-8a22332ae0de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:22.816403 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:22.832558 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85142e26-eea8-4b3d-94d3-8a22332ae0de admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:22.836615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5f40d-8748-4688-972c-d9cc76362964 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:22.837229 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5f40d-8748-4688-972c-d9cc76362964 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:22.837517 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5f40d-8748-4688-972c-d9cc76362964 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:22.837796 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5f40d-8748-4688-972c-d9cc76362964 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:22.846688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5f40d-8748-4688-972c-d9cc76362964 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:22.848173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff5f40d-8748-4688-972c-d9cc76362964 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:22.859162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1243/2464] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:07:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:07:23.641273 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c5319-4d0e-4868-8518-a4cd4d25f4cf None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:23.642809 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-427c5319-4d0e-4868-8518-a4cd4d25f4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:23.721028 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c5319-4d0e-4868-8518-a4cd4d25f4cf None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:23.726999 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eed396-34b6-4aba-9e8a-2d94192e2e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:23.727802 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eed396-34b6-4aba-9e8a-2d94192e2e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:23.728088 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eed396-34b6-4aba-9e8a-2d94192e2e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:23.728359 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eed396-34b6-4aba-9e8a-2d94192e2e1e admin admin] PATH_INFO: `/v3/users/e20113c737c74d309c4628be79a53c0d` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:23.729520 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eed396-34b6-4aba-9e8a-2d94192e2e1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e20113c737c74d309c4628be79a53c0d)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:23.731483 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eed396-34b6-4aba-9e8a-2d94192e2e1e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:23.927020 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-39eed396-34b6-4aba-9e8a-2d94192e2e1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e20113c737c74d309c4628be79a53c0d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:23.944928 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-39eed396-34b6-4aba-9e8a-2d94192e2e1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e20113c737c74d309c4628be79a53c0d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:23.946922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-39eed396-34b6-4aba-9e8a-2d94192e2e1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e20113c737c74d309c4628be79a53c0d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:23.951709 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:24.075786 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-39eed396-34b6-4aba-9e8a-2d94192e2e1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e20113c737c74d309c4628be79a53c0d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:24.083219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-39eed396-34b6-4aba-9e8a-2d94192e2e1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e20113c737c74d309c4628be79a53c0d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:24.090101 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1222/2465] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:07:23 2022] DELETE /identity/v3/users/e20113c737c74d309c4628be79a53c0d => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:07:24.094959 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b8108-16ca-45fa-919c-ae4545db8701 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:24.095563 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b8108-16ca-45fa-919c-ae4545db8701 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:24.095649 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b8108-16ca-45fa-919c-ae4545db8701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:24.115402 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-475b8108-16ca-45fa-919c-ae4545db8701 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:07:24.116615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-475b8108-16ca-45fa-919c-ae4545db8701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:24.188772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1244/2466] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:07:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:07:24.200500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eed396-34b6-4aba-9e8a-2d94192e2e1e admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:24.202531 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-39eed396-34b6-4aba-9e8a-2d94192e2e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:24.306887 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eed396-34b6-4aba-9e8a-2d94192e2e1e admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:24.515450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd443965-75e6-4bf7-ae56-5fd54ab52891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:24.515450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd443965-75e6-4bf7-ae56-5fd54ab52891 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:24.515450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd443965-75e6-4bf7-ae56-5fd54ab52891 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:24.515450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd443965-75e6-4bf7-ae56-5fd54ab52891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:24.515952 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd443965-75e6-4bf7-ae56-5fd54ab52891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:24.515952 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd443965-75e6-4bf7-ae56-5fd54ab52891 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:24.515952 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1223/2467] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:07:24.803746 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b8108-16ca-45fa-919c-ae4545db8701 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:24.808864 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-475b8108-16ca-45fa-919c-ae4545db8701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:24.825352 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b8108-16ca-45fa-919c-ae4545db8701 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:24.832491 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161964c5-81d8-4783-b9fa-1826597c49ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:24.833267 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161964c5-81d8-4783-b9fa-1826597c49ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:24.833501 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161964c5-81d8-4783-b9fa-1826597c49ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:24.834029 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161964c5-81d8-4783-b9fa-1826597c49ec admin admin] PATH_INFO: `/v3/projects/b019c32b9a8f4f8bb3ec621260ed6e98` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:24.835354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161964c5-81d8-4783-b9fa-1826597c49ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=b019c32b9a8f4f8bb3ec621260ed6e98)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:24.837352 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161964c5-81d8-4783-b9fa-1826597c49ec admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:24.986170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-161964c5-81d8-4783-b9fa-1826597c49ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b019c32b9a8f4f8bb3ec621260ed6e98', 'request_id': 'req-161964c5-81d8-4783-b9fa-1826597c49ec'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:25.001098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-161964c5-81d8-4783-b9fa-1826597c49ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b019c32b9a8f4f8bb3ec621260ed6e98', 'request_id': 'req-161964c5-81d8-4783-b9fa-1826597c49ec'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:25.093339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-161964c5-81d8-4783-b9fa-1826597c49ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b019c32b9a8f4f8bb3ec621260ed6e98', 'request_id': 'req-161964c5-81d8-4783-b9fa-1826597c49ec'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:25.117942 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-161964c5-81d8-4783-b9fa-1826597c49ec admin admin] The token cache is being invalidate because project b019c32b9a8f4f8bb3ec621260ed6e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:07:25.118582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-161964c5-81d8-4783-b9fa-1826597c49ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:25.119703 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-161964c5-81d8-4783-b9fa-1826597c49ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:25.122864 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1245/2468] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:07:24 2022] DELETE /identity/v3/projects/b019c32b9a8f4f8bb3ec621260ed6e98 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:07:27.128572 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd443965-75e6-4bf7-ae56-5fd54ab52891 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:27.129976 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cd443965-75e6-4bf7-ae56-5fd54ab52891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:27.142839 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd443965-75e6-4bf7-ae56-5fd54ab52891 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:27.227305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c063b6-17a7-4730-9bbc-c130dd6e93b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:27.228698 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c063b6-17a7-4730-9bbc-c130dd6e93b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:27.229077 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c063b6-17a7-4730-9bbc-c130dd6e93b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:27.229444 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c063b6-17a7-4730-9bbc-c130dd6e93b2 admin admin] PATH_INFO: `/v3/users/537893a03e5e4c36aae9136eefa46648` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:27.230875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c063b6-17a7-4730-9bbc-c130dd6e93b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=537893a03e5e4c36aae9136eefa46648)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:27.233994 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c063b6-17a7-4730-9bbc-c130dd6e93b2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:27.492716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-55c063b6-17a7-4730-9bbc-c130dd6e93b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '537893a03e5e4c36aae9136eefa46648'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:27.507450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-55c063b6-17a7-4730-9bbc-c130dd6e93b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '537893a03e5e4c36aae9136eefa46648'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:27.508958 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-55c063b6-17a7-4730-9bbc-c130dd6e93b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '537893a03e5e4c36aae9136eefa46648'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:27.578438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-55c063b6-17a7-4730-9bbc-c130dd6e93b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '537893a03e5e4c36aae9136eefa46648'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:27.587449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-55c063b6-17a7-4730-9bbc-c130dd6e93b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '537893a03e5e4c36aae9136eefa46648'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:27.594418 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1224/2469] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:07:27 2022] DELETE /identity/v3/users/537893a03e5e4c36aae9136eefa46648 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:07:27.599113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be969f-7110-4fd4-bec2-72280b339485 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:27.599579 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be969f-7110-4fd4-bec2-72280b339485 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:27.599812 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be969f-7110-4fd4-bec2-72280b339485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:27.620235 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-48be969f-7110-4fd4-bec2-72280b339485 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:07:27.621453 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-48be969f-7110-4fd4-bec2-72280b339485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:27.701516 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1246/2470] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:07:27.711435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c063b6-17a7-4730-9bbc-c130dd6e93b2 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:27.712846 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-55c063b6-17a7-4730-9bbc-c130dd6e93b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:27.722885 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:27.784221 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c063b6-17a7-4730-9bbc-c130dd6e93b2 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:27.788022 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579a7fc-5d6a-4b38-a38e-15414114977f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:27.788959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579a7fc-5d6a-4b38-a38e-15414114977f service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:27.789724 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579a7fc-5d6a-4b38-a38e-15414114977f service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:27.790810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579a7fc-5d6a-4b38-a38e-15414114977f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:27.802885 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579a7fc-5d6a-4b38-a38e-15414114977f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:27.804584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579a7fc-5d6a-4b38-a38e-15414114977f service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:27.816870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1225/2471] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:07:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:07:29.028558 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be969f-7110-4fd4-bec2-72280b339485 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:29.034309 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-48be969f-7110-4fd4-bec2-72280b339485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:29.046893 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:29.058968 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be969f-7110-4fd4-bec2-72280b339485 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:29.068170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a55604-6470-4eee-842a-e95c0307f71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:29.068937 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a55604-6470-4eee-842a-e95c0307f71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:29.070806 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a55604-6470-4eee-842a-e95c0307f71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:29.070806 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a55604-6470-4eee-842a-e95c0307f71c admin admin] PATH_INFO: `/v3/projects/f76b582d1624437ca9cdf6e833fd61f6` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:29.078392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a55604-6470-4eee-842a-e95c0307f71c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f76b582d1624437ca9cdf6e833fd61f6)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:29.080659 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a55604-6470-4eee-842a-e95c0307f71c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:29.246130 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-87a55604-6470-4eee-842a-e95c0307f71c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f76b582d1624437ca9cdf6e833fd61f6', 'request_id': 'req-87a55604-6470-4eee-842a-e95c0307f71c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:29.253187 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-87a55604-6470-4eee-842a-e95c0307f71c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f76b582d1624437ca9cdf6e833fd61f6', 'request_id': 'req-87a55604-6470-4eee-842a-e95c0307f71c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:29.472319 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-87a55604-6470-4eee-842a-e95c0307f71c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f76b582d1624437ca9cdf6e833fd61f6', 'request_id': 'req-87a55604-6470-4eee-842a-e95c0307f71c'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:29.484969 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-87a55604-6470-4eee-842a-e95c0307f71c admin admin] The token cache is being invalidate because project f76b582d1624437ca9cdf6e833fd61f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:07:29.485258 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-87a55604-6470-4eee-842a-e95c0307f71c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:29.485885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-87a55604-6470-4eee-842a-e95c0307f71c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:07:29.487377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1247/2472] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:07:29 2022] DELETE /identity/v3/projects/f76b582d1624437ca9cdf6e833fd61f6 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:07:37.812606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=23 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:39.829590 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:47.928623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fc04f-4b76-48dd-aadd-8db407579661 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:47.929225 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fc04f-4b76-48dd-aadd-8db407579661 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:47.929225 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fc04f-4b76-48dd-aadd-8db407579661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:47.952801 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ee9fc04f-4b76-48dd-aadd-8db407579661 None None] MFA Rules not processed for user `9751264123914c27b961009f75067660`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:07:47.954084 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ee9fc04f-4b76-48dd-aadd-8db407579661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:48.031050 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1226/2473] 10.222.0.43 () {58 vars in 967 bytes} [Thu Aug 11 11:07:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:07:48.059197 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a55604-6470-4eee-842a-e95c0307f71c admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:07:48.060859 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-87a55604-6470-4eee-842a-e95c0307f71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:07:48.133446 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a55604-6470-4eee-842a-e95c0307f71c admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:07:48.140033 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7e39d-3ca7-4747-af1b-1d5b043bd615 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd25d1bde0c4703b61e0edaf5b658d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:07:48.140713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7e39d-3ca7-4747-af1b-1d5b043bd615 service swift] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:07:48.141145 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7e39d-3ca7-4747-af1b-1d5b043bd615 service swift] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:07:48.141414 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7e39d-3ca7-4747-af1b-1d5b043bd615 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:07:48.153283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7e39d-3ca7-4747-af1b-1d5b043bd615 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:07:48.154895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7e39d-3ca7-4747-af1b-1d5b043bd615 service swift] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:07:48.170451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1248/2474] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Aug 11 11:07:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 11:07:58.017543 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=25 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:58.160069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=32 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:08:11.348579 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64c047-bc76-475e-a5e7-6b7a18d651ab None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:08:11.349144 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64c047-bc76-475e-a5e7-6b7a18d651ab None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:08:11.349144 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64c047-bc76-475e-a5e7-6b7a18d651ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:08:11.368851 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-af64c047-bc76-475e-a5e7-6b7a18d651ab None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:08:11.370937 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-af64c047-bc76-475e-a5e7-6b7a18d651ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:08:11.427872 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1227/2475] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 11:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:08:11.453406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7e39d-3ca7-4747-af1b-1d5b043bd615 service swift] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:08:11.454845 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9cc7e39d-3ca7-4747-af1b-1d5b043bd615 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:08:11.525964 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7e39d-3ca7-4747-af1b-1d5b043bd615 service swift] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:08:11.531454 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b887b1-fbcb-4cd1-aeac-0d679cf3243b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:08:11.532053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b887b1-fbcb-4cd1-aeac-0d679cf3243b service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:08:11.532331 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b887b1-fbcb-4cd1-aeac-0d679cf3243b service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:08:11.532605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b887b1-fbcb-4cd1-aeac-0d679cf3243b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:08:11.540463 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b887b1-fbcb-4cd1-aeac-0d679cf3243b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:08:11.542608 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b887b1-fbcb-4cd1-aeac-0d679cf3243b service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:08:11.551752 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1249/2476] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:08:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:08:17.588504 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f68aa4-c9b2-4cd3-b99f-edfe26c0d4d3 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:08:17.589108 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f68aa4-c9b2-4cd3-b99f-edfe26c0d4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:08:17.589108 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f68aa4-c9b2-4cd3-b99f-edfe26c0d4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:08:17.608463 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-34f68aa4-c9b2-4cd3-b99f-edfe26c0d4d3 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:08:17.609903 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-34f68aa4-c9b2-4cd3-b99f-edfe26c0d4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:08:17.617620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1228/2477] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 11:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:08:17.639492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b887b1-fbcb-4cd1-aeac-0d679cf3243b service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:08:17.640856 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f0b887b1-fbcb-4cd1-aeac-0d679cf3243b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:08:17.655336 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b887b1-fbcb-4cd1-aeac-0d679cf3243b service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:08:17.661101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2182b15-8809-48d3-add0-400d2b2320d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:08:17.661711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2182b15-8809-48d3-add0-400d2b2320d7 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:08:17.661993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2182b15-8809-48d3-add0-400d2b2320d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:08:17.662264 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2182b15-8809-48d3-add0-400d2b2320d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:08:17.671744 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2182b15-8809-48d3-add0-400d2b2320d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:08:17.673402 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2182b15-8809-48d3-add0-400d2b2320d7 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:08:17.685420 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1250/2478] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:08:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:08:22.169024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af2251-8b23-46c5-9e76-62d608e6144b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:08:22.169555 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af2251-8b23-46c5-9e76-62d608e6144b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:08:22.169661 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af2251-8b23-46c5-9e76-62d608e6144b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:08:22.188905 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e0af2251-8b23-46c5-9e76-62d608e6144b None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:08:22.190082 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e0af2251-8b23-46c5-9e76-62d608e6144b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:08:22.197696 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1229/2479] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 11:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:08:22.223711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2182b15-8809-48d3-add0-400d2b2320d7 service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:08:22.235806 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2182b15-8809-48d3-add0-400d2b2320d7 service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:08:22.241601 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d88a5-5a8b-4c41-8a74-d46bda73455b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:08:22.242200 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d88a5-5a8b-4c41-8a74-d46bda73455b service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:08:22.242483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d88a5-5a8b-4c41-8a74-d46bda73455b service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:08:22.242778 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d88a5-5a8b-4c41-8a74-d46bda73455b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:08:22.252354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d88a5-5a8b-4c41-8a74-d46bda73455b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:08:22.253929 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d88a5-5a8b-4c41-8a74-d46bda73455b service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:08:22.264539 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1251/2480] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:08:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:08:26.148445 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17205172-4362-4b8a-adfa-3cb02544e180 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:08:26.148945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17205172-4362-4b8a-adfa-3cb02544e180 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:08:26.148945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17205172-4362-4b8a-adfa-3cb02544e180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:08:26.167753 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-17205172-4362-4b8a-adfa-3cb02544e180 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:08:26.168938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-17205172-4362-4b8a-adfa-3cb02544e180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:08:26.176764 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1230/2481] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 11:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:08:26.198416 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d88a5-5a8b-4c41-8a74-d46bda73455b service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:08:26.210090 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d88a5-5a8b-4c41-8a74-d46bda73455b service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:08:26.215771 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d76af7-43b3-4382-a3a0-23dc8c49b9f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:08:26.216361 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d76af7-43b3-4382-a3a0-23dc8c49b9f8 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:08:26.216640 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d76af7-43b3-4382-a3a0-23dc8c49b9f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:08:26.216911 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d76af7-43b3-4382-a3a0-23dc8c49b9f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:08:26.225050 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d76af7-43b3-4382-a3a0-23dc8c49b9f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:08:26.226672 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d76af7-43b3-4382-a3a0-23dc8c49b9f8 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:08:26.236773 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1252/2482] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:08:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:08:31.433886 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ad8ac-178a-4f7a-a0ac-2e8c7175b8a6 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:08:31.434957 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ad8ac-178a-4f7a-a0ac-2e8c7175b8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:08:31.435719 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ad8ac-178a-4f7a-a0ac-2e8c7175b8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:08:31.460938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ca3ad8ac-178a-4f7a-a0ac-2e8c7175b8a6 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:08:31.463535 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ca3ad8ac-178a-4f7a-a0ac-2e8c7175b8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:08:31.475312 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1231/2483] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 11:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:08:31.495815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d76af7-43b3-4382-a3a0-23dc8c49b9f8 service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:08:31.510382 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d76af7-43b3-4382-a3a0-23dc8c49b9f8 service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:08:31.516879 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba97af-04de-4d47-85f7-b55fb460a7e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:08:31.517819 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba97af-04de-4d47-85f7-b55fb460a7e2 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:08:31.518098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba97af-04de-4d47-85f7-b55fb460a7e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:08:31.518370 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba97af-04de-4d47-85f7-b55fb460a7e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:08:31.527007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba97af-04de-4d47-85f7-b55fb460a7e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:08:31.529485 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba97af-04de-4d47-85f7-b55fb460a7e2 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:08:31.548521 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1253/2484] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:08:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:08:35.693506 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cb2ed-d245-4ad9-8c54-9ff0b3d84abe None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:08:35.694000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cb2ed-d245-4ad9-8c54-9ff0b3d84abe None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:08:35.694095 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cb2ed-d245-4ad9-8c54-9ff0b3d84abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:08:35.713442 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c70cb2ed-d245-4ad9-8c54-9ff0b3d84abe None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:08:35.714636 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c70cb2ed-d245-4ad9-8c54-9ff0b3d84abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:08:35.722883 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1232/2485] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 11:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:08:35.748175 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba97af-04de-4d47-85f7-b55fb460a7e2 service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:08:35.760024 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba97af-04de-4d47-85f7-b55fb460a7e2 service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:08:35.765587 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe7603-9408-49b2-abce-8a51bd9f382d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:08:35.766195 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe7603-9408-49b2-abce-8a51bd9f382d service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:08:35.766473 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe7603-9408-49b2-abce-8a51bd9f382d service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:08:35.766801 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe7603-9408-49b2-abce-8a51bd9f382d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:08:35.774986 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe7603-9408-49b2-abce-8a51bd9f382d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:08:35.776578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe7603-9408-49b2-abce-8a51bd9f382d service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:08:35.786361 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1254/2486] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:08:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:08:45.708583 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=42 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:08:45.781923 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=64 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:08:50.918518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cb2ed-d245-4ad9-8c54-9ff0b3d84abe None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:08:50.920118 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c70cb2ed-d245-4ad9-8c54-9ff0b3d84abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:08:50.980070 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cb2ed-d245-4ad9-8c54-9ff0b3d84abe None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:08:50.984330 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45dd15-b784-4ba0-a650-6e27a2ae71a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:08:50.986617 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45dd15-b784-4ba0-a650-6e27a2ae71a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:08:50.986617 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45dd15-b784-4ba0-a650-6e27a2ae71a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:08:50.986617 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45dd15-b784-4ba0-a650-6e27a2ae71a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:08:50.988672 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2d45dd15-b784-4ba0-a650-6e27a2ae71a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:08:51.002978 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45dd15-b784-4ba0-a650-6e27a2ae71a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:08:51.004423 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45dd15-b784-4ba0-a650-6e27a2ae71a9 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:08:51.015526 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1233/2487] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:08:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:08:52.132847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd262b-c022-4bc3-9786-6cf911965137 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:08:52.133273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd262b-c022-4bc3-9786-6cf911965137 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:08:52.133411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd262b-c022-4bc3-9786-6cf911965137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:08:52.153643 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-28fd262b-c022-4bc3-9786-6cf911965137 None None] MFA Rules not processed for user `950e6ba9e8ed4e00843657869bc3a26d`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:08:52.154521 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-28fd262b-c022-4bc3-9786-6cf911965137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:08:52.210496 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1255/2488] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:08:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:08:52.906571 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45dd15-b784-4ba0-a650-6e27a2ae71a9 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:08:52.908290 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2d45dd15-b784-4ba0-a650-6e27a2ae71a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:08:52.919422 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45dd15-b784-4ba0-a650-6e27a2ae71a9 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:08:52.923739 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdceea-1b9a-4d36-9051-ec5ce02de5b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:08:52.924350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdceea-1b9a-4d36-9051-ec5ce02de5b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:08:52.925493 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdceea-1b9a-4d36-9051-ec5ce02de5b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:08:52.925779 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdceea-1b9a-4d36-9051-ec5ce02de5b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:08:52.927521 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-23fdceea-1b9a-4d36-9051-ec5ce02de5b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:08:52.947844 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdceea-1b9a-4d36-9051-ec5ce02de5b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:08:52.947844 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdceea-1b9a-4d36-9051-ec5ce02de5b2 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:08:52.954869 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1234/2489] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:08:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:08:56.513280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c55e75-2444-4583-a04d-4d8737688ed3 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:08:56.513813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c55e75-2444-4583-a04d-4d8737688ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:08:56.513928 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c55e75-2444-4583-a04d-4d8737688ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:08:56.532528 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-88c55e75-2444-4583-a04d-4d8737688ed3 None None] MFA Rules not processed for user `c656365b03324a80bb6f7f955176ae9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:08:56.533810 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-88c55e75-2444-4583-a04d-4d8737688ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:08:56.592216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1256/2490] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:08:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:09:00.605462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdceea-1b9a-4d36-9051-ec5ce02de5b2 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:09:00.616995 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdceea-1b9a-4d36-9051-ec5ce02de5b2 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:09:00.622888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16bd08-a9d7-491f-afd2-af5816bab80e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:09:00.623490 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16bd08-a9d7-491f-afd2-af5816bab80e service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:09:00.623771 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16bd08-a9d7-491f-afd2-af5816bab80e service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:09:00.624066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16bd08-a9d7-491f-afd2-af5816bab80e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:09:00.625810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6c16bd08-a9d7-491f-afd2-af5816bab80e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:09:00.685922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16bd08-a9d7-491f-afd2-af5816bab80e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:09:00.687570 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16bd08-a9d7-491f-afd2-af5816bab80e service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:09:00.697474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1235/2491] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:09:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:09:04.527503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c55e75-2444-4583-a04d-4d8737688ed3 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:09:04.541270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c55e75-2444-4583-a04d-4d8737688ed3 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:09:04.546845 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d1cb2-125d-402a-903e-0669ffe9a3e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:09:04.547545 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d1cb2-125d-402a-903e-0669ffe9a3e3 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:09:04.547932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d1cb2-125d-402a-903e-0669ffe9a3e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:09:04.548207 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d1cb2-125d-402a-903e-0669ffe9a3e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:09:04.550347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8c1d1cb2-125d-402a-903e-0669ffe9a3e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:09:04.562070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d1cb2-125d-402a-903e-0669ffe9a3e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:09:04.563997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d1cb2-125d-402a-903e-0669ffe9a3e3 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:09:04.574812 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1257/2492] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:09:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:09:10.693468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=60 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:14.569979 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=56 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:14.828937 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c483e-bc5d-4c8c-86c5-a043e99c47e3 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:09:14.829413 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c483e-bc5d-4c8c-86c5-a043e99c47e3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:09:14.830160 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c483e-bc5d-4c8c-86c5-a043e99c47e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:09:14.854190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-481c483e-bc5d-4c8c-86c5-a043e99c47e3 None None] MFA Rules not processed for user `060fd4adbdce44dfbf65e21561bfa532`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:09:14.855441 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-481c483e-bc5d-4c8c-86c5-a043e99c47e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:09:14.863024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1236/2493] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:09:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:09:15.181315 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d1cb2-125d-402a-903e-0669ffe9a3e3 service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:09:15.191339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d1cb2-125d-402a-903e-0669ffe9a3e3 service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:09:15.194966 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2fffc-fc90-4251-9d27-3f58b06a344d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:09:15.195594 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2fffc-fc90-4251-9d27-3f58b06a344d service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:09:15.195878 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2fffc-fc90-4251-9d27-3f58b06a344d service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:09:15.196181 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2fffc-fc90-4251-9d27-3f58b06a344d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:09:15.197928 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-2ec2fffc-fc90-4251-9d27-3f58b06a344d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:09:15.208720 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2fffc-fc90-4251-9d27-3f58b06a344d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:09:15.210155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2fffc-fc90-4251-9d27-3f58b06a344d service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:09:15.219250 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1258/2494] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:09:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:09:15.675004 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c483e-bc5d-4c8c-86c5-a043e99c47e3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:09:15.676539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-481c483e-bc5d-4c8c-86c5-a043e99c47e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:09:15.754530 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c483e-bc5d-4c8c-86c5-a043e99c47e3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:09:15.759654 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a465bc4-4921-4591-9115-ea138272ae27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db99589bb504e8fa4068925badf3942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:09:15.760269 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a465bc4-4921-4591-9115-ea138272ae27 service placement] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:09:15.760547 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a465bc4-4921-4591-9115-ea138272ae27 service placement] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:09:15.760819 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a465bc4-4921-4591-9115-ea138272ae27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:09:15.762567 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4a465bc4-4921-4591-9115-ea138272ae27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:09:15.775023 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a465bc4-4921-4591-9115-ea138272ae27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:09:15.776608 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a465bc4-4921-4591-9115-ea138272ae27 service placement] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:09:15.786986 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1237/2495] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:09:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:09:20.223619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2fffc-fc90-4251-9d27-3f58b06a344d service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:09:20.234791 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2fffc-fc90-4251-9d27-3f58b06a344d service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:09:20.241788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6d47b-ed31-45d0-8885-664253d65460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:09:20.241788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6d47b-ed31-45d0-8885-664253d65460 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:09:20.241788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6d47b-ed31-45d0-8885-664253d65460 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:09:20.241788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6d47b-ed31-45d0-8885-664253d65460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:09:20.243051 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9ae6d47b-ed31-45d0-8885-664253d65460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:09:20.258542 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22ca53-a76f-4cca-8425-0234123574f2 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:09:20.259058 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22ca53-a76f-4cca-8425-0234123574f2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:09:20.259282 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22ca53-a76f-4cca-8425-0234123574f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:09:20.266895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6d47b-ed31-45d0-8885-664253d65460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:09:20.269561 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6d47b-ed31-45d0-8885-664253d65460 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:09:20.281743 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0d22ca53-a76f-4cca-8425-0234123574f2 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:09:20.281743 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0d22ca53-a76f-4cca-8425-0234123574f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:09:20.283468 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1259/2496] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:09:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:09:20.290321 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1238/2497] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 11:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:09:20.314297 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6d47b-ed31-45d0-8885-664253d65460 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:09:20.333348 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6d47b-ed31-45d0-8885-664253d65460 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:09:20.340753 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aeecc5-5f8d-4913-a3c0-0bee9ee870c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:09:20.341616 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aeecc5-5f8d-4913-a3c0-0bee9ee870c7 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:09:20.341975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aeecc5-5f8d-4913-a3c0-0bee9ee870c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:09:20.342320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aeecc5-5f8d-4913-a3c0-0bee9ee870c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:09:20.356436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aeecc5-5f8d-4913-a3c0-0bee9ee870c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:09:20.356436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aeecc5-5f8d-4913-a3c0-0bee9ee870c7 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:09:20.367612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1260/2498] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:09:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:09:27.895657 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3b0f7-0448-4a2b-9652-43cb8b344b4b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:09:27.896163 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3b0f7-0448-4a2b-9652-43cb8b344b4b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:09:27.896272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3b0f7-0448-4a2b-9652-43cb8b344b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:09:27.915693 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d5c3b0f7-0448-4a2b-9652-43cb8b344b4b None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:09:27.916913 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d5c3b0f7-0448-4a2b-9652-43cb8b344b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:09:27.925457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1239/2499] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 11:09:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:09:27.946891 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aeecc5-5f8d-4913-a3c0-0bee9ee870c7 service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:09:27.958619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aeecc5-5f8d-4913-a3c0-0bee9ee870c7 service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:09:27.964113 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a1360-44d3-4eb8-af88-bbf061c7edf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:09:27.964698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a1360-44d3-4eb8-af88-bbf061c7edf1 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:09:27.964973 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a1360-44d3-4eb8-af88-bbf061c7edf1 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:09:27.965242 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a1360-44d3-4eb8-af88-bbf061c7edf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:09:27.973228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a1360-44d3-4eb8-af88-bbf061c7edf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:09:27.974822 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a1360-44d3-4eb8-af88-bbf061c7edf1 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:09:27.985496 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1261/2500] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:09:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:09:32.796329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b78e7-4dee-4cec-ad74-44cf547890b5 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:09:32.796866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b78e7-4dee-4cec-ad74-44cf547890b5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:09:32.796999 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b78e7-4dee-4cec-ad74-44cf547890b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:09:32.817747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7c9b78e7-4dee-4cec-ad74-44cf547890b5 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:09:32.818919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7c9b78e7-4dee-4cec-ad74-44cf547890b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:09:32.826985 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1240/2501] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 11:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:09:32.862613 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a1360-44d3-4eb8-af88-bbf061c7edf1 service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:09:32.874174 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a1360-44d3-4eb8-af88-bbf061c7edf1 service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:09:32.880210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bdf4c-c40f-4de2-a877-640a437eef6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:09:32.880841 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bdf4c-c40f-4de2-a877-640a437eef6a service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:09:32.881128 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bdf4c-c40f-4de2-a877-640a437eef6a service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:09:32.881405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bdf4c-c40f-4de2-a877-640a437eef6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:09:32.889908 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bdf4c-c40f-4de2-a877-640a437eef6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:09:32.891566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575bdf4c-c40f-4de2-a877-640a437eef6a service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:09:32.901288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1262/2502] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:09:33.474454 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b78e7-4dee-4cec-ad74-44cf547890b5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:09:33.489744 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b78e7-4dee-4cec-ad74-44cf547890b5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:09:33.501922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed8a08-0116-4c84-9f6c-bd28487ec7f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:09:33.501922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed8a08-0116-4c84-9f6c-bd28487ec7f8 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:09:33.501922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed8a08-0116-4c84-9f6c-bd28487ec7f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:09:33.501922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed8a08-0116-4c84-9f6c-bd28487ec7f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:09:33.502301 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-95ed8a08-0116-4c84-9f6c-bd28487ec7f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:09:33.520589 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed8a08-0116-4c84-9f6c-bd28487ec7f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:09:33.522310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed8a08-0116-4c84-9f6c-bd28487ec7f8 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:09:33.534038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1241/2503] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:09:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:09:37.072258 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e37303-da7c-41cb-934c-8c5b10a04f06 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:09:37.072770 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e37303-da7c-41cb-934c-8c5b10a04f06 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:09:37.072879 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e37303-da7c-41cb-934c-8c5b10a04f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:09:37.092367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-48e37303-da7c-41cb-934c-8c5b10a04f06 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:09:37.093576 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-48e37303-da7c-41cb-934c-8c5b10a04f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:09:37.101687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1263/2504] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 11:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:09:37.122798 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed8a08-0116-4c84-9f6c-bd28487ec7f8 service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:09:37.134606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed8a08-0116-4c84-9f6c-bd28487ec7f8 service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:09:37.140035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d8da4-ef56-4b62-8b32-ebddb764ded0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:09:37.140623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d8da4-ef56-4b62-8b32-ebddb764ded0 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:09:37.140904 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d8da4-ef56-4b62-8b32-ebddb764ded0 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:09:37.141178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d8da4-ef56-4b62-8b32-ebddb764ded0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:09:37.149151 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d8da4-ef56-4b62-8b32-ebddb764ded0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:09:37.150709 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d8da4-ef56-4b62-8b32-ebddb764ded0 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:09:37.160306 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1242/2505] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:09:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:09:41.308033 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d6c4c-8b34-4fc2-a057-7da4eec945e7 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:09:41.308478 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d6c4c-8b34-4fc2-a057-7da4eec945e7 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:09:41.308592 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d6c4c-8b34-4fc2-a057-7da4eec945e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:09:41.329736 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e45d6c4c-8b34-4fc2-a057-7da4eec945e7 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:09:41.330960 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e45d6c4c-8b34-4fc2-a057-7da4eec945e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:09:41.338731 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1264/2506] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 11 11:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:09:41.366273 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d8da4-ef56-4b62-8b32-ebddb764ded0 service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:09:41.371968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=57 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:41.379047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d8da4-ef56-4b62-8b32-ebddb764ded0 service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:09:41.384663 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec304e-31e9-45b7-a7a4-371a632edb15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:09:41.389126 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec304e-31e9-45b7-a7a4-371a632edb15 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:09:41.389126 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec304e-31e9-45b7-a7a4-371a632edb15 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:09:41.389126 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec304e-31e9-45b7-a7a4-371a632edb15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:09:41.395201 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec304e-31e9-45b7-a7a4-371a632edb15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:09:41.396784 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec304e-31e9-45b7-a7a4-371a632edb15 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:09:41.406092 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1243/2507] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:09:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:09:47.589605 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f1e54-4c10-4c4f-ba2b-d3cb0669f536 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:09:47.590103 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f1e54-4c10-4c4f-ba2b-d3cb0669f536 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:09:47.590216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f1e54-4c10-4c4f-ba2b-d3cb0669f536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:09:47.597433 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=37 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:47.609450 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e94f1e54-4c10-4c4f-ba2b-d3cb0669f536 None None] MFA Rules not processed for user `ae05a859b3eb47e5ab60e39467b5ab06`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:09:47.611182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e94f1e54-4c10-4c4f-ba2b-d3cb0669f536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:09:47.664628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1265/2508] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:09:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:09:51.419162 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:57.698880 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=24 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:58.334818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec304e-31e9-45b7-a7a4-371a632edb15 service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:09:58.346448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec304e-31e9-45b7-a7a4-371a632edb15 service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:09:58.352297 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbebfe-4fe2-44bf-8a2a-05b4f1120c07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:09:58.352929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbebfe-4fe2-44bf-8a2a-05b4f1120c07 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:09:58.353209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbebfe-4fe2-44bf-8a2a-05b4f1120c07 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:09:58.353596 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbebfe-4fe2-44bf-8a2a-05b4f1120c07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:09:58.355452 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ebcbebfe-4fe2-44bf-8a2a-05b4f1120c07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:09:58.372017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbebfe-4fe2-44bf-8a2a-05b4f1120c07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:09:58.376440 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbebfe-4fe2-44bf-8a2a-05b4f1120c07 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:09:58.384839 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1244/2509] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:09:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:10:08.380049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:10:23.728284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f1e54-4c10-4c4f-ba2b-d3cb0669f536 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:10:23.772867 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f1e54-4c10-4c4f-ba2b-d3cb0669f536 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:10:23.778082 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86632c18-34f1-4f3f-93f1-faf8b9a0b802 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db99589bb504e8fa4068925badf3942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:10:23.778689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86632c18-34f1-4f3f-93f1-faf8b9a0b802 service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:10:23.779005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86632c18-34f1-4f3f-93f1-faf8b9a0b802 service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:10:23.779280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86632c18-34f1-4f3f-93f1-faf8b9a0b802 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:10:23.781673 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-86632c18-34f1-4f3f-93f1-faf8b9a0b802 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:10:23.814345 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86632c18-34f1-4f3f-93f1-faf8b9a0b802 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:10:23.816037 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86632c18-34f1-4f3f-93f1-faf8b9a0b802 service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:10:23.825876 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1266/2510] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:10:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:10:23.865708 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbebfe-4fe2-44bf-8a2a-05b4f1120c07 service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:10:23.867250 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ebcbebfe-4fe2-44bf-8a2a-05b4f1120c07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:10:23.947242 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbebfe-4fe2-44bf-8a2a-05b4f1120c07 service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:10:23.951841 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f6cbe-1058-4821-a02c-0afcfb4c2120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:10:23.952463 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f6cbe-1058-4821-a02c-0afcfb4c2120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:10:23.952746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f6cbe-1058-4821-a02c-0afcfb4c2120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:10:23.953589 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f6cbe-1058-4821-a02c-0afcfb4c2120 admin admin] PATH_INFO: `/v3/users/c656365b03324a80bb6f7f955176ae9a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:10:23.954704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f6cbe-1058-4821-a02c-0afcfb4c2120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c656365b03324a80bb6f7f955176ae9a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:10:23.956715 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f6cbe-1058-4821-a02c-0afcfb4c2120 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:10:24.197454 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e14f6cbe-1058-4821-a02c-0afcfb4c2120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c656365b03324a80bb6f7f955176ae9a'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:10:24.209745 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e14f6cbe-1058-4821-a02c-0afcfb4c2120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c656365b03324a80bb6f7f955176ae9a'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:10:24.210445 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e14f6cbe-1058-4821-a02c-0afcfb4c2120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c656365b03324a80bb6f7f955176ae9a'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:10:24.251940 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e14f6cbe-1058-4821-a02c-0afcfb4c2120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c656365b03324a80bb6f7f955176ae9a'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:10:24.259080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e14f6cbe-1058-4821-a02c-0afcfb4c2120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c656365b03324a80bb6f7f955176ae9a'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:10:24.264970 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1245/2511] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:10:23 2022] DELETE /identity/v3/users/c656365b03324a80bb6f7f955176ae9a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:10:24.499240 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86632c18-34f1-4f3f-93f1-faf8b9a0b802 service placement] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:10:24.514483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86632c18-34f1-4f3f-93f1-faf8b9a0b802 service placement] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:10:24.567777 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75c9f9-85d2-44e5-99bc-a3808d923dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:10:24.568398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75c9f9-85d2-44e5-99bc-a3808d923dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:10:24.568677 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75c9f9-85d2-44e5-99bc-a3808d923dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:10:24.568945 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75c9f9-85d2-44e5-99bc-a3808d923dd4 admin admin] PATH_INFO: `/v3/projects/9206aabb32384f78aa9e9632e43bbf2f` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:10:24.570045 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75c9f9-85d2-44e5-99bc-a3808d923dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9206aabb32384f78aa9e9632e43bbf2f)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:10:24.571959 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75c9f9-85d2-44e5-99bc-a3808d923dd4 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:10:24.657265 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0f75c9f9-85d2-44e5-99bc-a3808d923dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9206aabb32384f78aa9e9632e43bbf2f', 'request_id': 'req-0f75c9f9-85d2-44e5-99bc-a3808d923dd4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:10:24.662636 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0f75c9f9-85d2-44e5-99bc-a3808d923dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9206aabb32384f78aa9e9632e43bbf2f', 'request_id': 'req-0f75c9f9-85d2-44e5-99bc-a3808d923dd4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:10:24.709058 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0f75c9f9-85d2-44e5-99bc-a3808d923dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9206aabb32384f78aa9e9632e43bbf2f', 'request_id': 'req-0f75c9f9-85d2-44e5-99bc-a3808d923dd4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:10:24.721005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0f75c9f9-85d2-44e5-99bc-a3808d923dd4 admin admin] The token cache is being invalidate because project 9206aabb32384f78aa9e9632e43bbf2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:10:24.721290 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0f75c9f9-85d2-44e5-99bc-a3808d923dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:10:24.721934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0f75c9f9-85d2-44e5-99bc-a3808d923dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:10:24.723436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1267/2512] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:10:24 2022] DELETE /identity/v3/projects/9206aabb32384f78aa9e9632e43bbf2f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:10:24.732698 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f38d6f-84bb-4cf8-ba12-783138283e67 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:10:24.732995 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f38d6f-84bb-4cf8-ba12-783138283e67 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:10:24.733275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f38d6f-84bb-4cf8-ba12-783138283e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:10:24.791914 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b3f38d6f-84bb-4cf8-ba12-783138283e67 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:10:24.793061 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b3f38d6f-84bb-4cf8-ba12-783138283e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:10:24.826043 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:10:24.851654 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1246/2513] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:10:24.860147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7686076-967b-49f6-bf76-0132bb768d1d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:10:24.860641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7686076-967b-49f6-bf76-0132bb768d1d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:10:24.860763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7686076-967b-49f6-bf76-0132bb768d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:10:24.879885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e7686076-967b-49f6-bf76-0132bb768d1d None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:10:24.881072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e7686076-967b-49f6-bf76-0132bb768d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:10:24.888962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1268/2514] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:10:24.893167 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f38d6f-84bb-4cf8-ba12-783138283e67 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:10:24.902972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f38d6f-84bb-4cf8-ba12-783138283e67 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:10:24.908332 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30055b8b-c4f7-4001-9268-1d688bfb3f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:10:24.908930 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30055b8b-c4f7-4001-9268-1d688bfb3f50 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:10:24.909207 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30055b8b-c4f7-4001-9268-1d688bfb3f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:10:24.909477 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30055b8b-c4f7-4001-9268-1d688bfb3f50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:10:24.910119 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30055b8b-c4f7-4001-9268-1d688bfb3f50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:10:24.910419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30055b8b-c4f7-4001-9268-1d688bfb3f50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:10:24.912869 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30055b8b-c4f7-4001-9268-1d688bfb3f50 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:10:24.924941 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1247/2515] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 11:10:24.929158 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7686076-967b-49f6-bf76-0132bb768d1d None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:10:24.938222 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7686076-967b-49f6-bf76-0132bb768d1d None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:10:24.942913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a17e8-b9f4-4abb-812f-59ed1a6aa2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:10:24.943515 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a17e8-b9f4-4abb-812f-59ed1a6aa2b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:10:24.943790 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a17e8-b9f4-4abb-812f-59ed1a6aa2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:10:24.944061 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a17e8-b9f4-4abb-812f-59ed1a6aa2b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:10:24.944685 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a17e8-b9f4-4abb-812f-59ed1a6aa2b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:10:24.946613 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a17e8-b9f4-4abb-812f-59ed1a6aa2b7 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:10:24.967246 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:10:25.032095 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1269/2516] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:10:24 2022] POST /identity/v3/projects => generated 397 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:10:25.036449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30055b8b-c4f7-4001-9268-1d688bfb3f50 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:10:25.046618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30055b8b-c4f7-4001-9268-1d688bfb3f50 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:10:25.103222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767264fa-ee9a-4960-8b2c-55399ffa7650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:10:25.103826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767264fa-ee9a-4960-8b2c-55399ffa7650 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:10:25.104108 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767264fa-ee9a-4960-8b2c-55399ffa7650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:10:25.104388 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767264fa-ee9a-4960-8b2c-55399ffa7650 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:10:25.104996 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767264fa-ee9a-4960-8b2c-55399ffa7650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:10:25.106948 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767264fa-ee9a-4960-8b2c-55399ffa7650 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:10:25.189032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1248/2517] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:10:25 2022] POST /identity/v3/users => generated 299 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:10:25.193081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a17e8-b9f4-4abb-812f-59ed1a6aa2b7 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:10:25.204304 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a17e8-b9f4-4abb-812f-59ed1a6aa2b7 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:10:25.208960 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867790fd-f765-4e0d-821a-2961ed6a9135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:10:25.209552 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867790fd-f765-4e0d-821a-2961ed6a9135 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:10:25.209830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867790fd-f765-4e0d-821a-2961ed6a9135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:10:25.210100 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867790fd-f765-4e0d-821a-2961ed6a9135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:10:25.210820 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867790fd-f765-4e0d-821a-2961ed6a9135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:10:25.215562 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867790fd-f765-4e0d-821a-2961ed6a9135 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:10:25.223745 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1270/2518] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:10:25.227882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767264fa-ee9a-4960-8b2c-55399ffa7650 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:10:25.238343 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767264fa-ee9a-4960-8b2c-55399ffa7650 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:10:25.243145 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185581d9-a40b-4ee6-a53a-74100f8110aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:10:25.243733 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185581d9-a40b-4ee6-a53a-74100f8110aa admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:10:25.244014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185581d9-a40b-4ee6-a53a-74100f8110aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:10:25.244285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185581d9-a40b-4ee6-a53a-74100f8110aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:10:25.244942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185581d9-a40b-4ee6-a53a-74100f8110aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:10:25.246561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185581d9-a40b-4ee6-a53a-74100f8110aa admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:10:25.257375 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1249/2519] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:10:25.261466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867790fd-f765-4e0d-821a-2961ed6a9135 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:10:25.272280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867790fd-f765-4e0d-821a-2961ed6a9135 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:10:25.276917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d0a97-3ecb-49f7-9044-62c753c07e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:10:25.277574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d0a97-3ecb-49f7-9044-62c753c07e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:10:25.277846 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d0a97-3ecb-49f7-9044-62c753c07e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:10:25.278123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d0a97-3ecb-49f7-9044-62c753c07e62 admin admin] PATH_INFO: `/v3/projects/d1d50f23f5674fddaf53452927385253/users/593f8124c5e344aba39b8e8016344567/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:10:25.293497 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d0a97-3ecb-49f7-9044-62c753c07e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d50f23f5674fddaf53452927385253, user_id=593f8124c5e344aba39b8e8016344567, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:10:25.296215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d0a97-3ecb-49f7-9044-62c753c07e62 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:10:25.378147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1271/2520] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:10:25 2022] PUT /identity/v3/projects/d1d50f23f5674fddaf53452927385253/users/593f8124c5e344aba39b8e8016344567/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:10:25.389752 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988a91c-5ded-417a-a928-7833cca18d93 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:10:25.390044 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988a91c-5ded-417a-a928-7833cca18d93 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:10:25.390403 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988a91c-5ded-417a-a928-7833cca18d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:10:25.419195 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4988a91c-5ded-417a-a928-7833cca18d93 None None] MFA Rules not processed for user `593f8124c5e344aba39b8e8016344567`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:10:25.420391 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4988a91c-5ded-417a-a928-7833cca18d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:10:25.482200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1250/2521] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:10:25 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:10:25.494503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d0a97-3ecb-49f7-9044-62c753c07e62 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:10:25.496185 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-186d0a97-3ecb-49f7-9044-62c753c07e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:10:25.570775 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d0a97-3ecb-49f7-9044-62c753c07e62 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:10:25.574315 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcb14d-33be-422c-af11-dfa522271d4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:10:25.574940 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcb14d-33be-422c-af11-dfa522271d4d service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:10:25.575215 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcb14d-33be-422c-af11-dfa522271d4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:10:25.575484 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcb14d-33be-422c-af11-dfa522271d4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:10:25.583589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adcb14d-33be-422c-af11-dfa522271d4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:10:25.585016 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adcb14d-33be-422c-af11-dfa522271d4d service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:10:25.593946 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1272/2522] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:10:25 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:10:32.449005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988a91c-5ded-417a-a928-7833cca18d93 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:10:32.488569 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:10:32.511496 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988a91c-5ded-417a-a928-7833cca18d93 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:10:32.517619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4452cb-e2bf-416b-a873-8cd403f65b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:10:32.518259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4452cb-e2bf-416b-a873-8cd403f65b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:10:32.518572 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4452cb-e2bf-416b-a873-8cd403f65b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:10:32.518894 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4452cb-e2bf-416b-a873-8cd403f65b9d admin admin] PATH_INFO: `/v3/users/593f8124c5e344aba39b8e8016344567` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:10:32.519995 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4452cb-e2bf-416b-a873-8cd403f65b9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=593f8124c5e344aba39b8e8016344567)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:10:32.521967 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4452cb-e2bf-416b-a873-8cd403f65b9d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:10:32.676535 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5b4452cb-e2bf-416b-a873-8cd403f65b9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '593f8124c5e344aba39b8e8016344567'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:10:32.688074 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5b4452cb-e2bf-416b-a873-8cd403f65b9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '593f8124c5e344aba39b8e8016344567'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:10:32.688739 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5b4452cb-e2bf-416b-a873-8cd403f65b9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '593f8124c5e344aba39b8e8016344567'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:10:32.737811 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5b4452cb-e2bf-416b-a873-8cd403f65b9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '593f8124c5e344aba39b8e8016344567'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:10:32.745106 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5b4452cb-e2bf-416b-a873-8cd403f65b9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '593f8124c5e344aba39b8e8016344567'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:10:32.751092 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1251/2523] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:10:32 2022] DELETE /identity/v3/users/593f8124c5e344aba39b8e8016344567 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:10:32.755626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19290b21-6e50-4291-b962-b3778fa0dd67 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:10:32.756124 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19290b21-6e50-4291-b962-b3778fa0dd67 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:10:32.756234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19290b21-6e50-4291-b962-b3778fa0dd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:10:32.775432 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-19290b21-6e50-4291-b962-b3778fa0dd67 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:10:32.777972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-19290b21-6e50-4291-b962-b3778fa0dd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:10:32.837789 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1273/2524] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:10:32.847482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4452cb-e2bf-416b-a873-8cd403f65b9d admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:10:32.848937 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5b4452cb-e2bf-416b-a873-8cd403f65b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:10:32.928999 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4452cb-e2bf-416b-a873-8cd403f65b9d admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:10:32.932599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783517b9-244e-44bb-a3a6-2b1936b92db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:10:32.933200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783517b9-244e-44bb-a3a6-2b1936b92db1 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:10:32.933483 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783517b9-244e-44bb-a3a6-2b1936b92db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:10:32.933759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783517b9-244e-44bb-a3a6-2b1936b92db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:10:32.943083 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783517b9-244e-44bb-a3a6-2b1936b92db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:10:32.944512 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783517b9-244e-44bb-a3a6-2b1936b92db1 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:10:32.954074 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1252/2525] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:10:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:10:33.356742 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19290b21-6e50-4291-b962-b3778fa0dd67 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:10:33.362936 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-19290b21-6e50-4291-b962-b3778fa0dd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:10:33.374661 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19290b21-6e50-4291-b962-b3778fa0dd67 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:10:33.380629 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b64b8-85a2-493e-b766-b843341ce578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:10:33.383278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b64b8-85a2-493e-b766-b843341ce578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:10:33.383278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b64b8-85a2-493e-b766-b843341ce578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:10:33.383278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b64b8-85a2-493e-b766-b843341ce578 admin admin] PATH_INFO: `/v3/projects/d1d50f23f5674fddaf53452927385253` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:10:33.383278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b64b8-85a2-493e-b766-b843341ce578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d50f23f5674fddaf53452927385253)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:10:33.385218 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b64b8-85a2-493e-b766-b843341ce578 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:10:33.465970 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:10:33.475947 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0b8b64b8-85a2-493e-b766-b843341ce578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d50f23f5674fddaf53452927385253', 'request_id': 'req-0b8b64b8-85a2-493e-b766-b843341ce578'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:10:33.481207 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0b8b64b8-85a2-493e-b766-b843341ce578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d50f23f5674fddaf53452927385253', 'request_id': 'req-0b8b64b8-85a2-493e-b766-b843341ce578'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:10:33.545078 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0b8b64b8-85a2-493e-b766-b843341ce578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d50f23f5674fddaf53452927385253', 'request_id': 'req-0b8b64b8-85a2-493e-b766-b843341ce578'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:10:33.557737 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0b8b64b8-85a2-493e-b766-b843341ce578 admin admin] The token cache is being invalidate because project d1d50f23f5674fddaf53452927385253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:10:33.558208 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0b8b64b8-85a2-493e-b766-b843341ce578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:10:33.558932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-0b8b64b8-85a2-493e-b766-b843341ce578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:10:33.561014 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1274/2526] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:10:33 2022] DELETE /identity/v3/projects/d1d50f23f5674fddaf53452927385253 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:10:42.949775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=72,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:10:43.629073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=5,keystone:SELECT=11,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:10:44.686737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b9ab6-d55f-46da-9a83-028008ab81bb None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:10:44.687383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b9ab6-d55f-46da-9a83-028008ab81bb None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:10:44.687383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b9ab6-d55f-46da-9a83-028008ab81bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:10:44.706956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f10b9ab6-d55f-46da-9a83-028008ab81bb None None] MFA Rules not processed for user `950e6ba9e8ed4e00843657869bc3a26d`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:10:44.708177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f10b9ab6-d55f-46da-9a83-028008ab81bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:10:44.764249 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1253/2527] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:10:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:10:53.490810 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b64b8-85a2-493e-b766-b843341ce578 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:10:53.493956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-0b8b64b8-85a2-493e-b766-b843341ce578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:10:53.554273 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b64b8-85a2-493e-b766-b843341ce578 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:10:53.558080 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85515d-c2c4-45af-a649-a89de562eb6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:10:53.558806 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85515d-c2c4-45af-a649-a89de562eb6c service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:10:53.559148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85515d-c2c4-45af-a649-a89de562eb6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:10:53.559430 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85515d-c2c4-45af-a649-a89de562eb6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:10:53.561892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4e85515d-c2c4-45af-a649-a89de562eb6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:10:53.623311 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85515d-c2c4-45af-a649-a89de562eb6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:10:53.625550 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85515d-c2c4-45af-a649-a89de562eb6c service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:10:53.634680 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1275/2528] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:10:53 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:10:54.757479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=25 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:10:56.566369 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b9ab6-d55f-46da-9a83-028008ab81bb None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:10:56.568050 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f10b9ab6-d55f-46da-9a83-028008ab81bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:10:56.645800 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b9ab6-d55f-46da-9a83-028008ab81bb None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:10:56.651490 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426b107-d9e9-41c1-8357-fceed1c0eedc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:10:56.652117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426b107-d9e9-41c1-8357-fceed1c0eedc service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:10:56.652412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426b107-d9e9-41c1-8357-fceed1c0eedc service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:10:56.652679 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426b107-d9e9-41c1-8357-fceed1c0eedc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:10:56.654471 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9426b107-d9e9-41c1-8357-fceed1c0eedc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:10:56.668199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426b107-d9e9-41c1-8357-fceed1c0eedc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:10:56.669813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426b107-d9e9-41c1-8357-fceed1c0eedc service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:10:56.683610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1254/2529] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:10:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:11:03.630796 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=48 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:11:06.677817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=34 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:11:12.624641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21059e57-beae-4d0b-aedf-a7f7d4d5e355 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:12.625160 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21059e57-beae-4d0b-aedf-a7f7d4d5e355 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:12.625282 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21059e57-beae-4d0b-aedf-a7f7d4d5e355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:12.654864 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-21059e57-beae-4d0b-aedf-a7f7d4d5e355 None None] MFA Rules not processed for user `9751264123914c27b961009f75067660`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:11:12.656062 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-21059e57-beae-4d0b-aedf-a7f7d4d5e355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:11:12.710305 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1276/2530] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Aug 11 11:11:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:11:12.855087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426b107-d9e9-41c1-8357-fceed1c0eedc service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:11:12.857882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9426b107-d9e9-41c1-8357-fceed1c0eedc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:11:12.929265 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426b107-d9e9-41c1-8357-fceed1c0eedc service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:11:12.934412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc166df-a5a1-488d-9fc9-9a5cd6f8af5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd25d1bde0c4703b61e0edaf5b658d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:11:12.935328 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc166df-a5a1-488d-9fc9-9a5cd6f8af5a service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:12.935612 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc166df-a5a1-488d-9fc9-9a5cd6f8af5a service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:12.935889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc166df-a5a1-488d-9fc9-9a5cd6f8af5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:12.944331 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc166df-a5a1-488d-9fc9-9a5cd6f8af5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:11:12.946020 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc166df-a5a1-488d-9fc9-9a5cd6f8af5a service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:11:12.955408 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1255/2531] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Aug 11 11:11:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 11:11:18.721680 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21059e57-beae-4d0b-aedf-a7f7d4d5e355 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:11:18.723234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-21059e57-beae-4d0b-aedf-a7f7d4d5e355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:11:18.790546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21059e57-beae-4d0b-aedf-a7f7d4d5e355 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:11:18.795126 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a3732-b567-47a9-a4f8-7d0f6bcf03dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:11:18.795734 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a3732-b567-47a9-a4f8-7d0f6bcf03dd service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:18.796011 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a3732-b567-47a9-a4f8-7d0f6bcf03dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:18.796283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a3732-b567-47a9-a4f8-7d0f6bcf03dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:18.798016 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6c8a3732-b567-47a9-a4f8-7d0f6bcf03dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:11:18.863625 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a3732-b567-47a9-a4f8-7d0f6bcf03dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:11:18.865057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a3732-b567-47a9-a4f8-7d0f6bcf03dd service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:11:18.874608 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1277/2532] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:11:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:11:22.951993 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=32 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:11:23.614616 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc166df-a5a1-488d-9fc9-9a5cd6f8af5a service swift] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:11:23.616884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5bc166df-a5a1-488d-9fc9-9a5cd6f8af5a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:11:23.631166 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc166df-a5a1-488d-9fc9-9a5cd6f8af5a service swift] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:11:23.635782 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a16370-952c-4432-8668-bed2195c98f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:11:23.636408 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a16370-952c-4432-8668-bed2195c98f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:23.636690 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a16370-952c-4432-8668-bed2195c98f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:23.636965 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a16370-952c-4432-8668-bed2195c98f6 admin admin] PATH_INFO: `/v3/users/ae05a859b3eb47e5ab60e39467b5ab06` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:23.638282 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a16370-952c-4432-8668-bed2195c98f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae05a859b3eb47e5ab60e39467b5ab06)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:11:23.640266 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a16370-952c-4432-8668-bed2195c98f6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:11:23.899235 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e6a16370-952c-4432-8668-bed2195c98f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae05a859b3eb47e5ab60e39467b5ab06'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:11:23.913176 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e6a16370-952c-4432-8668-bed2195c98f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae05a859b3eb47e5ab60e39467b5ab06'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:11:23.916684 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e6a16370-952c-4432-8668-bed2195c98f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae05a859b3eb47e5ab60e39467b5ab06'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:11:23.999026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e6a16370-952c-4432-8668-bed2195c98f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae05a859b3eb47e5ab60e39467b5ab06'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:11:24.006740 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e6a16370-952c-4432-8668-bed2195c98f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae05a859b3eb47e5ab60e39467b5ab06'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:11:24.013688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1256/2533] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:11:23 2022] DELETE /identity/v3/users/ae05a859b3eb47e5ab60e39467b5ab06 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:11:24.289514 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a3732-b567-47a9-a4f8-7d0f6bcf03dd service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:11:24.299878 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a3732-b567-47a9-a4f8-7d0f6bcf03dd service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:11:24.348916 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:11:24.362346 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69259c19-336a-41c8-9748-aff62dbe9b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:11:24.363167 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69259c19-336a-41c8-9748-aff62dbe9b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:24.363488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69259c19-336a-41c8-9748-aff62dbe9b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:24.363765 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69259c19-336a-41c8-9748-aff62dbe9b03 admin admin] PATH_INFO: `/v3/projects/83ea8686ce044a86af451e3d4119dc7e` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:24.364919 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69259c19-336a-41c8-9748-aff62dbe9b03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ea8686ce044a86af451e3d4119dc7e)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:11:24.366947 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69259c19-336a-41c8-9748-aff62dbe9b03 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:11:24.502876 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-69259c19-336a-41c8-9748-aff62dbe9b03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ea8686ce044a86af451e3d4119dc7e', 'request_id': 'req-69259c19-336a-41c8-9748-aff62dbe9b03'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:11:24.508415 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-69259c19-336a-41c8-9748-aff62dbe9b03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ea8686ce044a86af451e3d4119dc7e', 'request_id': 'req-69259c19-336a-41c8-9748-aff62dbe9b03'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:11:24.593493 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-69259c19-336a-41c8-9748-aff62dbe9b03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ea8686ce044a86af451e3d4119dc7e', 'request_id': 'req-69259c19-336a-41c8-9748-aff62dbe9b03'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:11:24.605545 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-69259c19-336a-41c8-9748-aff62dbe9b03 admin admin] The token cache is being invalidate because project 83ea8686ce044a86af451e3d4119dc7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:11:24.605835 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-69259c19-336a-41c8-9748-aff62dbe9b03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:11:24.607201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-69259c19-336a-41c8-9748-aff62dbe9b03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:11:24.608971 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1278/2534] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:11:24 2022] DELETE /identity/v3/projects/83ea8686ce044a86af451e3d4119dc7e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:11:24.613959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2d475-3e2f-464b-8593-af66e2c9874a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:24.614252 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2d475-3e2f-464b-8593-af66e2c9874a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:24.614532 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2d475-3e2f-464b-8593-af66e2c9874a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:24.634635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-64b2d475-3e2f-464b-8593-af66e2c9874a None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:11:24.635872 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-64b2d475-3e2f-464b-8593-af66e2c9874a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:11:24.696134 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1257/2535] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:11:24.704456 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db6569-e80f-4322-80bb-04d184e85df1 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:24.704741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db6569-e80f-4322-80bb-04d184e85df1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:24.705012 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db6569-e80f-4322-80bb-04d184e85df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:24.724731 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a4db6569-e80f-4322-80bb-04d184e85df1 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:11:24.725945 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a4db6569-e80f-4322-80bb-04d184e85df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:11:24.735061 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1279/2536] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:11:24.739419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2d475-3e2f-464b-8593-af66e2c9874a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:11:24.749535 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2d475-3e2f-464b-8593-af66e2c9874a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:11:24.755634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb28c43-4f06-46f4-92f4-093d8e9854ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:11:24.755634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb28c43-4f06-46f4-92f4-093d8e9854ed admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:24.755634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb28c43-4f06-46f4-92f4-093d8e9854ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:24.755634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb28c43-4f06-46f4-92f4-093d8e9854ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:24.756110 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb28c43-4f06-46f4-92f4-093d8e9854ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:11:24.756335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb28c43-4f06-46f4-92f4-093d8e9854ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:11:24.757931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb28c43-4f06-46f4-92f4-093d8e9854ed admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:11:24.770372 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1258/2537] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:11:24.774787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db6569-e80f-4322-80bb-04d184e85df1 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:11:24.785125 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db6569-e80f-4322-80bb-04d184e85df1 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:11:24.789848 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7903a-cf06-406b-9d78-d50cd741b2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:11:24.790444 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7903a-cf06-406b-9d78-d50cd741b2c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:24.790724 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7903a-cf06-406b-9d78-d50cd741b2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:24.791034 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7903a-cf06-406b-9d78-d50cd741b2c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:24.791698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7903a-cf06-406b-9d78-d50cd741b2c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:11:24.794244 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7903a-cf06-406b-9d78-d50cd741b2c8 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:11:24.897985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1280/2538] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:11:24 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:11:24.902129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb28c43-4f06-46f4-92f4-093d8e9854ed admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:11:24.912801 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb28c43-4f06-46f4-92f4-093d8e9854ed admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:11:24.974211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6473da-1eda-4d4f-a78d-3f7f785e2118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:11:24.974884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6473da-1eda-4d4f-a78d-3f7f785e2118 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:24.975172 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6473da-1eda-4d4f-a78d-3f7f785e2118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:24.975449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6473da-1eda-4d4f-a78d-3f7f785e2118 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:24.976081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6473da-1eda-4d4f-a78d-3f7f785e2118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:11:24.978007 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6473da-1eda-4d4f-a78d-3f7f785e2118 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:11:24.986485 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:11:25.102455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1259/2539] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:11:24 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:11:25.106636 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7903a-cf06-406b-9d78-d50cd741b2c8 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:11:25.117352 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7903a-cf06-406b-9d78-d50cd741b2c8 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:11:25.122567 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec926a78-1d3d-48ad-91ae-44263c92ad33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:11:25.123237 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec926a78-1d3d-48ad-91ae-44263c92ad33 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:25.123522 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec926a78-1d3d-48ad-91ae-44263c92ad33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:25.123795 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec926a78-1d3d-48ad-91ae-44263c92ad33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:25.124461 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec926a78-1d3d-48ad-91ae-44263c92ad33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:11:25.126040 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec926a78-1d3d-48ad-91ae-44263c92ad33 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:11:25.136288 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1281/2540] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:11:25.141044 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6473da-1eda-4d4f-a78d-3f7f785e2118 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:11:25.151009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6473da-1eda-4d4f-a78d-3f7f785e2118 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:11:25.155821 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a097fb0-ddce-4cca-9868-7e485387acff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:11:25.156428 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a097fb0-ddce-4cca-9868-7e485387acff admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:25.156709 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a097fb0-ddce-4cca-9868-7e485387acff admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:25.156989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a097fb0-ddce-4cca-9868-7e485387acff admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:25.157658 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a097fb0-ddce-4cca-9868-7e485387acff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:11:25.159285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a097fb0-ddce-4cca-9868-7e485387acff admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:11:25.170267 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1260/2541] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:11:25.174316 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec926a78-1d3d-48ad-91ae-44263c92ad33 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:11:25.185564 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec926a78-1d3d-48ad-91ae-44263c92ad33 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:11:25.190631 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b3fad-bf22-46d7-98ea-7159859ce434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:11:25.191331 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b3fad-bf22-46d7-98ea-7159859ce434 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:25.191637 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b3fad-bf22-46d7-98ea-7159859ce434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:25.191921 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b3fad-bf22-46d7-98ea-7159859ce434 admin admin] PATH_INFO: `/v3/projects/a717713f93744790b021bb6b6440d86c/users/39a12126a08341089f09877ad8e31484/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:25.208839 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b3fad-bf22-46d7-98ea-7159859ce434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a717713f93744790b021bb6b6440d86c, user_id=39a12126a08341089f09877ad8e31484, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:11:25.211593 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b3fad-bf22-46d7-98ea-7159859ce434 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:11:25.353904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1282/2542] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:11:25 2022] PUT /identity/v3/projects/a717713f93744790b021bb6b6440d86c/users/39a12126a08341089f09877ad8e31484/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:11:25.360221 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70c326-9767-433e-bc9c-cad7e7e9a859 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:25.361052 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70c326-9767-433e-bc9c-cad7e7e9a859 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:25.361340 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70c326-9767-433e-bc9c-cad7e7e9a859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:25.380787 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5c70c326-9767-433e-bc9c-cad7e7e9a859 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:11:25.381988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5c70c326-9767-433e-bc9c-cad7e7e9a859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:11:25.442663 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1261/2543] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:11:25.452498 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b3fad-bf22-46d7-98ea-7159859ce434 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:11:25.454897 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3e6b3fad-bf22-46d7-98ea-7159859ce434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:11:25.639749 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b3fad-bf22-46d7-98ea-7159859ce434 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:11:25.643352 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9266cad-5b8c-4532-a9b4-8ddd36e9be1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:11:25.643952 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9266cad-5b8c-4532-a9b4-8ddd36e9be1c service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:25.644234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9266cad-5b8c-4532-a9b4-8ddd36e9be1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:25.644506 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9266cad-5b8c-4532-a9b4-8ddd36e9be1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:25.653830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9266cad-5b8c-4532-a9b4-8ddd36e9be1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:11:25.655295 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9266cad-5b8c-4532-a9b4-8ddd36e9be1c service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:11:25.664436 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1283/2544] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:11:30.790144 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1c56-96e4-4bad-8926-a725d4645540 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:30.790637 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1c56-96e4-4bad-8926-a725d4645540 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:30.790920 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1c56-96e4-4bad-8926-a725d4645540 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:30.792600 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1262/2545] 10.222.0.43 () {54 vars in 921 bytes} [Thu Aug 11 11:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:11:30.800030 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f93a6e-dbfc-4078-8446-88d3c0297827 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:30.800982 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f93a6e-dbfc-4078-8446-88d3c0297827 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:30.801424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f93a6e-dbfc-4078-8446-88d3c0297827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:30.828990 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f8f93a6e-dbfc-4078-8446-88d3c0297827 None None] MFA Rules not processed for user `9267752ac6724013bc1edcdecff48dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:11:30.831162 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f8f93a6e-dbfc-4078-8446-88d3c0297827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:11:30.845121 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:11:30.924637 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1284/2546] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Aug 11 11:11:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:11:30.944093 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb1c56-96e4-4bad-8926-a725d4645540 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:11:30.946557 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5bbb1c56-96e4-4bad-8926-a725d4645540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:11:31.024266 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb1c56-96e4-4bad-8926-a725d4645540 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:11:31.029388 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5267a8-eb4c-4229-b791-688fc34abd0c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fe013f66e2452eaaf84d4b52eca489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:11:31.030264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5267a8-eb4c-4229-b791-688fc34abd0c service glance] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:31.030666 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5267a8-eb4c-4229-b791-688fc34abd0c service glance] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:31.031180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5267a8-eb4c-4229-b791-688fc34abd0c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:31.046283 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5267a8-eb4c-4229-b791-688fc34abd0c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:11:31.047763 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5267a8-eb4c-4229-b791-688fc34abd0c service glance] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:11:31.059081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1263/2547] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:11:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:11:31.320632 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4888a0f-375f-44f6-ba65-a8c0e4635b69 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:31.321116 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4888a0f-375f-44f6-ba65-a8c0e4635b69 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:31.321457 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4888a0f-375f-44f6-ba65-a8c0e4635b69 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:31.323318 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1285/2548] 10.222.0.43 () {54 vars in 921 bytes} [Thu Aug 11 11:11:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:11:31.328896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ad6ea-8ae4-4181-a7d9-ff6ec54b7e43 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:31.329225 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ad6ea-8ae4-4181-a7d9-ff6ec54b7e43 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:31.329510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8ad6ea-8ae4-4181-a7d9-ff6ec54b7e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:31.355049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-af8ad6ea-8ae4-4181-a7d9-ff6ec54b7e43 None None] MFA Rules not processed for user `6302b1f98544470a8986055a68bcd948`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:11:31.356830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-af8ad6ea-8ae4-4181-a7d9-ff6ec54b7e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:11:31.398545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1264/2549] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Aug 11 11:11:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:11:31.413476 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4888a0f-375f-44f6-ba65-a8c0e4635b69 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:11:31.415356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f4888a0f-375f-44f6-ba65-a8c0e4635b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:11:31.433159 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4888a0f-375f-44f6-ba65-a8c0e4635b69 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:11:31.439685 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80bea2-a94f-4527-895c-0e0ac0c5e800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:11:31.440309 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80bea2-a94f-4527-895c-0e0ac0c5e800 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:31.440588 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80bea2-a94f-4527-895c-0e0ac0c5e800 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:31.440909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80bea2-a94f-4527-895c-0e0ac0c5e800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:31.449134 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80bea2-a94f-4527-895c-0e0ac0c5e800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:11:31.451455 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80bea2-a94f-4527-895c-0e0ac0c5e800 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:11:31.461779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1286/2550] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:11:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:11:31.561643 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015433f4-bf2a-4327-9a7d-c3e86cbd085c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:31.563437 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bd2fe-4d9b-46cf-949a-057fd13f8f54 None None] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:31.566931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bd2fe-4d9b-46cf-949a-057fd13f8f54 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:31.566931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bd2fe-4d9b-46cf-949a-057fd13f8f54 None None] PATH_INFO: `/` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:31.566931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1287/2551] 10.222.0.43 () {54 vars in 921 bytes} [Thu Aug 11 11:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 11 11:11:31.567343 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015433f4-bf2a-4327-9a7d-c3e86cbd085c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:31.567343 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015433f4-bf2a-4327-9a7d-c3e86cbd085c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:31.572221 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d085891-9940-40d2-9ff2-bc7b09574634 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:31.572622 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d085891-9940-40d2-9ff2-bc7b09574634 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:31.573080 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d085891-9940-40d2-9ff2-bc7b09574634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:31.602197 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-015433f4-bf2a-4327-9a7d-c3e86cbd085c None None] MFA Rules not processed for user `39a12126a08341089f09877ad8e31484`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:11:31.603469 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-015433f4-bf2a-4327-9a7d-c3e86cbd085c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:11:31.624293 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-7d085891-9940-40d2-9ff2-bc7b09574634 None None] MFA Rules not processed for user `9267752ac6724013bc1edcdecff48dd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:11:31.625538 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7d085891-9940-40d2-9ff2-bc7b09574634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:11:31.638548 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1288/2552] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Aug 11 11:11:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:11:31.657239 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d085891-9940-40d2-9ff2-bc7b09574634 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:11:31.667185 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d085891-9940-40d2-9ff2-bc7b09574634 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:11:31.672928 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf33368-2ede-4f0a-bb37-abd8563c0a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:11:31.673544 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf33368-2ede-4f0a-bb37-abd8563c0a5b service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:31.673826 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf33368-2ede-4f0a-bb37-abd8563c0a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:31.674095 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf33368-2ede-4f0a-bb37-abd8563c0a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:31.685997 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf33368-2ede-4f0a-bb37-abd8563c0a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:11:31.686242 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1265/2553] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:11:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:11:31.687653 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf33368-2ede-4f0a-bb37-abd8563c0a5b service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:11:31.701185 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015433f4-bf2a-4327-9a7d-c3e86cbd085c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:11:31.701805 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1289/2554] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:11:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:11:31.703226 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-015433f4-bf2a-4327-9a7d-c3e86cbd085c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:11:31.715771 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:11:31.721933 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015433f4-bf2a-4327-9a7d-c3e86cbd085c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:11:31.728045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2ec7e-7364-4e3b-92ac-4bc9ab27cd71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:11:31.728802 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2ec7e-7364-4e3b-92ac-4bc9ab27cd71 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:31.729178 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2ec7e-7364-4e3b-92ac-4bc9ab27cd71 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:31.729538 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2ec7e-7364-4e3b-92ac-4bc9ab27cd71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:31.739804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2ec7e-7364-4e3b-92ac-4bc9ab27cd71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:11:31.741433 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2ec7e-7364-4e3b-92ac-4bc9ab27cd71 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:11:31.753575 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1266/2555] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:11:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:11:34.235961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fc1c8-a990-4d46-b932-6c2bc561f269 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:34.236430 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fc1c8-a990-4d46-b932-6c2bc561f269 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:34.236532 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fc1c8-a990-4d46-b932-6c2bc561f269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:34.255600 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-330fc1c8-a990-4d46-b932-6c2bc561f269 None None] MFA Rules not processed for user `9751264123914c27b961009f75067660`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:11:34.257971 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-330fc1c8-a990-4d46-b932-6c2bc561f269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:11:34.344838 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1290/2556] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Aug 11 11:11:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:11:34.361587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2ec7e-7364-4e3b-92ac-4bc9ab27cd71 service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:11:34.362937 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-afe2ec7e-7364-4e3b-92ac-4bc9ab27cd71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:11:34.452794 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4ff46-d841-40ea-b824-f15854d05b5d None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:34.453170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4ff46-d841-40ea-b824-f15854d05b5d None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:34.453470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2ec7e-7364-4e3b-92ac-4bc9ab27cd71 service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:11:34.453610 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4ff46-d841-40ea-b824-f15854d05b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:34.459500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507f484-3c5e-4f5e-997e-d69eb898061e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd25d1bde0c4703b61e0edaf5b658d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:11:34.460336 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507f484-3c5e-4f5e-997e-d69eb898061e service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:34.460832 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507f484-3c5e-4f5e-997e-d69eb898061e service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:34.461277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507f484-3c5e-4f5e-997e-d69eb898061e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:34.475849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507f484-3c5e-4f5e-997e-d69eb898061e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:11:34.476415 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-bfb4ff46-d841-40ea-b824-f15854d05b5d None None] MFA Rules not processed for user `39a12126a08341089f09877ad8e31484`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:11:34.477537 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507f484-3c5e-4f5e-997e-d69eb898061e service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:11:34.477733 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-bfb4ff46-d841-40ea-b824-f15854d05b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:11:34.489144 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1291/2557] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:11:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:11:34.510363 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1267/2558] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Aug 11 11:11:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 11:11:44.472539 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=67 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:11:44.485351 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=36 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:11:57.485731 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fa799-aee7-4db1-bd40-356dd8ec8168 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:57.486249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fa799-aee7-4db1-bd40-356dd8ec8168 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:57.486355 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fa799-aee7-4db1-bd40-356dd8ec8168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:57.508182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-536fa799-aee7-4db1-bd40-356dd8ec8168 None None] MFA Rules not processed for user `9751264123914c27b961009f75067660`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:11:57.509387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-536fa799-aee7-4db1-bd40-356dd8ec8168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:11:57.527012 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1292/2559] 10.222.0.43 () {58 vars in 967 bytes} [Thu Aug 11 11:11:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:11:57.539529 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507f484-3c5e-4f5e-997e-d69eb898061e service swift] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:11:57.550501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507f484-3c5e-4f5e-997e-d69eb898061e service swift] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:11:57.555617 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0beb3-91d1-40f9-aa28-df99aaa5a313 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd25d1bde0c4703b61e0edaf5b658d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:11:57.556209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0beb3-91d1-40f9-aa28-df99aaa5a313 service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:11:57.556493 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0beb3-91d1-40f9-aa28-df99aaa5a313 service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:11:57.556771 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0beb3-91d1-40f9-aa28-df99aaa5a313 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:11:57.565518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0beb3-91d1-40f9-aa28-df99aaa5a313 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:11:57.567227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0beb3-91d1-40f9-aa28-df99aaa5a313 service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:11:57.575632 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1268/2560] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Aug 11 11:11:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 11:12:07.520002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=6 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:07.572112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:33.169005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fa799-aee7-4db1-bd40-356dd8ec8168 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:33.170417 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-536fa799-aee7-4db1-bd40-356dd8ec8168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:33.263091 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fa799-aee7-4db1-bd40-356dd8ec8168 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:33.268496 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add641cd-52fb-489b-b905-a31e06a1bfc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db99589bb504e8fa4068925badf3942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:33.269132 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add641cd-52fb-489b-b905-a31e06a1bfc2 service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:33.269419 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add641cd-52fb-489b-b905-a31e06a1bfc2 service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:33.269691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add641cd-52fb-489b-b905-a31e06a1bfc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:33.271537 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-add641cd-52fb-489b-b905-a31e06a1bfc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:33.284069 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add641cd-52fb-489b-b905-a31e06a1bfc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:33.285695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add641cd-52fb-489b-b905-a31e06a1bfc2 service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:33.295695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1293/2561] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:12:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:12:40.388272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0beb3-91d1-40f9-aa28-df99aaa5a313 service swift] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:40.398298 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0beb3-91d1-40f9-aa28-df99aaa5a313 service swift] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:40.401870 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a60a46-9664-49e0-86ee-7f4149d247c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:40.402452 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a60a46-9664-49e0-86ee-7f4149d247c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:40.402728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a60a46-9664-49e0-86ee-7f4149d247c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:40.403046 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a60a46-9664-49e0-86ee-7f4149d247c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:40.404762 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e2a60a46-9664-49e0-86ee-7f4149d247c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:40.416790 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a60a46-9664-49e0-86ee-7f4149d247c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:40.418192 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a60a46-9664-49e0-86ee-7f4149d247c8 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:40.427634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1269/2562] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:12:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:12:43.294924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=41 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:43.792411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add641cd-52fb-489b-b905-a31e06a1bfc2 service placement] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:43.793917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-add641cd-52fb-489b-b905-a31e06a1bfc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:43.810105 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add641cd-52fb-489b-b905-a31e06a1bfc2 service placement] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:43.814828 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef1c5e-f713-4656-9288-da181a2fc99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:43.816077 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef1c5e-f713-4656-9288-da181a2fc99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:43.816480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef1c5e-f713-4656-9288-da181a2fc99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:43.816896 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef1c5e-f713-4656-9288-da181a2fc99a admin admin] PATH_INFO: `/v3/users/950e6ba9e8ed4e00843657869bc3a26d` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:43.818082 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef1c5e-f713-4656-9288-da181a2fc99a admin admin] RBAC: Authorizing `identity:delete_user(user_id=950e6ba9e8ed4e00843657869bc3a26d)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:43.820102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef1c5e-f713-4656-9288-da181a2fc99a admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:43.970033 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-95ef1c5e-f713-4656-9288-da181a2fc99a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '950e6ba9e8ed4e00843657869bc3a26d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:43.970688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-95ef1c5e-f713-4656-9288-da181a2fc99a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '950e6ba9e8ed4e00843657869bc3a26d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:43.983212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-95ef1c5e-f713-4656-9288-da181a2fc99a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '950e6ba9e8ed4e00843657869bc3a26d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:43.990146 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-95ef1c5e-f713-4656-9288-da181a2fc99a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '950e6ba9e8ed4e00843657869bc3a26d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:44.048624 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-95ef1c5e-f713-4656-9288-da181a2fc99a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '950e6ba9e8ed4e00843657869bc3a26d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:44.055567 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1294/2563] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:12:43 2022] DELETE /identity/v3/users/950e6ba9e8ed4e00843657869bc3a26d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:12:44.323781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a60a46-9664-49e0-86ee-7f4149d247c8 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:44.336085 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a60a46-9664-49e0-86ee-7f4149d247c8 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:44.398035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff8641-867f-4f51-94d4-6ab213cd57ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:44.398669 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff8641-867f-4f51-94d4-6ab213cd57ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:44.398978 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff8641-867f-4f51-94d4-6ab213cd57ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:44.399249 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff8641-867f-4f51-94d4-6ab213cd57ee admin admin] PATH_INFO: `/v3/projects/dc574fd3698c4688af4478e2d3e66ef2` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:44.400349 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff8641-867f-4f51-94d4-6ab213cd57ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc574fd3698c4688af4478e2d3e66ef2)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:44.402476 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff8641-867f-4f51-94d4-6ab213cd57ee admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:44.516429 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c5ff8641-867f-4f51-94d4-6ab213cd57ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc574fd3698c4688af4478e2d3e66ef2', 'request_id': 'req-c5ff8641-867f-4f51-94d4-6ab213cd57ee'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:44.522584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c5ff8641-867f-4f51-94d4-6ab213cd57ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc574fd3698c4688af4478e2d3e66ef2', 'request_id': 'req-c5ff8641-867f-4f51-94d4-6ab213cd57ee'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:44.530283 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c5ff8641-867f-4f51-94d4-6ab213cd57ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc574fd3698c4688af4478e2d3e66ef2', 'request_id': 'req-c5ff8641-867f-4f51-94d4-6ab213cd57ee'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:44.607547 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c5ff8641-867f-4f51-94d4-6ab213cd57ee admin admin] The token cache is being invalidate because project dc574fd3698c4688af4478e2d3e66ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:12:44.609771 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c5ff8641-867f-4f51-94d4-6ab213cd57ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:44.609771 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c5ff8641-867f-4f51-94d4-6ab213cd57ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:44.610042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1270/2564] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:12:44 2022] DELETE /identity/v3/projects/dc574fd3698c4688af4478e2d3e66ef2 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:12:44.615539 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da8aee-62b1-40e2-9c13-5f3564eede84 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:44.616027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da8aee-62b1-40e2-9c13-5f3564eede84 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:44.616132 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da8aee-62b1-40e2-9c13-5f3564eede84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:44.636857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-00da8aee-62b1-40e2-9c13-5f3564eede84 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:12:44.638059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-00da8aee-62b1-40e2-9c13-5f3564eede84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:44.703593 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1295/2565] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:12:44.713486 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640c111-fdea-445b-b1c5-40cda0e8b745 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:44.713772 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640c111-fdea-445b-b1c5-40cda0e8b745 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:44.714048 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640c111-fdea-445b-b1c5-40cda0e8b745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:44.733348 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2640c111-fdea-445b-b1c5-40cda0e8b745 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:12:44.734590 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2640c111-fdea-445b-b1c5-40cda0e8b745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:44.743153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1271/2566] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:12:44.747767 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da8aee-62b1-40e2-9c13-5f3564eede84 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:44.758087 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da8aee-62b1-40e2-9c13-5f3564eede84 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:44.762692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca614d5-3129-4c59-9a0c-f8ec2a910fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:44.763312 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca614d5-3129-4c59-9a0c-f8ec2a910fbe admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:44.763586 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca614d5-3129-4c59-9a0c-f8ec2a910fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:44.763856 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca614d5-3129-4c59-9a0c-f8ec2a910fbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:44.764501 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca614d5-3129-4c59-9a0c-f8ec2a910fbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:12:44.764799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca614d5-3129-4c59-9a0c-f8ec2a910fbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:44.766469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca614d5-3129-4c59-9a0c-f8ec2a910fbe admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:44.778161 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1296/2567] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:12:44.782616 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640c111-fdea-445b-b1c5-40cda0e8b745 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:44.792349 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640c111-fdea-445b-b1c5-40cda0e8b745 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:44.797044 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42baac-93a9-4599-bee1-3550c769f9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:44.797671 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42baac-93a9-4599-bee1-3550c769f9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:44.797947 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42baac-93a9-4599-bee1-3550c769f9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:44.798222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42baac-93a9-4599-bee1-3550c769f9f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:44.798887 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42baac-93a9-4599-bee1-3550c769f9f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:44.801589 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42baac-93a9-4599-bee1-3550c769f9f9 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:44.901265 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1272/2568] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:12:44 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:12:44.905590 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca614d5-3129-4c59-9a0c-f8ec2a910fbe admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:44.916099 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca614d5-3129-4c59-9a0c-f8ec2a910fbe admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:44.971202 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82806059-1032-4423-b89b-7828b38dc38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:44.971846 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82806059-1032-4423-b89b-7828b38dc38b admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:44.972166 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82806059-1032-4423-b89b-7828b38dc38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:44.972600 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82806059-1032-4423-b89b-7828b38dc38b admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:44.973229 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82806059-1032-4423-b89b-7828b38dc38b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:44.975179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82806059-1032-4423-b89b-7828b38dc38b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:44.983077 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:45.083169 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1297/2569] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:12:44 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:12:45.087061 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42baac-93a9-4599-bee1-3550c769f9f9 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:45.098298 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42baac-93a9-4599-bee1-3550c769f9f9 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:45.103007 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5245d-1dd9-47d0-a6fe-ead498d69de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:45.103623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5245d-1dd9-47d0-a6fe-ead498d69de2 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:45.103926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5245d-1dd9-47d0-a6fe-ead498d69de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:45.104186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5245d-1dd9-47d0-a6fe-ead498d69de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:45.104831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5245d-1dd9-47d0-a6fe-ead498d69de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:45.106438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5245d-1dd9-47d0-a6fe-ead498d69de2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:45.117985 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1273/2570] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:12:45.128158 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82806059-1032-4423-b89b-7828b38dc38b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:45.137860 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82806059-1032-4423-b89b-7828b38dc38b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:45.142405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6992b7-a17e-4349-8f63-21e649c0eab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:45.143021 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6992b7-a17e-4349-8f63-21e649c0eab4 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:45.143562 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6992b7-a17e-4349-8f63-21e649c0eab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:45.143858 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6992b7-a17e-4349-8f63-21e649c0eab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:45.144876 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6992b7-a17e-4349-8f63-21e649c0eab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:45.146738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6992b7-a17e-4349-8f63-21e649c0eab4 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:45.157298 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1298/2571] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:12:45.162804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5245d-1dd9-47d0-a6fe-ead498d69de2 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:45.172832 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5245d-1dd9-47d0-a6fe-ead498d69de2 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:45.178113 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0bff2-93b9-4194-92c9-f2e2c1165022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:45.178777 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0bff2-93b9-4194-92c9-f2e2c1165022 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:45.179070 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0bff2-93b9-4194-92c9-f2e2c1165022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:45.179347 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0bff2-93b9-4194-92c9-f2e2c1165022 admin admin] PATH_INFO: `/v3/projects/7f9cd2c0f4d44dcdbcec5e4fcbb5ea22/users/ee290446b040495e9c4ea6d280b01f7a/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:45.193758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0bff2-93b9-4194-92c9-f2e2c1165022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9cd2c0f4d44dcdbcec5e4fcbb5ea22, user_id=ee290446b040495e9c4ea6d280b01f7a, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:45.196467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0bff2-93b9-4194-92c9-f2e2c1165022 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:45.305880 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1274/2572] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:12:45 2022] PUT /identity/v3/projects/7f9cd2c0f4d44dcdbcec5e4fcbb5ea22/users/ee290446b040495e9c4ea6d280b01f7a/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:12:45.316012 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31638cb-65dd-4484-84dd-a03dcc8f2ccb None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:45.320270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31638cb-65dd-4484-84dd-a03dcc8f2ccb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:45.320270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31638cb-65dd-4484-84dd-a03dcc8f2ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:45.343768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-e31638cb-65dd-4484-84dd-a03dcc8f2ccb None None] MFA Rules not processed for user `ee290446b040495e9c4ea6d280b01f7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:12:45.344970 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e31638cb-65dd-4484-84dd-a03dcc8f2ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:45.409470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1299/2573] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:12:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:12:45.420891 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0bff2-93b9-4194-92c9-f2e2c1165022 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:45.422573 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fef0bff2-93b9-4194-92c9-f2e2c1165022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:45.441265 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:45.517250 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0bff2-93b9-4194-92c9-f2e2c1165022 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:45.523549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0d671-8a3d-4a4f-bda0-2d781f61c06c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:45.524186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0d671-8a3d-4a4f-bda0-2d781f61c06c service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:45.524471 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0d671-8a3d-4a4f-bda0-2d781f61c06c service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:45.524749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0d671-8a3d-4a4f-bda0-2d781f61c06c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:45.532554 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0d671-8a3d-4a4f-bda0-2d781f61c06c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:45.534827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0d671-8a3d-4a4f-bda0-2d781f61c06c service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:45.544072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1275/2574] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:12:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:12:48.849397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31638cb-65dd-4484-84dd-a03dcc8f2ccb None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:48.911740 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31638cb-65dd-4484-84dd-a03dcc8f2ccb None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:48.916214 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb21cc5-c329-46b2-b1e6-3965ddd8042f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:48.916961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb21cc5-c329-46b2-b1e6-3965ddd8042f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:48.917242 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb21cc5-c329-46b2-b1e6-3965ddd8042f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:48.917515 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb21cc5-c329-46b2-b1e6-3965ddd8042f admin admin] PATH_INFO: `/v3/users/ee290446b040495e9c4ea6d280b01f7a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:48.918619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb21cc5-c329-46b2-b1e6-3965ddd8042f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee290446b040495e9c4ea6d280b01f7a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:48.922417 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb21cc5-c329-46b2-b1e6-3965ddd8042f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:49.119462 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9eb21cc5-c329-46b2-b1e6-3965ddd8042f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee290446b040495e9c4ea6d280b01f7a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:49.120112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9eb21cc5-c329-46b2-b1e6-3965ddd8042f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee290446b040495e9c4ea6d280b01f7a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:49.132474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9eb21cc5-c329-46b2-b1e6-3965ddd8042f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee290446b040495e9c4ea6d280b01f7a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:49.136866 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:49.139938 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9eb21cc5-c329-46b2-b1e6-3965ddd8042f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee290446b040495e9c4ea6d280b01f7a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:49.236048 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-9eb21cc5-c329-46b2-b1e6-3965ddd8042f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee290446b040495e9c4ea6d280b01f7a'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:49.242383 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1300/2575] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:12:48 2022] DELETE /identity/v3/users/ee290446b040495e9c4ea6d280b01f7a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:12:49.247012 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0178c14-cedb-440f-b7e0-a087054ce33a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:49.247482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0178c14-cedb-440f-b7e0-a087054ce33a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:49.247584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0178c14-cedb-440f-b7e0-a087054ce33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:49.266209 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c0178c14-cedb-440f-b7e0-a087054ce33a None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:12:49.267439 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c0178c14-cedb-440f-b7e0-a087054ce33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:49.326597 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1276/2576] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:12:49.337271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb21cc5-c329-46b2-b1e6-3965ddd8042f admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:49.338505 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9eb21cc5-c329-46b2-b1e6-3965ddd8042f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:49.396248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb21cc5-c329-46b2-b1e6-3965ddd8042f admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:49.399956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28c3ae-86ab-4dec-a2c0-22e1d6f8bef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:49.400552 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28c3ae-86ab-4dec-a2c0-22e1d6f8bef9 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:49.400837 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28c3ae-86ab-4dec-a2c0-22e1d6f8bef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:49.401110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28c3ae-86ab-4dec-a2c0-22e1d6f8bef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:49.411059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28c3ae-86ab-4dec-a2c0-22e1d6f8bef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:49.412522 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28c3ae-86ab-4dec-a2c0-22e1d6f8bef9 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:49.421655 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1301/2577] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:12:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:12:49.860961 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0178c14-cedb-440f-b7e0-a087054ce33a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:49.863073 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c0178c14-cedb-440f-b7e0-a087054ce33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:49.879955 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0178c14-cedb-440f-b7e0-a087054ce33a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:49.883265 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f13db-fd6a-4ea5-a69f-5b29fd8df17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:49.883942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f13db-fd6a-4ea5-a69f-5b29fd8df17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:49.884218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f13db-fd6a-4ea5-a69f-5b29fd8df17e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:49.884511 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f13db-fd6a-4ea5-a69f-5b29fd8df17e admin admin] PATH_INFO: `/v3/projects/7f9cd2c0f4d44dcdbcec5e4fcbb5ea22` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:49.885657 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f13db-fd6a-4ea5-a69f-5b29fd8df17e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9cd2c0f4d44dcdbcec5e4fcbb5ea22)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:49.887663 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f13db-fd6a-4ea5-a69f-5b29fd8df17e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:50.021289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5f0f13db-fd6a-4ea5-a69f-5b29fd8df17e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9cd2c0f4d44dcdbcec5e4fcbb5ea22', 'request_id': 'req-5f0f13db-fd6a-4ea5-a69f-5b29fd8df17e'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:50.026915 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5f0f13db-fd6a-4ea5-a69f-5b29fd8df17e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9cd2c0f4d44dcdbcec5e4fcbb5ea22', 'request_id': 'req-5f0f13db-fd6a-4ea5-a69f-5b29fd8df17e'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:50.033317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5f0f13db-fd6a-4ea5-a69f-5b29fd8df17e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9cd2c0f4d44dcdbcec5e4fcbb5ea22', 'request_id': 'req-5f0f13db-fd6a-4ea5-a69f-5b29fd8df17e'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:50.126805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5f0f13db-fd6a-4ea5-a69f-5b29fd8df17e admin admin] The token cache is being invalidate because project 7f9cd2c0f4d44dcdbcec5e4fcbb5ea22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:12:50.127107 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5f0f13db-fd6a-4ea5-a69f-5b29fd8df17e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:50.128438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5f0f13db-fd6a-4ea5-a69f-5b29fd8df17e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:50.130148 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1277/2578] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:12:49 2022] DELETE /identity/v3/projects/7f9cd2c0f4d44dcdbcec5e4fcbb5ea22 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:12:50.135104 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1fd49-9912-4078-aad7-5e937bb690a9 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:50.135578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1fd49-9912-4078-aad7-5e937bb690a9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:50.135687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1fd49-9912-4078-aad7-5e937bb690a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:50.155363 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-94f1fd49-9912-4078-aad7-5e937bb690a9 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:12:50.156568 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-94f1fd49-9912-4078-aad7-5e937bb690a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:50.216715 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1302/2579] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:12:50.224835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ca05c-5d27-417f-b179-11667f0b8fb6 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:50.225118 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ca05c-5d27-417f-b179-11667f0b8fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:50.225396 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ca05c-5d27-417f-b179-11667f0b8fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:50.233331 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:50.246830 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-441ca05c-5d27-417f-b179-11667f0b8fb6 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:12:50.257878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-441ca05c-5d27-417f-b179-11667f0b8fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:50.257878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1278/2580] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:12:50.261257 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1fd49-9912-4078-aad7-5e937bb690a9 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:50.271164 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1fd49-9912-4078-aad7-5e937bb690a9 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:50.275611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c32f42-2f6e-4f8a-a7ed-9c3f228d8074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:50.276206 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c32f42-2f6e-4f8a-a7ed-9c3f228d8074 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:50.276479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c32f42-2f6e-4f8a-a7ed-9c3f228d8074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:50.276745 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c32f42-2f6e-4f8a-a7ed-9c3f228d8074 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:50.277387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c32f42-2f6e-4f8a-a7ed-9c3f228d8074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:12:50.277688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c32f42-2f6e-4f8a-a7ed-9c3f228d8074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:50.279296 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c32f42-2f6e-4f8a-a7ed-9c3f228d8074 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:50.290651 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1303/2581] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:12:50.294978 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ca05c-5d27-417f-b179-11667f0b8fb6 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:50.320667 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ca05c-5d27-417f-b179-11667f0b8fb6 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:50.320667 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d9141-da98-47b9-9670-cb51b1d83949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:50.320667 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d9141-da98-47b9-9670-cb51b1d83949 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:50.320667 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d9141-da98-47b9-9670-cb51b1d83949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:50.321105 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d9141-da98-47b9-9670-cb51b1d83949 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:50.321105 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d9141-da98-47b9-9670-cb51b1d83949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:50.321105 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d9141-da98-47b9-9670-cb51b1d83949 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:50.466124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1279/2582] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:12:50 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:12:50.470550 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c32f42-2f6e-4f8a-a7ed-9c3f228d8074 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:50.481179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c32f42-2f6e-4f8a-a7ed-9c3f228d8074 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:50.536838 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a5fa6-0d13-403d-9521-bcd82a839431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:50.537495 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a5fa6-0d13-403d-9521-bcd82a839431 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:50.537648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a5fa6-0d13-403d-9521-bcd82a839431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:50.538051 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a5fa6-0d13-403d-9521-bcd82a839431 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:50.538623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a5fa6-0d13-403d-9521-bcd82a839431 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:50.540695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a5fa6-0d13-403d-9521-bcd82a839431 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:50.642594 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1304/2583] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:12:50 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:12:50.646885 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d9141-da98-47b9-9670-cb51b1d83949 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:50.657292 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d9141-da98-47b9-9670-cb51b1d83949 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:50.662691 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b2e61-0835-46a6-8af9-2523433c88ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:50.663332 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b2e61-0835-46a6-8af9-2523433c88ad admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:50.663617 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b2e61-0835-46a6-8af9-2523433c88ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:50.663895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b2e61-0835-46a6-8af9-2523433c88ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:50.664540 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b2e61-0835-46a6-8af9-2523433c88ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:50.666135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b2e61-0835-46a6-8af9-2523433c88ad admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:50.677222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1280/2584] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:12:50.681381 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a5fa6-0d13-403d-9521-bcd82a839431 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:50.691245 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a5fa6-0d13-403d-9521-bcd82a839431 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:50.696173 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50af604-e8db-4c86-a918-7b79d733f055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:50.696772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50af604-e8db-4c86-a918-7b79d733f055 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:50.697057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50af604-e8db-4c86-a918-7b79d733f055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:50.697357 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50af604-e8db-4c86-a918-7b79d733f055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:50.698028 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50af604-e8db-4c86-a918-7b79d733f055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:50.699770 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50af604-e8db-4c86-a918-7b79d733f055 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:50.701082 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:50.712723 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1305/2585] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:12:50.716938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b2e61-0835-46a6-8af9-2523433c88ad admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:50.727853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b2e61-0835-46a6-8af9-2523433c88ad admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:50.733042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855fa37-ad92-4d62-b7f9-cb9761809e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:50.733696 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855fa37-ad92-4d62-b7f9-cb9761809e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:50.733984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855fa37-ad92-4d62-b7f9-cb9761809e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:50.734262 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855fa37-ad92-4d62-b7f9-cb9761809e76 admin admin] PATH_INFO: `/v3/projects/8bb1ce145ce54aed909b705d5bf72f30/users/60a3fe40ed23457c937ab74713ba8781/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:50.748970 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855fa37-ad92-4d62-b7f9-cb9761809e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb1ce145ce54aed909b705d5bf72f30, user_id=60a3fe40ed23457c937ab74713ba8781, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:50.751662 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855fa37-ad92-4d62-b7f9-cb9761809e76 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:50.830627 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1281/2586] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:12:50 2022] PUT /identity/v3/projects/8bb1ce145ce54aed909b705d5bf72f30/users/60a3fe40ed23457c937ab74713ba8781/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:12:50.842665 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c540d32-31cd-4b16-a328-ce63372b33b7 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:50.842974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c540d32-31cd-4b16-a328-ce63372b33b7 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:50.843246 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c540d32-31cd-4b16-a328-ce63372b33b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:50.870934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-9c540d32-31cd-4b16-a328-ce63372b33b7 None None] MFA Rules not processed for user `60a3fe40ed23457c937ab74713ba8781`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:12:50.872117 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9c540d32-31cd-4b16-a328-ce63372b33b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:50.935164 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1306/2587] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:12:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:12:50.939652 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855fa37-ad92-4d62-b7f9-cb9761809e76 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:51.002596 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855fa37-ad92-4d62-b7f9-cb9761809e76 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:51.007251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9452c8-4b24-41c3-867a-201a162b2bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:51.007851 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9452c8-4b24-41c3-867a-201a162b2bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:51.008130 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9452c8-4b24-41c3-867a-201a162b2bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:51.008403 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9452c8-4b24-41c3-867a-201a162b2bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:51.009035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9452c8-4b24-41c3-867a-201a162b2bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:51.010984 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9452c8-4b24-41c3-867a-201a162b2bc9 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:51.157960 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1282/2588] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:12:50 2022] POST /identity/v3/projects => generated 387 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:12:51.162330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c540d32-31cd-4b16-a328-ce63372b33b7 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:51.172798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c540d32-31cd-4b16-a328-ce63372b33b7 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:51.226411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c6bba-7850-4c65-9a7a-5a5805355104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:51.227025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c6bba-7850-4c65-9a7a-5a5805355104 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:51.227318 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c6bba-7850-4c65-9a7a-5a5805355104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:51.227574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c6bba-7850-4c65-9a7a-5a5805355104 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:51.228181 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c6bba-7850-4c65-9a7a-5a5805355104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:51.230071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c6bba-7850-4c65-9a7a-5a5805355104 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:51.310477 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1307/2589] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:12:51 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:12:51.314434 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9452c8-4b24-41c3-867a-201a162b2bc9 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:51.325336 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9452c8-4b24-41c3-867a-201a162b2bc9 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:51.329943 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e58cb-9784-4dbf-a27d-78124686d129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:51.330536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e58cb-9784-4dbf-a27d-78124686d129 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:51.335294 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e58cb-9784-4dbf-a27d-78124686d129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:51.335294 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e58cb-9784-4dbf-a27d-78124686d129 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:51.335294 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e58cb-9784-4dbf-a27d-78124686d129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:51.335294 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e58cb-9784-4dbf-a27d-78124686d129 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:51.344599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1283/2590] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:12:51.348805 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c6bba-7850-4c65-9a7a-5a5805355104 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:51.358849 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c6bba-7850-4c65-9a7a-5a5805355104 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:51.363533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde5a34-3d6b-4b34-9e66-f01922c1d022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:51.364170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde5a34-3d6b-4b34-9e66-f01922c1d022 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:51.364449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde5a34-3d6b-4b34-9e66-f01922c1d022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:51.364722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde5a34-3d6b-4b34-9e66-f01922c1d022 admin admin] PATH_INFO: `/v3/projects/3af31fc1da4540d5a28f0cafa9898cf1/users/9772d7893a7d4d21878fadda3b6ccab8/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:51.379279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde5a34-3d6b-4b34-9e66-f01922c1d022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af31fc1da4540d5a28f0cafa9898cf1, user_id=9772d7893a7d4d21878fadda3b6ccab8, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:51.381932 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde5a34-3d6b-4b34-9e66-f01922c1d022 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:51.482589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1308/2591] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:12:51 2022] PUT /identity/v3/projects/3af31fc1da4540d5a28f0cafa9898cf1/users/9772d7893a7d4d21878fadda3b6ccab8/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:12:51.486539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e58cb-9784-4dbf-a27d-78124686d129 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:51.497299 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e58cb-9784-4dbf-a27d-78124686d129 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:51.553436 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbb833-ac06-4eb0-959e-bcef9843d7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:51.554043 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbb833-ac06-4eb0-959e-bcef9843d7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:51.554326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbb833-ac06-4eb0-959e-bcef9843d7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:51.554606 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbb833-ac06-4eb0-959e-bcef9843d7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:51.555309 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbb833-ac06-4eb0-959e-bcef9843d7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:51.556895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbb833-ac06-4eb0-959e-bcef9843d7f0 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:51.567251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1284/2592] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:12:51.571752 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde5a34-3d6b-4b34-9e66-f01922c1d022 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:51.582616 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde5a34-3d6b-4b34-9e66-f01922c1d022 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:51.587178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe2d44-6ecb-4e2d-ae32-bb4718829cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:51.587813 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe2d44-6ecb-4e2d-ae32-bb4718829cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:51.588086 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe2d44-6ecb-4e2d-ae32-bb4718829cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:51.588355 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe2d44-6ecb-4e2d-ae32-bb4718829cb1 admin admin] PATH_INFO: `/v3/projects/3af31fc1da4540d5a28f0cafa9898cf1/users/9772d7893a7d4d21878fadda3b6ccab8/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:51.590313 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe2d44-6ecb-4e2d-ae32-bb4718829cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af31fc1da4540d5a28f0cafa9898cf1, user_id=9772d7893a7d4d21878fadda3b6ccab8, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:51.592981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe2d44-6ecb-4e2d-ae32-bb4718829cb1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:51.603059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1309/2593] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:12:51 2022] PUT /identity/v3/projects/3af31fc1da4540d5a28f0cafa9898cf1/users/9772d7893a7d4d21878fadda3b6ccab8/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:12:51.614089 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdb018-aa67-44d3-b728-9ac1774cef9a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:51.614361 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdb018-aa67-44d3-b728-9ac1774cef9a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:51.614641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdb018-aa67-44d3-b728-9ac1774cef9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:51.634660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:51.643099 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-03fdb018-aa67-44d3-b728-9ac1774cef9a None None] MFA Rules not processed for user `9772d7893a7d4d21878fadda3b6ccab8`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:12:51.644539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-03fdb018-aa67-44d3-b728-9ac1774cef9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:51.713147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1285/2594] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:12:51 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:12:51.724830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe2d44-6ecb-4e2d-ae32-bb4718829cb1 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:51.727649 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-edfe2d44-6ecb-4e2d-ae32-bb4718829cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:51.768735 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:51.783176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe2d44-6ecb-4e2d-ae32-bb4718829cb1 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:51.786938 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82424bd8-4963-454f-b582-00bf9b565c97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:51.787647 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82424bd8-4963-454f-b582-00bf9b565c97 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:51.787933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82424bd8-4963-454f-b582-00bf9b565c97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:51.788248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82424bd8-4963-454f-b582-00bf9b565c97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:51.796896 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82424bd8-4963-454f-b582-00bf9b565c97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:51.798327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82424bd8-4963-454f-b582-00bf9b565c97 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:51.808482 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1310/2595] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:12:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:12:51.878820 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdb018-aa67-44d3-b728-9ac1774cef9a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:51.941064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdb018-aa67-44d3-b728-9ac1774cef9a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:51.945581 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4318f-ffae-494c-b97a-fbb7894b4cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:51.946202 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4318f-ffae-494c-b97a-fbb7894b4cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:51.946568 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4318f-ffae-494c-b97a-fbb7894b4cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:51.946900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4318f-ffae-494c-b97a-fbb7894b4cb0 admin admin] PATH_INFO: `/v3/users/60a3fe40ed23457c937ab74713ba8781` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:51.948023 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4318f-ffae-494c-b97a-fbb7894b4cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60a3fe40ed23457c937ab74713ba8781)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:51.949926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4318f-ffae-494c-b97a-fbb7894b4cb0 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:52.124781 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6fc4318f-ffae-494c-b97a-fbb7894b4cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60a3fe40ed23457c937ab74713ba8781'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:52.136764 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6fc4318f-ffae-494c-b97a-fbb7894b4cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60a3fe40ed23457c937ab74713ba8781'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:52.137435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6fc4318f-ffae-494c-b97a-fbb7894b4cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60a3fe40ed23457c937ab74713ba8781'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:52.207839 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6fc4318f-ffae-494c-b97a-fbb7894b4cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60a3fe40ed23457c937ab74713ba8781'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:52.214974 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6fc4318f-ffae-494c-b97a-fbb7894b4cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60a3fe40ed23457c937ab74713ba8781'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:52.220910 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1286/2596] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:12:51 2022] DELETE /identity/v3/users/60a3fe40ed23457c937ab74713ba8781 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:12:52.226027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42a349-3fdf-46c3-ac21-dd43c3d00515 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:52.226529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42a349-3fdf-46c3-ac21-dd43c3d00515 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:52.226633 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42a349-3fdf-46c3-ac21-dd43c3d00515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:52.244843 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-8b42a349-3fdf-46c3-ac21-dd43c3d00515 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:12:52.246014 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8b42a349-3fdf-46c3-ac21-dd43c3d00515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:52.301883 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1311/2597] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:12:52.311549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4318f-ffae-494c-b97a-fbb7894b4cb0 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:52.312964 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6fc4318f-ffae-494c-b97a-fbb7894b4cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:52.326999 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:52.371195 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4318f-ffae-494c-b97a-fbb7894b4cb0 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:52.374891 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c170d-c57d-404b-9503-14a6afb78557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:52.375489 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c170d-c57d-404b-9503-14a6afb78557 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:52.375766 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c170d-c57d-404b-9503-14a6afb78557 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:52.376042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c170d-c57d-404b-9503-14a6afb78557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:52.385471 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c170d-c57d-404b-9503-14a6afb78557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:52.386909 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c170d-c57d-404b-9503-14a6afb78557 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:52.396598 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1287/2598] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:12:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:12:52.837816 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42a349-3fdf-46c3-ac21-dd43c3d00515 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:52.839333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8b42a349-3fdf-46c3-ac21-dd43c3d00515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:52.852006 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42a349-3fdf-46c3-ac21-dd43c3d00515 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:52.856670 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff9765-73d5-49a5-934f-658d45e40554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:52.857555 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff9765-73d5-49a5-934f-658d45e40554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:52.857838 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff9765-73d5-49a5-934f-658d45e40554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:52.858134 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff9765-73d5-49a5-934f-658d45e40554 admin admin] PATH_INFO: `/v3/projects/8bb1ce145ce54aed909b705d5bf72f30` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:52.859332 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff9765-73d5-49a5-934f-658d45e40554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bb1ce145ce54aed909b705d5bf72f30)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:52.861280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff9765-73d5-49a5-934f-658d45e40554 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:52.985528 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-aeff9765-73d5-49a5-934f-658d45e40554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bb1ce145ce54aed909b705d5bf72f30', 'request_id': 'req-aeff9765-73d5-49a5-934f-658d45e40554'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:52.991235 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-aeff9765-73d5-49a5-934f-658d45e40554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bb1ce145ce54aed909b705d5bf72f30', 'request_id': 'req-aeff9765-73d5-49a5-934f-658d45e40554'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:53.064793 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-aeff9765-73d5-49a5-934f-658d45e40554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bb1ce145ce54aed909b705d5bf72f30', 'request_id': 'req-aeff9765-73d5-49a5-934f-658d45e40554'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:53.076460 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-aeff9765-73d5-49a5-934f-658d45e40554 admin admin] The token cache is being invalidate because project 8bb1ce145ce54aed909b705d5bf72f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:12:53.081159 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-aeff9765-73d5-49a5-934f-658d45e40554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:53.081159 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-aeff9765-73d5-49a5-934f-658d45e40554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:53.081159 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1312/2599] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:12:52 2022] DELETE /identity/v3/projects/8bb1ce145ce54aed909b705d5bf72f30 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:12:53.083584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c170d-c57d-404b-9503-14a6afb78557 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:53.093346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c170d-c57d-404b-9503-14a6afb78557 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:53.149369 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e9301-723f-4af6-9937-f07109d3aff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:53.150051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e9301-723f-4af6-9937-f07109d3aff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:53.150333 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e9301-723f-4af6-9937-f07109d3aff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:53.150605 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e9301-723f-4af6-9937-f07109d3aff1 admin admin] PATH_INFO: `/v3/users/9772d7893a7d4d21878fadda3b6ccab8` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:53.151758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e9301-723f-4af6-9937-f07109d3aff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9772d7893a7d4d21878fadda3b6ccab8)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:53.153696 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e9301-723f-4af6-9937-f07109d3aff1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:53.352759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-cb1e9301-723f-4af6-9937-f07109d3aff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9772d7893a7d4d21878fadda3b6ccab8'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:53.365417 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-cb1e9301-723f-4af6-9937-f07109d3aff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9772d7893a7d4d21878fadda3b6ccab8'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:53.366182 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-cb1e9301-723f-4af6-9937-f07109d3aff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9772d7893a7d4d21878fadda3b6ccab8'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:53.407251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-cb1e9301-723f-4af6-9937-f07109d3aff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9772d7893a7d4d21878fadda3b6ccab8'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:53.415109 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-cb1e9301-723f-4af6-9937-f07109d3aff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9772d7893a7d4d21878fadda3b6ccab8'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:53.421120 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1288/2600] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:12:53 2022] DELETE /identity/v3/users/9772d7893a7d4d21878fadda3b6ccab8 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:12:53.883954 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff9765-73d5-49a5-934f-658d45e40554 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:53.885430 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-aeff9765-73d5-49a5-934f-658d45e40554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:53.898886 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff9765-73d5-49a5-934f-658d45e40554 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:53.966328 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d8def-3822-42dc-bb16-b98b51bd1b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:53.966986 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d8def-3822-42dc-bb16-b98b51bd1b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:53.967271 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d8def-3822-42dc-bb16-b98b51bd1b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:53.967545 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d8def-3822-42dc-bb16-b98b51bd1b50 admin admin] PATH_INFO: `/v3/projects/3af31fc1da4540d5a28f0cafa9898cf1` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:53.968662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d8def-3822-42dc-bb16-b98b51bd1b50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3af31fc1da4540d5a28f0cafa9898cf1)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:53.970566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d8def-3822-42dc-bb16-b98b51bd1b50 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:53.980736 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:54.105961 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fc5d8def-3822-42dc-bb16-b98b51bd1b50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3af31fc1da4540d5a28f0cafa9898cf1', 'request_id': 'req-fc5d8def-3822-42dc-bb16-b98b51bd1b50'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:54.111490 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fc5d8def-3822-42dc-bb16-b98b51bd1b50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3af31fc1da4540d5a28f0cafa9898cf1', 'request_id': 'req-fc5d8def-3822-42dc-bb16-b98b51bd1b50'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:54.224475 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fc5d8def-3822-42dc-bb16-b98b51bd1b50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3af31fc1da4540d5a28f0cafa9898cf1', 'request_id': 'req-fc5d8def-3822-42dc-bb16-b98b51bd1b50'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:54.235740 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fc5d8def-3822-42dc-bb16-b98b51bd1b50 admin admin] The token cache is being invalidate because project 3af31fc1da4540d5a28f0cafa9898cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:12:54.236028 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fc5d8def-3822-42dc-bb16-b98b51bd1b50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:54.236710 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fc5d8def-3822-42dc-bb16-b98b51bd1b50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:54.238979 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1313/2601] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:12:53 2022] DELETE /identity/v3/projects/3af31fc1da4540d5a28f0cafa9898cf1 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:12:54.244016 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9439fe-4d8d-4e51-b0ce-ba126c826843 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:54.244309 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9439fe-4d8d-4e51-b0ce-ba126c826843 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:54.244694 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9439fe-4d8d-4e51-b0ce-ba126c826843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:54.265182 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ec9439fe-4d8d-4e51-b0ce-ba126c826843 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:12:54.266395 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ec9439fe-4d8d-4e51-b0ce-ba126c826843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:54.296785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:54.325306 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1289/2602] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:12:54.334785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e7ebc-9c95-4fc3-8d90-8594a02947f6 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:54.339314 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e7ebc-9c95-4fc3-8d90-8594a02947f6 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:54.339314 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e7ebc-9c95-4fc3-8d90-8594a02947f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:54.356242 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-935e7ebc-9c95-4fc3-8d90-8594a02947f6 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:12:54.357718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-935e7ebc-9c95-4fc3-8d90-8594a02947f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:54.366060 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1314/2603] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:12:54.370384 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9439fe-4d8d-4e51-b0ce-ba126c826843 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:54.380344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9439fe-4d8d-4e51-b0ce-ba126c826843 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:54.384906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f6274-02c2-46b9-919e-4c7a62d57da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:54.385507 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f6274-02c2-46b9-919e-4c7a62d57da6 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:54.385795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f6274-02c2-46b9-919e-4c7a62d57da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:54.386070 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f6274-02c2-46b9-919e-4c7a62d57da6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:54.386714 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f6274-02c2-46b9-919e-4c7a62d57da6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:12:54.387054 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f6274-02c2-46b9-919e-4c7a62d57da6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:54.388673 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f6274-02c2-46b9-919e-4c7a62d57da6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:54.400124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1290/2604] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:12:54.404324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e7ebc-9c95-4fc3-8d90-8594a02947f6 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:54.414175 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e7ebc-9c95-4fc3-8d90-8594a02947f6 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:54.418840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef2f69-9a5b-4b22-a630-9b8250976909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:54.419446 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef2f69-9a5b-4b22-a630-9b8250976909 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:54.419724 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef2f69-9a5b-4b22-a630-9b8250976909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:54.419994 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef2f69-9a5b-4b22-a630-9b8250976909 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:54.420619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef2f69-9a5b-4b22-a630-9b8250976909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:54.422520 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef2f69-9a5b-4b22-a630-9b8250976909 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:54.505297 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1315/2605] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:12:54 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:12:54.509625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f6274-02c2-46b9-919e-4c7a62d57da6 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:54.520649 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f6274-02c2-46b9-919e-4c7a62d57da6 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:54.579100 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59445baf-fbd4-4584-a2ae-a771557fd500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:54.579731 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59445baf-fbd4-4584-a2ae-a771557fd500 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:54.580015 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59445baf-fbd4-4584-a2ae-a771557fd500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:54.580285 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59445baf-fbd4-4584-a2ae-a771557fd500 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:54.581462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59445baf-fbd4-4584-a2ae-a771557fd500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:54.583402 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59445baf-fbd4-4584-a2ae-a771557fd500 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:54.698718 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1291/2606] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:12:54 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:12:54.702873 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef2f69-9a5b-4b22-a630-9b8250976909 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:54.713546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef2f69-9a5b-4b22-a630-9b8250976909 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:54.718126 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acd25e-6ed9-460f-9db0-61494d91ba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:54.725721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acd25e-6ed9-460f-9db0-61494d91ba4f admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:54.725721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acd25e-6ed9-460f-9db0-61494d91ba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:54.725721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acd25e-6ed9-460f-9db0-61494d91ba4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:54.725721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acd25e-6ed9-460f-9db0-61494d91ba4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:54.725721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acd25e-6ed9-460f-9db0-61494d91ba4f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:54.732534 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1316/2607] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:12:54.736342 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59445baf-fbd4-4584-a2ae-a771557fd500 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:54.746911 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59445baf-fbd4-4584-a2ae-a771557fd500 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:54.751832 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53530390-3422-4fc2-820b-a9895ebde8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:54.752459 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53530390-3422-4fc2-820b-a9895ebde8db admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:54.752729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53530390-3422-4fc2-820b-a9895ebde8db admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:54.753004 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53530390-3422-4fc2-820b-a9895ebde8db admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:54.753749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53530390-3422-4fc2-820b-a9895ebde8db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:54.755448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53530390-3422-4fc2-820b-a9895ebde8db admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:54.766159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1292/2608] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:12:54.771100 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acd25e-6ed9-460f-9db0-61494d91ba4f admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:54.781126 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acd25e-6ed9-460f-9db0-61494d91ba4f admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:54.787280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d616387-f733-49b3-b239-a1cd4fb33f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:54.787929 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d616387-f733-49b3-b239-a1cd4fb33f29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:54.788233 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d616387-f733-49b3-b239-a1cd4fb33f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:54.788507 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d616387-f733-49b3-b239-a1cd4fb33f29 admin admin] PATH_INFO: `/v3/projects/7377e494ee984bfe8c269e35db233b46/users/7157291d3d0a436b91ac144730a41bf0/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:54.803476 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d616387-f733-49b3-b239-a1cd4fb33f29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7377e494ee984bfe8c269e35db233b46, user_id=7157291d3d0a436b91ac144730a41bf0, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:54.806161 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d616387-f733-49b3-b239-a1cd4fb33f29 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:54.892043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1317/2609] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:12:54 2022] PUT /identity/v3/projects/7377e494ee984bfe8c269e35db233b46/users/7157291d3d0a436b91ac144730a41bf0/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:12:54.903435 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54dfa0-4ac8-4744-9802-d5b8c5787aed None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:54.904331 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54dfa0-4ac8-4744-9802-d5b8c5787aed None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:54.904331 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54dfa0-4ac8-4744-9802-d5b8c5787aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:54.932184 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0a54dfa0-4ac8-4744-9802-d5b8c5787aed None None] MFA Rules not processed for user `7157291d3d0a436b91ac144730a41bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:12:54.933441 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0a54dfa0-4ac8-4744-9802-d5b8c5787aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:54.997643 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1293/2610] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:12:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:12:55.002119 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d616387-f733-49b3-b239-a1cd4fb33f29 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:55.063228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d616387-f733-49b3-b239-a1cd4fb33f29 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:55.068501 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f6f4e-9b80-4a62-9d15-3cc5bd5acfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:55.069097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f6f4e-9b80-4a62-9d15-3cc5bd5acfa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:55.069375 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f6f4e-9b80-4a62-9d15-3cc5bd5acfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:55.069646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f6f4e-9b80-4a62-9d15-3cc5bd5acfa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:55.070274 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f6f4e-9b80-4a62-9d15-3cc5bd5acfa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:55.072182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f6f4e-9b80-4a62-9d15-3cc5bd5acfa7 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:55.231440 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1318/2611] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:12:55 2022] POST /identity/v3/projects => generated 381 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:12:55.236145 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54dfa0-4ac8-4744-9802-d5b8c5787aed None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:55.248040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54dfa0-4ac8-4744-9802-d5b8c5787aed None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:55.277155 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:55.305245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48582dac-b27c-41af-9f95-0fa7a569c7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:55.305862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48582dac-b27c-41af-9f95-0fa7a569c7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:55.306173 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48582dac-b27c-41af-9f95-0fa7a569c7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:55.306445 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48582dac-b27c-41af-9f95-0fa7a569c7e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:55.307096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48582dac-b27c-41af-9f95-0fa7a569c7e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:55.309244 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48582dac-b27c-41af-9f95-0fa7a569c7e9 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:55.391117 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1294/2612] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:12:55 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:12:55.395009 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f6f4e-9b80-4a62-9d15-3cc5bd5acfa7 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:55.408380 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f6f4e-9b80-4a62-9d15-3cc5bd5acfa7 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:55.410574 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475f97b-3764-4b1f-b944-da2f18556568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:55.411285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475f97b-3764-4b1f-b944-da2f18556568 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:55.411630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475f97b-3764-4b1f-b944-da2f18556568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:55.412006 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9475f97b-3764-4b1f-b944-da2f18556568 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:55.412721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475f97b-3764-4b1f-b944-da2f18556568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:55.414830 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9475f97b-3764-4b1f-b944-da2f18556568 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:55.426779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1319/2613] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:12:55.431229 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48582dac-b27c-41af-9f95-0fa7a569c7e9 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:55.443009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48582dac-b27c-41af-9f95-0fa7a569c7e9 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:55.447814 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe39b8-01d1-4ba5-aeb7-90de491e64d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:55.448468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe39b8-01d1-4ba5-aeb7-90de491e64d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:55.448750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe39b8-01d1-4ba5-aeb7-90de491e64d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:55.449026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe39b8-01d1-4ba5-aeb7-90de491e64d3 admin admin] PATH_INFO: `/v3/projects/3250950aa83843dca2097c1390c83df3/users/b6bd8a30760240428e57e234dc01cf17/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:55.464531 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe39b8-01d1-4ba5-aeb7-90de491e64d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3250950aa83843dca2097c1390c83df3, user_id=b6bd8a30760240428e57e234dc01cf17, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:55.467441 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe39b8-01d1-4ba5-aeb7-90de491e64d3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:55.597207 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1295/2614] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:12:55 2022] PUT /identity/v3/projects/3250950aa83843dca2097c1390c83df3/users/b6bd8a30760240428e57e234dc01cf17/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:12:55.601398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475f97b-3764-4b1f-b944-da2f18556568 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:55.607983 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:55.611608 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9475f97b-3764-4b1f-b944-da2f18556568 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:55.667250 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62f516-48d5-490f-8f05-1a4c27403c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:55.667848 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62f516-48d5-490f-8f05-1a4c27403c81 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:55.668123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62f516-48d5-490f-8f05-1a4c27403c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:55.668392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62f516-48d5-490f-8f05-1a4c27403c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:55.669067 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62f516-48d5-490f-8f05-1a4c27403c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:55.670636 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62f516-48d5-490f-8f05-1a4c27403c81 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:55.680575 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1320/2615] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:12:55.684987 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe39b8-01d1-4ba5-aeb7-90de491e64d3 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:55.695512 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe39b8-01d1-4ba5-aeb7-90de491e64d3 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:55.700396 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dd7b0-fffd-470f-9b25-c7c6aae95fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:55.701046 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dd7b0-fffd-470f-9b25-c7c6aae95fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:55.701347 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dd7b0-fffd-470f-9b25-c7c6aae95fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:55.701621 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dd7b0-fffd-470f-9b25-c7c6aae95fa9 admin admin] PATH_INFO: `/v3/projects/3250950aa83843dca2097c1390c83df3/users/b6bd8a30760240428e57e234dc01cf17/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:55.703618 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dd7b0-fffd-470f-9b25-c7c6aae95fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3250950aa83843dca2097c1390c83df3, user_id=b6bd8a30760240428e57e234dc01cf17, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:55.706278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dd7b0-fffd-470f-9b25-c7c6aae95fa9 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:55.716396 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1296/2616] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:12:55 2022] PUT /identity/v3/projects/3250950aa83843dca2097c1390c83df3/users/b6bd8a30760240428e57e234dc01cf17/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:12:55.727261 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e3143-5143-402d-a94d-40fe8d971028 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:55.727548 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e3143-5143-402d-a94d-40fe8d971028 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:55.727823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e3143-5143-402d-a94d-40fe8d971028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:55.755409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-df4e3143-5143-402d-a94d-40fe8d971028 None None] MFA Rules not processed for user `b6bd8a30760240428e57e234dc01cf17`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:12:55.757210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-df4e3143-5143-402d-a94d-40fe8d971028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:55.825258 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1321/2617] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:12:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:12:55.836832 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dd7b0-fffd-470f-9b25-c7c6aae95fa9 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:55.840985 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-250dd7b0-fffd-470f-9b25-c7c6aae95fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:55.902928 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dd7b0-fffd-470f-9b25-c7c6aae95fa9 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:55.906583 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84577fa3-0d69-4dd1-a32f-5da59a425975 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:55.907234 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84577fa3-0d69-4dd1-a32f-5da59a425975 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:55.907517 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84577fa3-0d69-4dd1-a32f-5da59a425975 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:55.907794 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84577fa3-0d69-4dd1-a32f-5da59a425975 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:55.918614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84577fa3-0d69-4dd1-a32f-5da59a425975 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:55.929380 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84577fa3-0d69-4dd1-a32f-5da59a425975 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:55.934030 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1297/2618] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:12:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:12:56.113197 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e3143-5143-402d-a94d-40fe8d971028 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:56.122958 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e3143-5143-402d-a94d-40fe8d971028 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:56.126843 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a98f5b-5e53-4fef-b34c-ba8bc158e8f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:56.127463 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a98f5b-5e53-4fef-b34c-ba8bc158e8f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:56.127842 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a98f5b-5e53-4fef-b34c-ba8bc158e8f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:56.128119 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a98f5b-5e53-4fef-b34c-ba8bc158e8f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:56.186010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a98f5b-5e53-4fef-b34c-ba8bc158e8f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:56.187486 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a98f5b-5e53-4fef-b34c-ba8bc158e8f0 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:56.196199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1322/2619] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:12:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:12:56.646431 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84577fa3-0d69-4dd1-a32f-5da59a425975 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:56.709623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84577fa3-0d69-4dd1-a32f-5da59a425975 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:56.714176 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998d4f9-0754-481a-80ca-336aa2d1c290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:56.714885 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998d4f9-0754-481a-80ca-336aa2d1c290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:56.715173 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998d4f9-0754-481a-80ca-336aa2d1c290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:56.715472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998d4f9-0754-481a-80ca-336aa2d1c290 admin admin] PATH_INFO: `/v3/users/7157291d3d0a436b91ac144730a41bf0` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:56.716585 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998d4f9-0754-481a-80ca-336aa2d1c290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7157291d3d0a436b91ac144730a41bf0)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:56.718491 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998d4f9-0754-481a-80ca-336aa2d1c290 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:56.809376 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:56.941885 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d998d4f9-0754-481a-80ca-336aa2d1c290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7157291d3d0a436b91ac144730a41bf0'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:56.954328 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d998d4f9-0754-481a-80ca-336aa2d1c290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7157291d3d0a436b91ac144730a41bf0'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:56.955114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d998d4f9-0754-481a-80ca-336aa2d1c290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7157291d3d0a436b91ac144730a41bf0'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:57.019274 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d998d4f9-0754-481a-80ca-336aa2d1c290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7157291d3d0a436b91ac144730a41bf0'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:57.027432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d998d4f9-0754-481a-80ca-336aa2d1c290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7157291d3d0a436b91ac144730a41bf0'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:57.035621 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1298/2620] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:12:56 2022] DELETE /identity/v3/users/7157291d3d0a436b91ac144730a41bf0 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:12:57.040973 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab07ae-2762-474e-8310-3174030693ce None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:57.041356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab07ae-2762-474e-8310-3174030693ce None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:57.041702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab07ae-2762-474e-8310-3174030693ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:57.062202 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-53ab07ae-2762-474e-8310-3174030693ce None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:12:57.063459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-53ab07ae-2762-474e-8310-3174030693ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:57.084080 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:57.129550 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1323/2621] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:12:57.144972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998d4f9-0754-481a-80ca-336aa2d1c290 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:57.146534 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d998d4f9-0754-481a-80ca-336aa2d1c290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:57.207825 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998d4f9-0754-481a-80ca-336aa2d1c290 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:57.211400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7bbaf-725a-4228-8fa0-e1cdef8f35cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:57.212021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7bbaf-725a-4228-8fa0-e1cdef8f35cf service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:57.212370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7bbaf-725a-4228-8fa0-e1cdef8f35cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:57.212552 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7bbaf-725a-4228-8fa0-e1cdef8f35cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:57.222015 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7bbaf-725a-4228-8fa0-e1cdef8f35cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:57.223507 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7bbaf-725a-4228-8fa0-e1cdef8f35cf service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:57.233033 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1299/2622] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:12:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:12:57.694587 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab07ae-2762-474e-8310-3174030693ce None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:57.696110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-53ab07ae-2762-474e-8310-3174030693ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:57.713208 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab07ae-2762-474e-8310-3174030693ce None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:57.713208 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216e298-5a9f-4956-9470-5e01236fc53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:57.714306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216e298-5a9f-4956-9470-5e01236fc53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:57.714306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216e298-5a9f-4956-9470-5e01236fc53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:57.714528 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216e298-5a9f-4956-9470-5e01236fc53d admin admin] PATH_INFO: `/v3/projects/7377e494ee984bfe8c269e35db233b46` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:57.715618 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216e298-5a9f-4956-9470-5e01236fc53d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7377e494ee984bfe8c269e35db233b46)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:57.717663 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216e298-5a9f-4956-9470-5e01236fc53d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:57.906409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8216e298-5a9f-4956-9470-5e01236fc53d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7377e494ee984bfe8c269e35db233b46', 'request_id': 'req-8216e298-5a9f-4956-9470-5e01236fc53d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:57.912320 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8216e298-5a9f-4956-9470-5e01236fc53d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7377e494ee984bfe8c269e35db233b46', 'request_id': 'req-8216e298-5a9f-4956-9470-5e01236fc53d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:57.990277 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8216e298-5a9f-4956-9470-5e01236fc53d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7377e494ee984bfe8c269e35db233b46', 'request_id': 'req-8216e298-5a9f-4956-9470-5e01236fc53d'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:58.002114 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8216e298-5a9f-4956-9470-5e01236fc53d admin admin] The token cache is being invalidate because project 7377e494ee984bfe8c269e35db233b46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:12:58.002413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8216e298-5a9f-4956-9470-5e01236fc53d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:58.004073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-8216e298-5a9f-4956-9470-5e01236fc53d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:58.005575 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1324/2623] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:12:57 2022] DELETE /identity/v3/projects/7377e494ee984bfe8c269e35db233b46 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:12:58.009595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7bbaf-725a-4228-8fa0-e1cdef8f35cf service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:58.020499 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7bbaf-725a-4228-8fa0-e1cdef8f35cf service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:58.080605 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd8400-0a8b-4408-836f-7054e6a727f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:58.085115 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd8400-0a8b-4408-836f-7054e6a727f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:58.085115 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd8400-0a8b-4408-836f-7054e6a727f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:58.085115 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd8400-0a8b-4408-836f-7054e6a727f1 admin admin] PATH_INFO: `/v3/users/b6bd8a30760240428e57e234dc01cf17` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:58.085115 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd8400-0a8b-4408-836f-7054e6a727f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6bd8a30760240428e57e234dc01cf17)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:58.086115 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd8400-0a8b-4408-836f-7054e6a727f1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:58.349274 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-4bdd8400-0a8b-4408-836f-7054e6a727f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6bd8a30760240428e57e234dc01cf17'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:58.351719 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:58.362953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-4bdd8400-0a8b-4408-836f-7054e6a727f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6bd8a30760240428e57e234dc01cf17'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:58.363853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-4bdd8400-0a8b-4408-836f-7054e6a727f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6bd8a30760240428e57e234dc01cf17'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:58.430596 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-4bdd8400-0a8b-4408-836f-7054e6a727f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6bd8a30760240428e57e234dc01cf17'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:58.438186 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-4bdd8400-0a8b-4408-836f-7054e6a727f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6bd8a30760240428e57e234dc01cf17'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:58.445762 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1300/2624] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:12:58 2022] DELETE /identity/v3/users/b6bd8a30760240428e57e234dc01cf17 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:12:58.901022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216e298-5a9f-4956-9470-5e01236fc53d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:58.903274 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8216e298-5a9f-4956-9470-5e01236fc53d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:58.920650 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216e298-5a9f-4956-9470-5e01236fc53d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:58.989402 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8214c-c044-4f31-b263-f7cacda8d14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:58.990127 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8214c-c044-4f31-b263-f7cacda8d14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:58.990416 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8214c-c044-4f31-b263-f7cacda8d14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:58.990679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8214c-c044-4f31-b263-f7cacda8d14f admin admin] PATH_INFO: `/v3/projects/3250950aa83843dca2097c1390c83df3` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:58.991922 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8214c-c044-4f31-b263-f7cacda8d14f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3250950aa83843dca2097c1390c83df3)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:58.994019 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8214c-c044-4f31-b263-f7cacda8d14f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:59.124201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c7f8214c-c044-4f31-b263-f7cacda8d14f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3250950aa83843dca2097c1390c83df3', 'request_id': 'req-c7f8214c-c044-4f31-b263-f7cacda8d14f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:59.125373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:59.130182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c7f8214c-c044-4f31-b263-f7cacda8d14f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3250950aa83843dca2097c1390c83df3', 'request_id': 'req-c7f8214c-c044-4f31-b263-f7cacda8d14f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:59.242117 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c7f8214c-c044-4f31-b263-f7cacda8d14f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3250950aa83843dca2097c1390c83df3', 'request_id': 'req-c7f8214c-c044-4f31-b263-f7cacda8d14f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:59.255229 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c7f8214c-c044-4f31-b263-f7cacda8d14f admin admin] The token cache is being invalidate because project 3250950aa83843dca2097c1390c83df3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:12:59.255698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c7f8214c-c044-4f31-b263-f7cacda8d14f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:59.256359 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-c7f8214c-c044-4f31-b263-f7cacda8d14f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:12:59.257869 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1325/2625] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:12:58 2022] DELETE /identity/v3/projects/3250950aa83843dca2097c1390c83df3 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:12:59.262730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a93be-4dfc-4121-8404-730c5fd3e342 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:59.263365 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a93be-4dfc-4121-8404-730c5fd3e342 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:59.263365 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a93be-4dfc-4121-8404-730c5fd3e342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:59.284610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-860a93be-4dfc-4121-8404-730c5fd3e342 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:12:59.285819 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-860a93be-4dfc-4121-8404-730c5fd3e342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:59.349998 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1301/2626] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:12:59.359323 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2e130-3373-4834-ac36-06bf25bc98ed None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:59.359612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2e130-3373-4834-ac36-06bf25bc98ed None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:59.359891 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2e130-3373-4834-ac36-06bf25bc98ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:59.380002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-d3f2e130-3373-4834-ac36-06bf25bc98ed None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:12:59.381250 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d3f2e130-3373-4834-ac36-06bf25bc98ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:12:59.395366 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1326/2627] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:12:59.399874 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a93be-4dfc-4121-8404-730c5fd3e342 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:59.412373 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a93be-4dfc-4121-8404-730c5fd3e342 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:59.417594 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfbb08-a5b4-4912-9fa4-83f142e08b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:59.418326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfbb08-a5b4-4912-9fa4-83f142e08b19 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:59.418677 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfbb08-a5b4-4912-9fa4-83f142e08b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:59.419085 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfbb08-a5b4-4912-9fa4-83f142e08b19 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:59.419821 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfbb08-a5b4-4912-9fa4-83f142e08b19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:12:59.420200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfbb08-a5b4-4912-9fa4-83f142e08b19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:59.421944 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfbb08-a5b4-4912-9fa4-83f142e08b19 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:59.445204 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1302/2628] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:12:59.454552 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2e130-3373-4834-ac36-06bf25bc98ed None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:59.466067 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2e130-3373-4834-ac36-06bf25bc98ed None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:59.471041 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65408af-c2db-4ceb-b743-2acceec3b5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:59.472279 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65408af-c2db-4ceb-b743-2acceec3b5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:59.477627 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65408af-c2db-4ceb-b743-2acceec3b5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:59.477627 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65408af-c2db-4ceb-b743-2acceec3b5f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:59.477627 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65408af-c2db-4ceb-b743-2acceec3b5f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:59.477627 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65408af-c2db-4ceb-b743-2acceec3b5f0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:59.615053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1327/2629] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:12:59 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:12:59.619258 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfbb08-a5b4-4912-9fa4-83f142e08b19 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:59.630311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfbb08-a5b4-4912-9fa4-83f142e08b19 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:59.687704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67155f4c-df8d-41ae-871d-ca80a2a772a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:59.688317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67155f4c-df8d-41ae-871d-ca80a2a772a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:59.688579 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67155f4c-df8d-41ae-871d-ca80a2a772a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:59.688853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67155f4c-df8d-41ae-871d-ca80a2a772a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:59.689472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67155f4c-df8d-41ae-871d-ca80a2a772a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:59.691958 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67155f4c-df8d-41ae-871d-ca80a2a772a9 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:59.772608 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1303/2630] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:12:59 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:12:59.777434 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65408af-c2db-4ceb-b743-2acceec3b5f0 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:59.788059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65408af-c2db-4ceb-b743-2acceec3b5f0 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:59.792581 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1f1e8-287d-45b9-a1d4-003bf101b3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:59.793302 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1f1e8-287d-45b9-a1d4-003bf101b3cb admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:59.793483 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1f1e8-287d-45b9-a1d4-003bf101b3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:59.793751 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1f1e8-287d-45b9-a1d4-003bf101b3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:59.794416 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1f1e8-287d-45b9-a1d4-003bf101b3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:59.796030 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1f1e8-287d-45b9-a1d4-003bf101b3cb admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:59.807239 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1328/2631] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:12:59.811566 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67155f4c-df8d-41ae-871d-ca80a2a772a9 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:59.822454 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67155f4c-df8d-41ae-871d-ca80a2a772a9 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:59.827131 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb47b23-2b6a-4e9d-89ce-0937fcbe90d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:59.827728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb47b23-2b6a-4e9d-89ce-0937fcbe90d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:59.828006 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb47b23-2b6a-4e9d-89ce-0937fcbe90d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:59.828284 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb47b23-2b6a-4e9d-89ce-0937fcbe90d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:59.828925 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb47b23-2b6a-4e9d-89ce-0937fcbe90d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:59.830543 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb47b23-2b6a-4e9d-89ce-0937fcbe90d7 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:59.841350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1304/2632] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:12:59.845590 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1f1e8-287d-45b9-a1d4-003bf101b3cb admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:12:59.855805 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1f1e8-287d-45b9-a1d4-003bf101b3cb admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:12:59.860960 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36344dd6-6401-44d6-bd5e-360d2f746f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:12:59.861607 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36344dd6-6401-44d6-bd5e-360d2f746f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:12:59.862513 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36344dd6-6401-44d6-bd5e-360d2f746f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:12:59.862964 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36344dd6-6401-44d6-bd5e-360d2f746f96 admin admin] PATH_INFO: `/v3/projects/6fc2aa966c1243a8af594a9473f589cf/users/6eb2600cf9f64d22b22f3f8a77e044de/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:12:59.877196 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36344dd6-6401-44d6-bd5e-360d2f746f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc2aa966c1243a8af594a9473f589cf, user_id=6eb2600cf9f64d22b22f3f8a77e044de, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:12:59.880593 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36344dd6-6401-44d6-bd5e-360d2f746f96 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:12:59.991355 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1329/2633] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:12:59 2022] PUT /identity/v3/projects/6fc2aa966c1243a8af594a9473f589cf/users/6eb2600cf9f64d22b22f3f8a77e044de/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:00.001731 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569213e2-d1e3-4aad-be6a-35ba600ba45b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:00.002024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569213e2-d1e3-4aad-be6a-35ba600ba45b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:00.002305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569213e2-d1e3-4aad-be6a-35ba600ba45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:00.032575 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-569213e2-d1e3-4aad-be6a-35ba600ba45b None None] MFA Rules not processed for user `6eb2600cf9f64d22b22f3f8a77e044de`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:00.034115 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-569213e2-d1e3-4aad-be6a-35ba600ba45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:00.054395 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:00.098355 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1305/2634] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:00.110356 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36344dd6-6401-44d6-bd5e-360d2f746f96 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:00.112669 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-36344dd6-6401-44d6-bd5e-360d2f746f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:00.169645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36344dd6-6401-44d6-bd5e-360d2f746f96 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:00.173301 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95358628-ecac-461c-9e2d-5e1649b2a6b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fe013f66e2452eaaf84d4b52eca489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:00.173899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95358628-ecac-461c-9e2d-5e1649b2a6b8 service glance] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:00.174235 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95358628-ecac-461c-9e2d-5e1649b2a6b8 service glance] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:00.175158 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95358628-ecac-461c-9e2d-5e1649b2a6b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:00.183442 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95358628-ecac-461c-9e2d-5e1649b2a6b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:00.184870 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95358628-ecac-461c-9e2d-5e1649b2a6b8 service glance] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:00.193601 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1330/2635] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:13:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:13:04.282510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569213e2-d1e3-4aad-be6a-35ba600ba45b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:04.283954 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-569213e2-d1e3-4aad-be6a-35ba600ba45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:04.342396 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569213e2-d1e3-4aad-be6a-35ba600ba45b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:04.346350 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35aee7-f57d-46e1-bd88-d07fa2ff8e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:04.347263 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35aee7-f57d-46e1-bd88-d07fa2ff8e7f service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:04.347550 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35aee7-f57d-46e1-bd88-d07fa2ff8e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:04.347826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35aee7-f57d-46e1-bd88-d07fa2ff8e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:04.349636 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-eb35aee7-f57d-46e1-bd88-d07fa2ff8e7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:04.414217 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35aee7-f57d-46e1-bd88-d07fa2ff8e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:04.415681 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35aee7-f57d-46e1-bd88-d07fa2ff8e7f service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:04.426731 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1306/2636] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:13:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:13:08.287773 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95358628-ecac-461c-9e2d-5e1649b2a6b8 service glance] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:08.289339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-95358628-ecac-461c-9e2d-5e1649b2a6b8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:08.303933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95358628-ecac-461c-9e2d-5e1649b2a6b8 service glance] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:08.308499 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac1d26-8ee4-4e51-b9ce-5082c750d8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:08.309207 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac1d26-8ee4-4e51-b9ce-5082c750d8c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:08.309697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac1d26-8ee4-4e51-b9ce-5082c750d8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:08.309981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac1d26-8ee4-4e51-b9ce-5082c750d8c4 admin admin] PATH_INFO: `/v3/users/060fd4adbdce44dfbf65e21561bfa532` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:08.311262 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac1d26-8ee4-4e51-b9ce-5082c750d8c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=060fd4adbdce44dfbf65e21561bfa532)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:08.313227 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac1d26-8ee4-4e51-b9ce-5082c750d8c4 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:08.518674 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-84ac1d26-8ee4-4e51-b9ce-5082c750d8c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '060fd4adbdce44dfbf65e21561bfa532'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:08.519431 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-84ac1d26-8ee4-4e51-b9ce-5082c750d8c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '060fd4adbdce44dfbf65e21561bfa532'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:08.532672 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-84ac1d26-8ee4-4e51-b9ce-5082c750d8c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '060fd4adbdce44dfbf65e21561bfa532'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:08.537933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:08.539849 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-84ac1d26-8ee4-4e51-b9ce-5082c750d8c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '060fd4adbdce44dfbf65e21561bfa532'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:08.624187 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-84ac1d26-8ee4-4e51-b9ce-5082c750d8c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '060fd4adbdce44dfbf65e21561bfa532'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:08.631973 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1331/2637] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:13:08 2022] DELETE /identity/v3/users/060fd4adbdce44dfbf65e21561bfa532 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:08.917434 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35aee7-f57d-46e1-bd88-d07fa2ff8e7f service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:08.929616 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35aee7-f57d-46e1-bd88-d07fa2ff8e7f service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:08.991820 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c3d2f-9c3b-43e8-b168-a105628d370c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:08.992458 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c3d2f-9c3b-43e8-b168-a105628d370c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:08.992737 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c3d2f-9c3b-43e8-b168-a105628d370c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:08.993033 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c3d2f-9c3b-43e8-b168-a105628d370c admin admin] PATH_INFO: `/v3/projects/d7c5801ef6e4451e93be86c6870a07f9` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:08.994132 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c3d2f-9c3b-43e8-b168-a105628d370c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c5801ef6e4451e93be86c6870a07f9)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:08.996058 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c3d2f-9c3b-43e8-b168-a105628d370c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:09.012668 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:09.195803 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0b4c3d2f-9c3b-43e8-b168-a105628d370c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c5801ef6e4451e93be86c6870a07f9', 'request_id': 'req-0b4c3d2f-9c3b-43e8-b168-a105628d370c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:09.201212 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0b4c3d2f-9c3b-43e8-b168-a105628d370c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c5801ef6e4451e93be86c6870a07f9', 'request_id': 'req-0b4c3d2f-9c3b-43e8-b168-a105628d370c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:09.208153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0b4c3d2f-9c3b-43e8-b168-a105628d370c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c5801ef6e4451e93be86c6870a07f9', 'request_id': 'req-0b4c3d2f-9c3b-43e8-b168-a105628d370c'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:09.342945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0b4c3d2f-9c3b-43e8-b168-a105628d370c admin admin] The token cache is being invalidate because project d7c5801ef6e4451e93be86c6870a07f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:13:09.343237 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0b4c3d2f-9c3b-43e8-b168-a105628d370c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:09.343892 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0b4c3d2f-9c3b-43e8-b168-a105628d370c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:09.345383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1307/2638] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:13:08 2022] DELETE /identity/v3/projects/d7c5801ef6e4451e93be86c6870a07f9 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:09.351034 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e08c6c-da12-4d1e-9c30-d16d2117911e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:09.355829 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e08c6c-da12-4d1e-9c30-d16d2117911e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:09.355829 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e08c6c-da12-4d1e-9c30-d16d2117911e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:09.373518 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-88e08c6c-da12-4d1e-9c30-d16d2117911e None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:09.374722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-88e08c6c-da12-4d1e-9c30-d16d2117911e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:09.436384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1332/2639] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:09.444869 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ea4ff-9f7d-496b-b0d3-1058c80f3ce7 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:09.445274 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ea4ff-9f7d-496b-b0d3-1058c80f3ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:09.445694 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ea4ff-9f7d-496b-b0d3-1058c80f3ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:09.467579 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7b6ea4ff-9f7d-496b-b0d3-1058c80f3ce7 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:09.468794 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7b6ea4ff-9f7d-496b-b0d3-1058c80f3ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:09.477959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1308/2640] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 11 11:13:09.482480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e08c6c-da12-4d1e-9c30-d16d2117911e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:09.492411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e08c6c-da12-4d1e-9c30-d16d2117911e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:09.496935 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81186cc9-f4d7-4e47-a9a1-0d8eb974e0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:09.497522 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81186cc9-f4d7-4e47-a9a1-0d8eb974e0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:09.497798 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81186cc9-f4d7-4e47-a9a1-0d8eb974e0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:09.498068 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81186cc9-f4d7-4e47-a9a1-0d8eb974e0a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:09.498734 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81186cc9-f4d7-4e47-a9a1-0d8eb974e0a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:13:09.499064 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81186cc9-f4d7-4e47-a9a1-0d8eb974e0a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:09.500651 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81186cc9-f4d7-4e47-a9a1-0d8eb974e0a9 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:09.512671 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1333/2641] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:13:09.517337 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ea4ff-9f7d-496b-b0d3-1058c80f3ce7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:09.527121 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ea4ff-9f7d-496b-b0d3-1058c80f3ce7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:09.531810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfc963-a525-4550-a644-bb756fa832f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:09.532404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfc963-a525-4550-a644-bb756fa832f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:09.532680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfc963-a525-4550-a644-bb756fa832f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:09.532951 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfc963-a525-4550-a644-bb756fa832f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:09.534506 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dfc963-a525-4550-a644-bb756fa832f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:09.536422 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dfc963-a525-4550-a644-bb756fa832f2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:09.650678 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1309/2642] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:13:09 2022] POST /identity/v3/projects => generated 405 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:13:09.654849 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81186cc9-f4d7-4e47-a9a1-0d8eb974e0a9 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:09.665551 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81186cc9-f4d7-4e47-a9a1-0d8eb974e0a9 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:09.721946 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5603492-2a18-4167-8e16-2726faa8f6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:09.722456 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5603492-2a18-4167-8e16-2726faa8f6a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:09.722733 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5603492-2a18-4167-8e16-2726faa8f6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:09.723029 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5603492-2a18-4167-8e16-2726faa8f6a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:09.723637 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5603492-2a18-4167-8e16-2726faa8f6a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:09.725545 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5603492-2a18-4167-8e16-2726faa8f6a1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:09.813901 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1334/2643] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:13:09 2022] POST /identity/v3/users => generated 303 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:13:09.818835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfc963-a525-4550-a644-bb756fa832f2 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:09.829228 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfc963-a525-4550-a644-bb756fa832f2 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:09.834877 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78d58a-ef05-489a-a7b0-6639630791df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:09.835473 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78d58a-ef05-489a-a7b0-6639630791df admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:09.835756 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78d58a-ef05-489a-a7b0-6639630791df admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:09.836030 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78d58a-ef05-489a-a7b0-6639630791df admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:09.836671 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78d58a-ef05-489a-a7b0-6639630791df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:09.838316 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78d58a-ef05-489a-a7b0-6639630791df admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:09.848714 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1310/2644] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:13:09.852689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5603492-2a18-4167-8e16-2726faa8f6a1 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:09.863296 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5603492-2a18-4167-8e16-2726faa8f6a1 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:09.867988 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112768e2-c286-499b-bdeb-a19a78335467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:09.868696 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112768e2-c286-499b-bdeb-a19a78335467 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:09.869025 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112768e2-c286-499b-bdeb-a19a78335467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:09.869297 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112768e2-c286-499b-bdeb-a19a78335467 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:09.869937 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112768e2-c286-499b-bdeb-a19a78335467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:09.871603 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112768e2-c286-499b-bdeb-a19a78335467 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:09.882811 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1335/2645] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:13:09.887056 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78d58a-ef05-489a-a7b0-6639630791df admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:09.897936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78d58a-ef05-489a-a7b0-6639630791df admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:09.902946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4377c1-fb13-4349-bb38-2c94dffceac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:09.903609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4377c1-fb13-4349-bb38-2c94dffceac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:09.903896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4377c1-fb13-4349-bb38-2c94dffceac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:09.904170 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4377c1-fb13-4349-bb38-2c94dffceac4 admin admin] PATH_INFO: `/v3/projects/4fad4b27b2fa430386cc8a8da6cec467/users/8dd8ce84d7dd44c982b44d5ad6330855/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:09.919245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4377c1-fb13-4349-bb38-2c94dffceac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fad4b27b2fa430386cc8a8da6cec467, user_id=8dd8ce84d7dd44c982b44d5ad6330855, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:09.921913 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4377c1-fb13-4349-bb38-2c94dffceac4 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:10.000787 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1311/2646] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:13:09 2022] PUT /identity/v3/projects/4fad4b27b2fa430386cc8a8da6cec467/users/8dd8ce84d7dd44c982b44d5ad6330855/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:10.011959 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac1c08-226c-452f-9b9e-c3c459707299 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:10.020377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac1c08-226c-452f-9b9e-c3c459707299 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:10.020377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac1c08-226c-452f-9b9e-c3c459707299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:10.042589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-65ac1c08-226c-452f-9b9e-c3c459707299 None None] MFA Rules not processed for user `8dd8ce84d7dd44c982b44d5ad6330855`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:10.043964 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-65ac1c08-226c-452f-9b9e-c3c459707299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:10.092228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:10.115769 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1336/2647] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:10 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:10.120317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4377c1-fb13-4349-bb38-2c94dffceac4 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:10.183931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4377c1-fb13-4349-bb38-2c94dffceac4 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:10.189009 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122da8c1-cdf3-494f-b574-8305ba8c94d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:10.190449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122da8c1-cdf3-494f-b574-8305ba8c94d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:10.190735 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122da8c1-cdf3-494f-b574-8305ba8c94d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:10.191033 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122da8c1-cdf3-494f-b574-8305ba8c94d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:10.191685 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122da8c1-cdf3-494f-b574-8305ba8c94d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:10.193689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122da8c1-cdf3-494f-b574-8305ba8c94d0 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:10.340740 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1312/2648] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:13:10 2022] POST /identity/v3/projects => generated 405 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:13:10.345018 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac1c08-226c-452f-9b9e-c3c459707299 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:10.358189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac1c08-226c-452f-9b9e-c3c459707299 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:10.415737 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7754b4-0145-40ef-815d-e2eff6216bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:10.416338 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7754b4-0145-40ef-815d-e2eff6216bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:10.416612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7754b4-0145-40ef-815d-e2eff6216bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:10.416881 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7754b4-0145-40ef-815d-e2eff6216bd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:10.417495 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7754b4-0145-40ef-815d-e2eff6216bd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:10.419437 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7754b4-0145-40ef-815d-e2eff6216bd7 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:10.515965 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1337/2649] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:13:10 2022] POST /identity/v3/users => generated 309 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:13:10.520729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122da8c1-cdf3-494f-b574-8305ba8c94d0 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:10.532131 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122da8c1-cdf3-494f-b574-8305ba8c94d0 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:10.537050 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1330538-441f-4040-bdf1-8dcddff2be6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:10.537699 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1330538-441f-4040-bdf1-8dcddff2be6f admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:10.537988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1330538-441f-4040-bdf1-8dcddff2be6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:10.538260 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1330538-441f-4040-bdf1-8dcddff2be6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:10.538939 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1330538-441f-4040-bdf1-8dcddff2be6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:10.540535 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1330538-441f-4040-bdf1-8dcddff2be6f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:10.554537 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1313/2650] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:13:10.558894 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7754b4-0145-40ef-815d-e2eff6216bd7 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:10.569468 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7754b4-0145-40ef-815d-e2eff6216bd7 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:10.574295 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083828d-b4ba-4182-a20a-67116b1abc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:10.575010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083828d-b4ba-4182-a20a-67116b1abc94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:10.575324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083828d-b4ba-4182-a20a-67116b1abc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:10.575675 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1083828d-b4ba-4182-a20a-67116b1abc94 admin admin] PATH_INFO: `/v3/projects/09949e59084743feb54c9fcb10f393cc/users/402fa345a76043878362a1a2a2b961aa/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:10.591626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083828d-b4ba-4182-a20a-67116b1abc94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09949e59084743feb54c9fcb10f393cc, user_id=402fa345a76043878362a1a2a2b961aa, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:10.594298 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1083828d-b4ba-4182-a20a-67116b1abc94 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:10.727459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1338/2651] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:13:10 2022] PUT /identity/v3/projects/09949e59084743feb54c9fcb10f393cc/users/402fa345a76043878362a1a2a2b961aa/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:10.731492 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1330538-441f-4040-bdf1-8dcddff2be6f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:10.742383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1330538-441f-4040-bdf1-8dcddff2be6f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:10.750863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:10.797521 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c79067-5884-445e-b645-d7d927cebeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:10.798122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c79067-5884-445e-b645-d7d927cebeaf admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:10.798405 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c79067-5884-445e-b645-d7d927cebeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:10.798741 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c79067-5884-445e-b645-d7d927cebeaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:10.800033 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c79067-5884-445e-b645-d7d927cebeaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:10.801645 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c79067-5884-445e-b645-d7d927cebeaf admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:10.811086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1314/2652] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:13:10.815306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083828d-b4ba-4182-a20a-67116b1abc94 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:10.825364 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1083828d-b4ba-4182-a20a-67116b1abc94 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:10.830385 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8655aa3-aa7a-40d2-9910-6dc9d1186dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:10.831075 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8655aa3-aa7a-40d2-9910-6dc9d1186dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:10.831352 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8655aa3-aa7a-40d2-9910-6dc9d1186dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:10.831628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8655aa3-aa7a-40d2-9910-6dc9d1186dbd admin admin] PATH_INFO: `/v3/projects/09949e59084743feb54c9fcb10f393cc/users/402fa345a76043878362a1a2a2b961aa/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:10.833542 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8655aa3-aa7a-40d2-9910-6dc9d1186dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=09949e59084743feb54c9fcb10f393cc, user_id=402fa345a76043878362a1a2a2b961aa, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:10.836207 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8655aa3-aa7a-40d2-9910-6dc9d1186dbd admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:10.847729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1339/2653] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:13:10 2022] PUT /identity/v3/projects/09949e59084743feb54c9fcb10f393cc/users/402fa345a76043878362a1a2a2b961aa/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:10.859569 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b44ef-8e73-46b7-afd8-5bdd4b7714a1 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:10.859863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b44ef-8e73-46b7-afd8-5bdd4b7714a1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:10.860143 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b44ef-8e73-46b7-afd8-5bdd4b7714a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:10.887462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ed5b44ef-8e73-46b7-afd8-5bdd4b7714a1 None None] MFA Rules not processed for user `402fa345a76043878362a1a2a2b961aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:10.888662 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ed5b44ef-8e73-46b7-afd8-5bdd4b7714a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:10.956500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1315/2654] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:10 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:13:10.967094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8655aa3-aa7a-40d2-9910-6dc9d1186dbd admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:10.968763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b8655aa3-aa7a-40d2-9910-6dc9d1186dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:11.026350 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8655aa3-aa7a-40d2-9910-6dc9d1186dbd admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:11.030252 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec2eda-9322-421c-9d4a-46f70fbd5027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:11.030895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec2eda-9322-421c-9d4a-46f70fbd5027 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:11.031199 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec2eda-9322-421c-9d4a-46f70fbd5027 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:11.031441 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec2eda-9322-421c-9d4a-46f70fbd5027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:11.042707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec2eda-9322-421c-9d4a-46f70fbd5027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:11.044333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec2eda-9322-421c-9d4a-46f70fbd5027 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:11.054456 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1340/2655] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:13:10 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:13:11.289305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b44ef-8e73-46b7-afd8-5bdd4b7714a1 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:11.353503 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b44ef-8e73-46b7-afd8-5bdd4b7714a1 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:11.358202 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d87ae-7c9d-4933-8611-6df61ed9447c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:11.358853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d87ae-7c9d-4933-8611-6df61ed9447c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:11.359146 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d87ae-7c9d-4933-8611-6df61ed9447c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:11.359422 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d87ae-7c9d-4933-8611-6df61ed9447c admin admin] PATH_INFO: `/v3/users/8dd8ce84d7dd44c982b44d5ad6330855` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:11.360675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d87ae-7c9d-4933-8611-6df61ed9447c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dd8ce84d7dd44c982b44d5ad6330855)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:11.363029 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d87ae-7c9d-4933-8611-6df61ed9447c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:11.594257 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:11.602583 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5e6d87ae-7c9d-4933-8611-6df61ed9447c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dd8ce84d7dd44c982b44d5ad6330855'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:11.614785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5e6d87ae-7c9d-4933-8611-6df61ed9447c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dd8ce84d7dd44c982b44d5ad6330855'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:11.615400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5e6d87ae-7c9d-4933-8611-6df61ed9447c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dd8ce84d7dd44c982b44d5ad6330855'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:11.687015 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5e6d87ae-7c9d-4933-8611-6df61ed9447c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dd8ce84d7dd44c982b44d5ad6330855'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:11.694912 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-5e6d87ae-7c9d-4933-8611-6df61ed9447c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dd8ce84d7dd44c982b44d5ad6330855'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:11.700661 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1316/2656] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:13:11 2022] DELETE /identity/v3/users/8dd8ce84d7dd44c982b44d5ad6330855 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:11.705804 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44832b97-8c6d-4299-867d-7502a603b25e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:11.706270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44832b97-8c6d-4299-867d-7502a603b25e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:11.706560 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44832b97-8c6d-4299-867d-7502a603b25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:11.724931 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-44832b97-8c6d-4299-867d-7502a603b25e None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:11.726116 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-44832b97-8c6d-4299-867d-7502a603b25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:11.759420 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:11.784291 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1341/2657] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:11.793985 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d87ae-7c9d-4933-8611-6df61ed9447c admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:11.795424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5e6d87ae-7c9d-4933-8611-6df61ed9447c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:11.852580 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d87ae-7c9d-4933-8611-6df61ed9447c admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:11.856157 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a732a-ecd4-4e43-8310-a1a612f892ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:11.856765 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a732a-ecd4-4e43-8310-a1a612f892ab service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:11.858933 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a732a-ecd4-4e43-8310-a1a612f892ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:11.858933 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a732a-ecd4-4e43-8310-a1a612f892ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:11.867335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a732a-ecd4-4e43-8310-a1a612f892ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:11.868698 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a732a-ecd4-4e43-8310-a1a612f892ab service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:11.878582 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1317/2658] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:13:12.522433 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44832b97-8c6d-4299-867d-7502a603b25e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:12.524067 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-44832b97-8c6d-4299-867d-7502a603b25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:12.535970 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44832b97-8c6d-4299-867d-7502a603b25e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:12.541001 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7b8c6-675c-4f41-b13d-b29ec0677040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:12.541641 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7b8c6-675c-4f41-b13d-b29ec0677040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:12.541920 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7b8c6-675c-4f41-b13d-b29ec0677040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:12.542191 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7b8c6-675c-4f41-b13d-b29ec0677040 admin admin] PATH_INFO: `/v3/projects/4fad4b27b2fa430386cc8a8da6cec467` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:12.543392 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7b8c6-675c-4f41-b13d-b29ec0677040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fad4b27b2fa430386cc8a8da6cec467)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:12.545327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7b8c6-675c-4f41-b13d-b29ec0677040 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:12.669891 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1ca7b8c6-675c-4f41-b13d-b29ec0677040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fad4b27b2fa430386cc8a8da6cec467', 'request_id': 'req-1ca7b8c6-675c-4f41-b13d-b29ec0677040'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:12.675877 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1ca7b8c6-675c-4f41-b13d-b29ec0677040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fad4b27b2fa430386cc8a8da6cec467', 'request_id': 'req-1ca7b8c6-675c-4f41-b13d-b29ec0677040'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:12.767190 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1ca7b8c6-675c-4f41-b13d-b29ec0677040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fad4b27b2fa430386cc8a8da6cec467', 'request_id': 'req-1ca7b8c6-675c-4f41-b13d-b29ec0677040'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:12.778549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1ca7b8c6-675c-4f41-b13d-b29ec0677040 admin admin] The token cache is being invalidate because project 4fad4b27b2fa430386cc8a8da6cec467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:13:12.778875 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1ca7b8c6-675c-4f41-b13d-b29ec0677040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:12.779511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-1ca7b8c6-675c-4f41-b13d-b29ec0677040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:12.780972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1342/2659] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:13:12 2022] DELETE /identity/v3/projects/4fad4b27b2fa430386cc8a8da6cec467 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:12.785095 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a732a-ecd4-4e43-8310-a1a612f892ab service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:12.794785 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a732a-ecd4-4e43-8310-a1a612f892ab service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:12.853049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070456aa-b43c-4cd4-8c83-7bcf8f476b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:12.853598 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070456aa-b43c-4cd4-8c83-7bcf8f476b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:12.853884 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070456aa-b43c-4cd4-8c83-7bcf8f476b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:12.854163 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070456aa-b43c-4cd4-8c83-7bcf8f476b5e admin admin] PATH_INFO: `/v3/users/402fa345a76043878362a1a2a2b961aa` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:12.855298 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070456aa-b43c-4cd4-8c83-7bcf8f476b5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=402fa345a76043878362a1a2a2b961aa)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:12.857536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070456aa-b43c-4cd4-8c83-7bcf8f476b5e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:13.066670 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-070456aa-b43c-4cd4-8c83-7bcf8f476b5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '402fa345a76043878362a1a2a2b961aa'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:13.074596 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:13.079112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-070456aa-b43c-4cd4-8c83-7bcf8f476b5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '402fa345a76043878362a1a2a2b961aa'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:13.079846 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-070456aa-b43c-4cd4-8c83-7bcf8f476b5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '402fa345a76043878362a1a2a2b961aa'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:13.161085 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-070456aa-b43c-4cd4-8c83-7bcf8f476b5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '402fa345a76043878362a1a2a2b961aa'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:13.168249 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-070456aa-b43c-4cd4-8c83-7bcf8f476b5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '402fa345a76043878362a1a2a2b961aa'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:13.175038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1318/2660] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:13:12 2022] DELETE /identity/v3/users/402fa345a76043878362a1a2a2b961aa => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:13.580610 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7b8c6-675c-4f41-b13d-b29ec0677040 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:13.582083 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1ca7b8c6-675c-4f41-b13d-b29ec0677040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:13.594854 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7b8c6-675c-4f41-b13d-b29ec0677040 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:13.662658 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1e5a3-f224-4d2b-817f-5769fec6fbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:13.662658 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1e5a3-f224-4d2b-817f-5769fec6fbc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:13.662658 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1e5a3-f224-4d2b-817f-5769fec6fbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:13.662658 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1e5a3-f224-4d2b-817f-5769fec6fbc6 admin admin] PATH_INFO: `/v3/projects/09949e59084743feb54c9fcb10f393cc` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:13.663130 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1e5a3-f224-4d2b-817f-5769fec6fbc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09949e59084743feb54c9fcb10f393cc)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:13.663130 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1e5a3-f224-4d2b-817f-5769fec6fbc6 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:13.768165 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-bbf1e5a3-f224-4d2b-817f-5769fec6fbc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09949e59084743feb54c9fcb10f393cc', 'request_id': 'req-bbf1e5a3-f224-4d2b-817f-5769fec6fbc6'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:13.773772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-bbf1e5a3-f224-4d2b-817f-5769fec6fbc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09949e59084743feb54c9fcb10f393cc', 'request_id': 'req-bbf1e5a3-f224-4d2b-817f-5769fec6fbc6'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:13.847216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-bbf1e5a3-f224-4d2b-817f-5769fec6fbc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09949e59084743feb54c9fcb10f393cc', 'request_id': 'req-bbf1e5a3-f224-4d2b-817f-5769fec6fbc6'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:13.848453 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:13.859067 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-bbf1e5a3-f224-4d2b-817f-5769fec6fbc6 admin admin] The token cache is being invalidate because project 09949e59084743feb54c9fcb10f393cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:13:13.859359 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-bbf1e5a3-f224-4d2b-817f-5769fec6fbc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:13.859983 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-bbf1e5a3-f224-4d2b-817f-5769fec6fbc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:13.861705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1343/2661] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:13:13 2022] DELETE /identity/v3/projects/09949e59084743feb54c9fcb10f393cc => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:13.866863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259b43b-1193-44f8-a879-1c9a59abd0b6 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:13.867330 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259b43b-1193-44f8-a879-1c9a59abd0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:13.867425 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259b43b-1193-44f8-a879-1c9a59abd0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:13.889229 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8259b43b-1193-44f8-a879-1c9a59abd0b6 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:13.890425 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8259b43b-1193-44f8-a879-1c9a59abd0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:13.950000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1319/2662] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:13.958509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6127f-dc34-40be-b17e-a71aa7ebd959 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:13.958826 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6127f-dc34-40be-b17e-a71aa7ebd959 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:13.959100 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6127f-dc34-40be-b17e-a71aa7ebd959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:13.978354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-25c6127f-dc34-40be-b17e-a71aa7ebd959 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:13.979561 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-25c6127f-dc34-40be-b17e-a71aa7ebd959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:13.988369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1344/2663] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:13.992634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259b43b-1193-44f8-a879-1c9a59abd0b6 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:14.002813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259b43b-1193-44f8-a879-1c9a59abd0b6 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:14.007324 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30201317-e830-43b0-ad03-74120c38636a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:14.007911 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30201317-e830-43b0-ad03-74120c38636a admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:14.008188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30201317-e830-43b0-ad03-74120c38636a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:14.008455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30201317-e830-43b0-ad03-74120c38636a admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:14.009087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30201317-e830-43b0-ad03-74120c38636a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:13:14.009385 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30201317-e830-43b0-ad03-74120c38636a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:14.011029 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30201317-e830-43b0-ad03-74120c38636a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:14.022365 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1320/2664] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:13:14.026697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6127f-dc34-40be-b17e-a71aa7ebd959 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:14.036222 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6127f-dc34-40be-b17e-a71aa7ebd959 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:14.040865 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ff7e4-fc5b-4d34-82c8-3084ef147674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:14.041464 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ff7e4-fc5b-4d34-82c8-3084ef147674 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:14.041740 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ff7e4-fc5b-4d34-82c8-3084ef147674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:14.042007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ff7e4-fc5b-4d34-82c8-3084ef147674 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:14.042626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ff7e4-fc5b-4d34-82c8-3084ef147674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:14.044545 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ff7e4-fc5b-4d34-82c8-3084ef147674 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:14.180223 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1345/2665] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:13:14 2022] POST /identity/v3/projects => generated 363 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:13:14.184423 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30201317-e830-43b0-ad03-74120c38636a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:14.195185 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30201317-e830-43b0-ad03-74120c38636a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:14.249869 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a9ddf-6f62-4476-914d-1a12e1543a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:14.250420 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a9ddf-6f62-4476-914d-1a12e1543a0a admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:14.250720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a9ddf-6f62-4476-914d-1a12e1543a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:14.251041 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a9ddf-6f62-4476-914d-1a12e1543a0a admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:14.251852 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a9ddf-6f62-4476-914d-1a12e1543a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:14.254634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a9ddf-6f62-4476-914d-1a12e1543a0a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:14.355368 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1321/2666] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:13:14 2022] POST /identity/v3/users => generated 282 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:13:14.359951 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ff7e4-fc5b-4d34-82c8-3084ef147674 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:14.371254 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ff7e4-fc5b-4d34-82c8-3084ef147674 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:14.376062 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813dbc3b-62ba-4189-a772-898ff1e323ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:14.376825 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dbc3b-62ba-4189-a772-898ff1e323ed admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:14.377149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dbc3b-62ba-4189-a772-898ff1e323ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:14.377504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813dbc3b-62ba-4189-a772-898ff1e323ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:14.378176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813dbc3b-62ba-4189-a772-898ff1e323ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:14.379802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813dbc3b-62ba-4189-a772-898ff1e323ed admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:14.389553 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1346/2667] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:13:14.393591 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a9ddf-6f62-4476-914d-1a12e1543a0a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:14.403400 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a9ddf-6f62-4476-914d-1a12e1543a0a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:14.408508 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27168a-b508-422a-b9b6-485192a068df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:14.409205 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27168a-b508-422a-b9b6-485192a068df admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:14.409485 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27168a-b508-422a-b9b6-485192a068df admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:14.409758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27168a-b508-422a-b9b6-485192a068df admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:14.410421 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27168a-b508-422a-b9b6-485192a068df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:14.412150 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27168a-b508-422a-b9b6-485192a068df admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:14.422664 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1322/2668] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:13:14.427470 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813dbc3b-62ba-4189-a772-898ff1e323ed admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:14.437168 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813dbc3b-62ba-4189-a772-898ff1e323ed admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:14.441858 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda70bad-7b3f-4cf8-b6fa-aa4ec7e970f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:14.442498 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda70bad-7b3f-4cf8-b6fa-aa4ec7e970f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:14.442804 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda70bad-7b3f-4cf8-b6fa-aa4ec7e970f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:14.443078 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda70bad-7b3f-4cf8-b6fa-aa4ec7e970f4 admin admin] PATH_INFO: `/v3/projects/d840ea4809f44157baf4bb62282348de/users/c858e68ff08146bebee4d020a662f7e4/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:14.457903 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda70bad-7b3f-4cf8-b6fa-aa4ec7e970f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d840ea4809f44157baf4bb62282348de, user_id=c858e68ff08146bebee4d020a662f7e4, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:14.460566 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda70bad-7b3f-4cf8-b6fa-aa4ec7e970f4 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:14.538626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1347/2669] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:13:14 2022] PUT /identity/v3/projects/d840ea4809f44157baf4bb62282348de/users/c858e68ff08146bebee4d020a662f7e4/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:14.549585 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677b5eb-2894-4b9a-8dc1-332702dbb20e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:14.553149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677b5eb-2894-4b9a-8dc1-332702dbb20e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:14.553149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677b5eb-2894-4b9a-8dc1-332702dbb20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:14.577543 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a677b5eb-2894-4b9a-8dc1-332702dbb20e None None] MFA Rules not processed for user `c858e68ff08146bebee4d020a662f7e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:14.578802 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a677b5eb-2894-4b9a-8dc1-332702dbb20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:14.608838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:14.643408 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1323/2670] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:14.648094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda70bad-7b3f-4cf8-b6fa-aa4ec7e970f4 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:14.710222 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda70bad-7b3f-4cf8-b6fa-aa4ec7e970f4 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:14.715577 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41a9df-9ad4-417b-8802-01408998688d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:14.716179 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41a9df-9ad4-417b-8802-01408998688d admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:14.716459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41a9df-9ad4-417b-8802-01408998688d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:14.716734 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d41a9df-9ad4-417b-8802-01408998688d admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:14.717360 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41a9df-9ad4-417b-8802-01408998688d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:14.719553 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d41a9df-9ad4-417b-8802-01408998688d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:14.803789 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1348/2671] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:13:14 2022] POST /identity/v3/projects => generated 363 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:13:14.807200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677b5eb-2894-4b9a-8dc1-332702dbb20e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:14.817973 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677b5eb-2894-4b9a-8dc1-332702dbb20e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:14.875413 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349d837-b995-4d4d-981f-e24e4710e41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:14.876086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349d837-b995-4d4d-981f-e24e4710e41b admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:14.876293 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349d837-b995-4d4d-981f-e24e4710e41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:14.876684 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349d837-b995-4d4d-981f-e24e4710e41b admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:14.877298 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349d837-b995-4d4d-981f-e24e4710e41b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:14.879397 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349d837-b995-4d4d-981f-e24e4710e41b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:14.961533 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1324/2672] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:13:14 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:13:14.965577 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41a9df-9ad4-417b-8802-01408998688d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:14.976609 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d41a9df-9ad4-417b-8802-01408998688d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:14.981232 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5610a-b308-4cae-bf47-1251339fba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:14.981823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5610a-b308-4cae-bf47-1251339fba98 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:14.982394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5610a-b308-4cae-bf47-1251339fba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:14.982631 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5610a-b308-4cae-bf47-1251339fba98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:14.983305 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5610a-b308-4cae-bf47-1251339fba98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:14.984886 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5610a-b308-4cae-bf47-1251339fba98 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:14.996076 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1349/2673] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:13:15.001200 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349d837-b995-4d4d-981f-e24e4710e41b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:15.011304 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349d837-b995-4d4d-981f-e24e4710e41b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:15.015988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f54f2-be2a-4769-8dde-7a487d319688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:15.016637 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f54f2-be2a-4769-8dde-7a487d319688 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:15.016923 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f54f2-be2a-4769-8dde-7a487d319688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:15.017708 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f54f2-be2a-4769-8dde-7a487d319688 admin admin] PATH_INFO: `/v3/projects/790ce2b0804849be8045529777a95eba/users/54950311bea9437981da9709ffb3add0/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:15.033683 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f54f2-be2a-4769-8dde-7a487d319688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=790ce2b0804849be8045529777a95eba, user_id=54950311bea9437981da9709ffb3add0, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:15.036491 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f54f2-be2a-4769-8dde-7a487d319688 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:15.120914 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1325/2674] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:13:15 2022] PUT /identity/v3/projects/790ce2b0804849be8045529777a95eba/users/54950311bea9437981da9709ffb3add0/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:15.124987 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5610a-b308-4cae-bf47-1251339fba98 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:15.135825 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5610a-b308-4cae-bf47-1251339fba98 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:15.191920 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf146f-3918-4711-8347-85d639b85a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:15.192521 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf146f-3918-4711-8347-85d639b85a4f admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:15.192809 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf146f-3918-4711-8347-85d639b85a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:15.193084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf146f-3918-4711-8347-85d639b85a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:15.193721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf146f-3918-4711-8347-85d639b85a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:15.195344 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf146f-3918-4711-8347-85d639b85a4f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:15.200236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:15.206058 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1350/2675] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:13:15.210457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f54f2-be2a-4769-8dde-7a487d319688 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:15.221010 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f54f2-be2a-4769-8dde-7a487d319688 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:15.225625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed320f6-07b6-4be6-b3c1-838793f75855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:15.226263 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed320f6-07b6-4be6-b3c1-838793f75855 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:15.226540 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed320f6-07b6-4be6-b3c1-838793f75855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:15.226853 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed320f6-07b6-4be6-b3c1-838793f75855 admin admin] PATH_INFO: `/v3/projects/790ce2b0804849be8045529777a95eba/users/54950311bea9437981da9709ffb3add0/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:15.228791 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed320f6-07b6-4be6-b3c1-838793f75855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=790ce2b0804849be8045529777a95eba, user_id=54950311bea9437981da9709ffb3add0, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:15.231451 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed320f6-07b6-4be6-b3c1-838793f75855 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:15.241817 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1326/2676] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:13:15 2022] PUT /identity/v3/projects/790ce2b0804849be8045529777a95eba/users/54950311bea9437981da9709ffb3add0/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:15.254026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35969b08-9735-4493-b859-146fa43ec5a7 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:15.254378 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35969b08-9735-4493-b859-146fa43ec5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:15.254657 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35969b08-9735-4493-b859-146fa43ec5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:15.282480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-35969b08-9735-4493-b859-146fa43ec5a7 None None] MFA Rules not processed for user `54950311bea9437981da9709ffb3add0`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:15.283899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-35969b08-9735-4493-b859-146fa43ec5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:15.349419 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1351/2677] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:15.360998 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed320f6-07b6-4be6-b3c1-838793f75855 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:15.362705 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4ed320f6-07b6-4be6-b3c1-838793f75855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:15.422590 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed320f6-07b6-4be6-b3c1-838793f75855 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:15.426510 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f63202-78fa-40d7-bbb5-f3116cf9c85d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:15.427140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f63202-78fa-40d7-bbb5-f3116cf9c85d service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:15.427424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f63202-78fa-40d7-bbb5-f3116cf9c85d service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:15.427730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f63202-78fa-40d7-bbb5-f3116cf9c85d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:15.437165 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f63202-78fa-40d7-bbb5-f3116cf9c85d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:15.438611 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f63202-78fa-40d7-bbb5-f3116cf9c85d service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:15.449062 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1327/2678] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:13:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:13:16.526513 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35969b08-9735-4493-b859-146fa43ec5a7 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:16.589028 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35969b08-9735-4493-b859-146fa43ec5a7 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:16.593729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79178039-b7fd-4d84-99fe-a2ebb7e73063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:16.594389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79178039-b7fd-4d84-99fe-a2ebb7e73063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:16.594675 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79178039-b7fd-4d84-99fe-a2ebb7e73063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:16.594974 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79178039-b7fd-4d84-99fe-a2ebb7e73063 admin admin] PATH_INFO: `/v3/users/c858e68ff08146bebee4d020a662f7e4` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:16.596174 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79178039-b7fd-4d84-99fe-a2ebb7e73063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c858e68ff08146bebee4d020a662f7e4)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:16.598097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79178039-b7fd-4d84-99fe-a2ebb7e73063 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:16.786135 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-79178039-b7fd-4d84-99fe-a2ebb7e73063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c858e68ff08146bebee4d020a662f7e4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:16.786769 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-79178039-b7fd-4d84-99fe-a2ebb7e73063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c858e68ff08146bebee4d020a662f7e4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:16.798251 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-79178039-b7fd-4d84-99fe-a2ebb7e73063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c858e68ff08146bebee4d020a662f7e4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:16.805035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-79178039-b7fd-4d84-99fe-a2ebb7e73063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c858e68ff08146bebee4d020a662f7e4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:16.864196 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-79178039-b7fd-4d84-99fe-a2ebb7e73063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c858e68ff08146bebee4d020a662f7e4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:16.870569 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1352/2679] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:13:16 2022] DELETE /identity/v3/users/c858e68ff08146bebee4d020a662f7e4 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:16.875054 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160c378-5e67-4e74-860c-4e94616f0d36 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:16.875569 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160c378-5e67-4e74-860c-4e94616f0d36 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:16.875569 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160c378-5e67-4e74-860c-4e94616f0d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:16.895138 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0160c378-5e67-4e74-860c-4e94616f0d36 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:16.896343 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0160c378-5e67-4e74-860c-4e94616f0d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:16.915751 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:16.954736 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1328/2680] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:16.965225 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79178039-b7fd-4d84-99fe-a2ebb7e73063 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:16.966666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-79178039-b7fd-4d84-99fe-a2ebb7e73063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:16.973599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:17.024360 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79178039-b7fd-4d84-99fe-a2ebb7e73063 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:17.028138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5329c8-febf-41e4-8dde-a7b083d45e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:17.028759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5329c8-febf-41e4-8dde-a7b083d45e70 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:17.029245 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5329c8-febf-41e4-8dde-a7b083d45e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:17.029713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5329c8-febf-41e4-8dde-a7b083d45e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:17.042151 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5329c8-febf-41e4-8dde-a7b083d45e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:17.042151 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5329c8-febf-41e4-8dde-a7b083d45e70 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:17.053359 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1353/2681] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:13:17.541583 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160c378-5e67-4e74-860c-4e94616f0d36 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:17.543072 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0160c378-5e67-4e74-860c-4e94616f0d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:17.556802 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160c378-5e67-4e74-860c-4e94616f0d36 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:17.561589 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c73f85-7a39-42f9-8ad1-d676f9b9671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:17.562257 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c73f85-7a39-42f9-8ad1-d676f9b9671d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:17.562566 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c73f85-7a39-42f9-8ad1-d676f9b9671d admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:17.562871 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c73f85-7a39-42f9-8ad1-d676f9b9671d admin admin] PATH_INFO: `/v3/projects/d840ea4809f44157baf4bb62282348de` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:17.564631 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c73f85-7a39-42f9-8ad1-d676f9b9671d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d840ea4809f44157baf4bb62282348de)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:17.567094 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c73f85-7a39-42f9-8ad1-d676f9b9671d admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:17.721205 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c0c73f85-7a39-42f9-8ad1-d676f9b9671d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd840ea4809f44157baf4bb62282348de', 'request_id': 'req-c0c73f85-7a39-42f9-8ad1-d676f9b9671d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:17.726601 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c0c73f85-7a39-42f9-8ad1-d676f9b9671d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd840ea4809f44157baf4bb62282348de', 'request_id': 'req-c0c73f85-7a39-42f9-8ad1-d676f9b9671d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:17.732851 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c0c73f85-7a39-42f9-8ad1-d676f9b9671d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd840ea4809f44157baf4bb62282348de', 'request_id': 'req-c0c73f85-7a39-42f9-8ad1-d676f9b9671d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:17.858176 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c0c73f85-7a39-42f9-8ad1-d676f9b9671d admin admin] The token cache is being invalidate because project d840ea4809f44157baf4bb62282348de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:13:17.858473 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c0c73f85-7a39-42f9-8ad1-d676f9b9671d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:17.859110 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-c0c73f85-7a39-42f9-8ad1-d676f9b9671d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:17.861590 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1329/2682] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:13:17 2022] DELETE /identity/v3/projects/d840ea4809f44157baf4bb62282348de => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:17.865115 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5329c8-febf-41e4-8dde-a7b083d45e70 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:17.875692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5329c8-febf-41e4-8dde-a7b083d45e70 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:17.943172 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b9c6b-b7dd-42af-b901-d74d809d64a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:17.943790 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b9c6b-b7dd-42af-b901-d74d809d64a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:17.944066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b9c6b-b7dd-42af-b901-d74d809d64a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:17.944335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b9c6b-b7dd-42af-b901-d74d809d64a3 admin admin] PATH_INFO: `/v3/users/54950311bea9437981da9709ffb3add0` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:17.945504 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b9c6b-b7dd-42af-b901-d74d809d64a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54950311bea9437981da9709ffb3add0)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:17.947925 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b9c6b-b7dd-42af-b901-d74d809d64a3 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:18.160097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-a13b9c6b-b7dd-42af-b901-d74d809d64a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54950311bea9437981da9709ffb3add0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:18.160793 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-a13b9c6b-b7dd-42af-b901-d74d809d64a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54950311bea9437981da9709ffb3add0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:18.172507 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-a13b9c6b-b7dd-42af-b901-d74d809d64a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54950311bea9437981da9709ffb3add0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:18.181659 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-a13b9c6b-b7dd-42af-b901-d74d809d64a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54950311bea9437981da9709ffb3add0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:18.281419 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-a13b9c6b-b7dd-42af-b901-d74d809d64a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54950311bea9437981da9709ffb3add0'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:18.289063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1354/2683] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:13:17 2022] DELETE /identity/v3/users/54950311bea9437981da9709ffb3add0 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:18.780450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c73f85-7a39-42f9-8ad1-d676f9b9671d admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:18.782040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c0c73f85-7a39-42f9-8ad1-d676f9b9671d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:18.801448 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c73f85-7a39-42f9-8ad1-d676f9b9671d admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:18.858773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c96bf-1b47-41ce-a371-7d93fabda1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:18.859419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c96bf-1b47-41ce-a371-7d93fabda1dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:18.859701 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c96bf-1b47-41ce-a371-7d93fabda1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:18.859974 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c96bf-1b47-41ce-a371-7d93fabda1dd admin admin] PATH_INFO: `/v3/projects/790ce2b0804849be8045529777a95eba` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:18.861281 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c96bf-1b47-41ce-a371-7d93fabda1dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=790ce2b0804849be8045529777a95eba)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:18.863228 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c96bf-1b47-41ce-a371-7d93fabda1dd admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:18.967838 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-871c96bf-1b47-41ce-a371-7d93fabda1dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '790ce2b0804849be8045529777a95eba', 'request_id': 'req-871c96bf-1b47-41ce-a371-7d93fabda1dd'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:18.969655 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:18.973814 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-871c96bf-1b47-41ce-a371-7d93fabda1dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '790ce2b0804849be8045529777a95eba', 'request_id': 'req-871c96bf-1b47-41ce-a371-7d93fabda1dd'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:18.980122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-871c96bf-1b47-41ce-a371-7d93fabda1dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '790ce2b0804849be8045529777a95eba', 'request_id': 'req-871c96bf-1b47-41ce-a371-7d93fabda1dd'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:19.087929 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-871c96bf-1b47-41ce-a371-7d93fabda1dd admin admin] The token cache is being invalidate because project 790ce2b0804849be8045529777a95eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:13:19.088225 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-871c96bf-1b47-41ce-a371-7d93fabda1dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:19.088850 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-871c96bf-1b47-41ce-a371-7d93fabda1dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:19.090440 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1330/2684] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:13:18 2022] DELETE /identity/v3/projects/790ce2b0804849be8045529777a95eba => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:19.097115 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89db57-5937-48f2-9527-6e126e3d5f5e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:19.097625 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89db57-5937-48f2-9527-6e126e3d5f5e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:19.097801 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89db57-5937-48f2-9527-6e126e3d5f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:19.117443 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-3f89db57-5937-48f2-9527-6e126e3d5f5e None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:19.118624 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-3f89db57-5937-48f2-9527-6e126e3d5f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:19.138984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:19.179306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1355/2685] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:19.186912 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffac9a-584f-4bd4-adde-3621cf1f1397 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:19.187205 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffac9a-584f-4bd4-adde-3621cf1f1397 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:19.187482 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffac9a-584f-4bd4-adde-3621cf1f1397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:19.209899 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-eeffac9a-584f-4bd4-adde-3621cf1f1397 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:19.211157 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-eeffac9a-584f-4bd4-adde-3621cf1f1397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:19.219549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1331/2686] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:19.224047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89db57-5937-48f2-9527-6e126e3d5f5e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:19.234432 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89db57-5937-48f2-9527-6e126e3d5f5e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:19.240236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d0f19-7701-4f0a-927c-80e2cd2bbe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:19.240827 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d0f19-7701-4f0a-927c-80e2cd2bbe54 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:19.241103 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d0f19-7701-4f0a-927c-80e2cd2bbe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:19.241375 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d0f19-7701-4f0a-927c-80e2cd2bbe54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:19.242012 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d0f19-7701-4f0a-927c-80e2cd2bbe54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:13:19.242342 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d0f19-7701-4f0a-927c-80e2cd2bbe54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:19.243962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d0f19-7701-4f0a-927c-80e2cd2bbe54 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:19.256430 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1356/2687] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 11:13:19.260895 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffac9a-584f-4bd4-adde-3621cf1f1397 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:19.270588 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffac9a-584f-4bd4-adde-3621cf1f1397 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:19.276783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57151ca5-f39b-4f02-9a74-d5c5b45430f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:19.276783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57151ca5-f39b-4f02-9a74-d5c5b45430f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:19.276783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57151ca5-f39b-4f02-9a74-d5c5b45430f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:19.276783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57151ca5-f39b-4f02-9a74-d5c5b45430f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:19.277182 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57151ca5-f39b-4f02-9a74-d5c5b45430f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:19.278904 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57151ca5-f39b-4f02-9a74-d5c5b45430f6 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:19.414269 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1332/2688] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:13:19 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:13:19.418510 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d0f19-7701-4f0a-927c-80e2cd2bbe54 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:19.431201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d0f19-7701-4f0a-927c-80e2cd2bbe54 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:19.488330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e11975-7b66-4df9-8df8-df67d5413851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:19.488871 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e11975-7b66-4df9-8df8-df67d5413851 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:19.489157 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e11975-7b66-4df9-8df8-df67d5413851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:19.489432 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e11975-7b66-4df9-8df8-df67d5413851 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:19.490048 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e11975-7b66-4df9-8df8-df67d5413851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:19.491987 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e11975-7b66-4df9-8df8-df67d5413851 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:19.636236 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1357/2689] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:13:19 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:13:19.640205 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57151ca5-f39b-4f02-9a74-d5c5b45430f6 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:19.650417 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57151ca5-f39b-4f02-9a74-d5c5b45430f6 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:19.655085 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee1038-3e6b-4330-a1f8-af86e12f7e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:19.655684 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee1038-3e6b-4330-a1f8-af86e12f7e71 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:19.655964 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee1038-3e6b-4330-a1f8-af86e12f7e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:19.656236 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee1038-3e6b-4330-a1f8-af86e12f7e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:19.656874 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee1038-3e6b-4330-a1f8-af86e12f7e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:19.659194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee1038-3e6b-4330-a1f8-af86e12f7e71 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:19.669527 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1333/2690] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:13:19.673578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e11975-7b66-4df9-8df8-df67d5413851 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:19.684786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e11975-7b66-4df9-8df8-df67d5413851 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:19.689765 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d23bd-319b-4370-b22e-7b0f3f89d1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:19.690533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d23bd-319b-4370-b22e-7b0f3f89d1cc admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:19.690850 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d23bd-319b-4370-b22e-7b0f3f89d1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:19.691398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d23bd-319b-4370-b22e-7b0f3f89d1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:19.691763 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d23bd-319b-4370-b22e-7b0f3f89d1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:19.693365 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d23bd-319b-4370-b22e-7b0f3f89d1cc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:19.710189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1358/2691] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:13:19.714735 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee1038-3e6b-4330-a1f8-af86e12f7e71 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:19.725126 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee1038-3e6b-4330-a1f8-af86e12f7e71 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:19.730000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727fbf8-4cca-4388-84a4-fda6148f5c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:19.730735 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727fbf8-4cca-4388-84a4-fda6148f5c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:19.731050 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727fbf8-4cca-4388-84a4-fda6148f5c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:19.731371 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727fbf8-4cca-4388-84a4-fda6148f5c8b admin admin] PATH_INFO: `/v3/projects/67bea423cff74d52bfd157f9c9c106d3/users/c9306f7fdb1344768587e91fdb2ce522/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:19.749950 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727fbf8-4cca-4388-84a4-fda6148f5c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=67bea423cff74d52bfd157f9c9c106d3, user_id=c9306f7fdb1344768587e91fdb2ce522, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:19.751013 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d23bd-319b-4370-b22e-7b0f3f89d1cc admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:19.751155 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727fbf8-4cca-4388-84a4-fda6148f5c8b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:19.752765 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-ac8d23bd-319b-4370-b22e-7b0f3f89d1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:19.765407 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d23bd-319b-4370-b22e-7b0f3f89d1cc admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:19.770317 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de1d7a-b58f-4a67-abb9-9cb7e60bedab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:19.770968 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de1d7a-b58f-4a67-abb9-9cb7e60bedab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:19.771248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de1d7a-b58f-4a67-abb9-9cb7e60bedab admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:19.771581 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de1d7a-b58f-4a67-abb9-9cb7e60bedab admin admin] PATH_INFO: `/v3/users/6eb2600cf9f64d22b22f3f8a77e044de` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:19.772659 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de1d7a-b58f-4a67-abb9-9cb7e60bedab admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb2600cf9f64d22b22f3f8a77e044de)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:19.774554 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de1d7a-b58f-4a67-abb9-9cb7e60bedab admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:19.859496 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1334/2692] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:13:19 2022] PUT /identity/v3/projects/67bea423cff74d52bfd157f9c9c106d3/users/c9306f7fdb1344768587e91fdb2ce522/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:19.870450 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf291f7-98b5-42b8-88a2-b7b3fb72b290 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:19.870783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf291f7-98b5-42b8-88a2-b7b3fb72b290 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:19.871066 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf291f7-98b5-42b8-88a2-b7b3fb72b290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:19.898430 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-aaf291f7-98b5-42b8-88a2-b7b3fb72b290 None None] MFA Rules not processed for user `c9306f7fdb1344768587e91fdb2ce522`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:19.899681 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-aaf291f7-98b5-42b8-88a2-b7b3fb72b290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:19.969365 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1335/2693] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:13:19.974584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf291f7-98b5-42b8-88a2-b7b3fb72b290 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:19.989059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-88de1d7a-b58f-4a67-abb9-9cb7e60bedab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb2600cf9f64d22b22f3f8a77e044de'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:19.989737 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-88de1d7a-b58f-4a67-abb9-9cb7e60bedab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb2600cf9f64d22b22f3f8a77e044de'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:20.010909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-88de1d7a-b58f-4a67-abb9-9cb7e60bedab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb2600cf9f64d22b22f3f8a77e044de'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:20.016380 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-88de1d7a-b58f-4a67-abb9-9cb7e60bedab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb2600cf9f64d22b22f3f8a77e044de'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:20.055750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf291f7-98b5-42b8-88a2-b7b3fb72b290 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:20.060779 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f7f4b-912a-4d05-9c71-77553d30cc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:20.061354 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f7f4b-912a-4d05-9c71-77553d30cc37 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:20.061638 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f7f4b-912a-4d05-9c71-77553d30cc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:20.061914 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f7f4b-912a-4d05-9c71-77553d30cc37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:20.062565 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f7f4b-912a-4d05-9c71-77553d30cc37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:20.065024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f7f4b-912a-4d05-9c71-77553d30cc37 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:20.079789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:20.093226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-88de1d7a-b58f-4a67-abb9-9cb7e60bedab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb2600cf9f64d22b22f3f8a77e044de'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:20.100944 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1359/2694] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:13:19 2022] DELETE /identity/v3/users/6eb2600cf9f64d22b22f3f8a77e044de => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:20.105441 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef40f0-b175-4f96-844d-a4599ed3c820 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:20.105721 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef40f0-b175-4f96-844d-a4599ed3c820 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:20.106017 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef40f0-b175-4f96-844d-a4599ed3c820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:20.114063 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:20.124619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-daef40f0-b175-4f96-844d-a4599ed3c820 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:20.125806 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-daef40f0-b175-4f96-844d-a4599ed3c820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:20.176467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1336/2695] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:13:19 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:13:20.180565 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f7f4b-912a-4d05-9c71-77553d30cc37 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:20.182206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-be9f7f4b-912a-4d05-9c71-77553d30cc37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:20.194934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1360/2696] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:13:20.196840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef40f0-b175-4f96-844d-a4599ed3c820 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:20.198217 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-daef40f0-b175-4f96-844d-a4599ed3c820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:20.255382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f7f4b-912a-4d05-9c71-77553d30cc37 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:20.257147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef40f0-b175-4f96-844d-a4599ed3c820 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:20.260181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21c2a9-a744-433b-af2e-1df39ac68b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:20.260793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21c2a9-a744-433b-af2e-1df39ac68b31 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:20.261132 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21c2a9-a744-433b-af2e-1df39ac68b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:20.261355 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21c2a9-a744-433b-af2e-1df39ac68b31 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:20.261981 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21c2a9-a744-433b-af2e-1df39ac68b31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:20.264017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21c2a9-a744-433b-af2e-1df39ac68b31 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:20.307195 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df507542-f28d-4e2e-9a07-1316b4436f9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:20.307823 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df507542-f28d-4e2e-9a07-1316b4436f9c service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:20.308107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df507542-f28d-4e2e-9a07-1316b4436f9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:20.308383 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df507542-f28d-4e2e-9a07-1316b4436f9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:20.318524 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df507542-f28d-4e2e-9a07-1316b4436f9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:20.320053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df507542-f28d-4e2e-9a07-1316b4436f9c service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:20.329685 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1361/2697] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:13:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:13:20.391039 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1337/2698] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:13:20 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:13:20.395578 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df507542-f28d-4e2e-9a07-1316b4436f9c service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:20.405949 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df507542-f28d-4e2e-9a07-1316b4436f9c service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:20.410946 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8501b-e645-402a-a018-4e2c5105d0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:20.411587 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8501b-e645-402a-a018-4e2c5105d0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:20.412263 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8501b-e645-402a-a018-4e2c5105d0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:20.412970 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8501b-e645-402a-a018-4e2c5105d0c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:20.414033 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8501b-e645-402a-a018-4e2c5105d0c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:20.415710 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8501b-e645-402a-a018-4e2c5105d0c0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:20.425930 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1362/2699] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:13:20.430130 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21c2a9-a744-433b-af2e-1df39ac68b31 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:20.440631 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21c2a9-a744-433b-af2e-1df39ac68b31 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:20.445151 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108c126-4427-4163-acb4-dbbcc88bc901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:20.445747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108c126-4427-4163-acb4-dbbcc88bc901 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:20.450644 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108c126-4427-4163-acb4-dbbcc88bc901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:20.450644 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108c126-4427-4163-acb4-dbbcc88bc901 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:20.450644 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108c126-4427-4163-acb4-dbbcc88bc901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:20.450644 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108c126-4427-4163-acb4-dbbcc88bc901 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:20.459090 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1338/2700] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:13:20.463404 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8501b-e645-402a-a018-4e2c5105d0c0 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:20.473885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8501b-e645-402a-a018-4e2c5105d0c0 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:20.478709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5df1f6-8354-40e6-95d1-525351818cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:20.479383 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5df1f6-8354-40e6-95d1-525351818cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:20.479666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5df1f6-8354-40e6-95d1-525351818cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:20.479944 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5df1f6-8354-40e6-95d1-525351818cdb admin admin] PATH_INFO: `/v3/projects/43417589cb174a2f8805fc1dc37e4941/users/53d93555d01a461dbf0f2258615925b4/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:20.495092 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5df1f6-8354-40e6-95d1-525351818cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=43417589cb174a2f8805fc1dc37e4941, user_id=53d93555d01a461dbf0f2258615925b4, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:20.497777 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5df1f6-8354-40e6-95d1-525351818cdb admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:20.625816 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1363/2701] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:13:20 2022] PUT /identity/v3/projects/43417589cb174a2f8805fc1dc37e4941/users/53d93555d01a461dbf0f2258615925b4/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:20.637977 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0606bbb-afb2-449b-a7ec-254b9b2a07d3 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:20.638358 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0606bbb-afb2-449b-a7ec-254b9b2a07d3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:20.638697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0606bbb-afb2-449b-a7ec-254b9b2a07d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:20.669347 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a0606bbb-afb2-449b-a7ec-254b9b2a07d3 None None] MFA Rules not processed for user `53d93555d01a461dbf0f2258615925b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:20.670559 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a0606bbb-afb2-449b-a7ec-254b9b2a07d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:20.737908 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1339/2702] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:20.742514 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5df1f6-8354-40e6-95d1-525351818cdb admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:20.773971 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:20.792775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0606bbb-afb2-449b-a7ec-254b9b2a07d3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:20.796132 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a0606bbb-afb2-449b-a7ec-254b9b2a07d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:20.805915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5df1f6-8354-40e6-95d1-525351818cdb admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:20.811789 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826c573-16b4-40df-a3d2-c4298a93e689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:20.812413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826c573-16b4-40df-a3d2-c4298a93e689 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:20.812698 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826c573-16b4-40df-a3d2-c4298a93e689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:20.812973 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826c573-16b4-40df-a3d2-c4298a93e689 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:20.813608 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826c573-16b4-40df-a3d2-c4298a93e689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:20.815689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0606bbb-afb2-449b-a7ec-254b9b2a07d3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:20.816418 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826c573-16b4-40df-a3d2-c4298a93e689 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:20.820694 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08fab4-b2d5-4576-9913-4650b1cc5fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:20.821271 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08fab4-b2d5-4576-9913-4650b1cc5fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:20.821697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08fab4-b2d5-4576-9913-4650b1cc5fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:20.821980 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08fab4-b2d5-4576-9913-4650b1cc5fd3 admin admin] PATH_INFO: `/v3/projects/6fc2aa966c1243a8af594a9473f589cf` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:20.825344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08fab4-b2d5-4576-9913-4650b1cc5fd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fc2aa966c1243a8af594a9473f589cf)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:20.827275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08fab4-b2d5-4576-9913-4650b1cc5fd3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:20.934941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1364/2703] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:13:20 2022] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:13:20.939042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826c573-16b4-40df-a3d2-c4298a93e689 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:20.973639 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6f08fab4-b2d5-4576-9913-4650b1cc5fd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fc2aa966c1243a8af594a9473f589cf', 'request_id': 'req-6f08fab4-b2d5-4576-9913-4650b1cc5fd3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:20.978150 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:20.980883 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6f08fab4-b2d5-4576-9913-4650b1cc5fd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fc2aa966c1243a8af594a9473f589cf', 'request_id': 'req-6f08fab4-b2d5-4576-9913-4650b1cc5fd3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:20.988718 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6f08fab4-b2d5-4576-9913-4650b1cc5fd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fc2aa966c1243a8af594a9473f589cf', 'request_id': 'req-6f08fab4-b2d5-4576-9913-4650b1cc5fd3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:21.004601 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826c573-16b4-40df-a3d2-c4298a93e689 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:21.062702 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3593e-829a-46ab-bf7e-b8d1997d119b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:21.068347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3593e-829a-46ab-bf7e-b8d1997d119b admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:21.068347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3593e-829a-46ab-bf7e-b8d1997d119b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:21.068347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3593e-829a-46ab-bf7e-b8d1997d119b admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:21.068347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3593e-829a-46ab-bf7e-b8d1997d119b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:21.068347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3593e-829a-46ab-bf7e-b8d1997d119b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:21.097752 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6f08fab4-b2d5-4576-9913-4650b1cc5fd3 admin admin] The token cache is being invalidate because project 6fc2aa966c1243a8af594a9473f589cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:13:21.097752 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6f08fab4-b2d5-4576-9913-4650b1cc5fd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:21.097752 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6f08fab4-b2d5-4576-9913-4650b1cc5fd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:21.097752 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1340/2704] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:13:20 2022] DELETE /identity/v3/projects/6fc2aa966c1243a8af594a9473f589cf => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:21.100854 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e64120-ed0a-44dd-b790-95e389f9fcb0 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:21.101141 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e64120-ed0a-44dd-b790-95e389f9fcb0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:21.101412 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e64120-ed0a-44dd-b790-95e389f9fcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:21.121988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f8e64120-ed0a-44dd-b790-95e389f9fcb0 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:21.123379 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f8e64120-ed0a-44dd-b790-95e389f9fcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:21.132192 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1341/2705] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:13:21.144921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc1952-4009-4f01-8628-03545650b183 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:21.145227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc1952-4009-4f01-8628-03545650b183 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:21.145554 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc1952-4009-4f01-8628-03545650b183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:21.170730 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1365/2706] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:13:20 2022] POST /identity/v3/users => generated 298 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:13:21.171222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f4dc1952-4009-4f01-8628-03545650b183 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:21.171222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f4dc1952-4009-4f01-8628-03545650b183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:21.175008 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3593e-829a-46ab-bf7e-b8d1997d119b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:21.176913 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9bf3593e-829a-46ab-bf7e-b8d1997d119b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:21.180019 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1342/2707] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:13:21.184385 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc1952-4009-4f01-8628-03545650b183 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:21.190657 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3593e-829a-46ab-bf7e-b8d1997d119b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:21.195383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc1952-4009-4f01-8628-03545650b183 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:21.197396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c731512-83e0-4382-b7e6-1494aaaed184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:21.199210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c731512-83e0-4382-b7e6-1494aaaed184 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:21.199901 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c731512-83e0-4382-b7e6-1494aaaed184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:21.200265 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6d4b8-9399-41ae-9584-85713c917fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:21.200525 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c731512-83e0-4382-b7e6-1494aaaed184 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:21.201252 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6d4b8-9399-41ae-9584-85713c917fba admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:21.201544 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6d4b8-9399-41ae-9584-85713c917fba admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:21.201736 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c731512-83e0-4382-b7e6-1494aaaed184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:21.201850 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6d4b8-9399-41ae-9584-85713c917fba admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:21.202466 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6d4b8-9399-41ae-9584-85713c917fba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:13:21.202814 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6d4b8-9399-41ae-9584-85713c917fba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:21.206871 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c731512-83e0-4382-b7e6-1494aaaed184 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:21.207034 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6d4b8-9399-41ae-9584-85713c917fba admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:21.216956 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1366/2708] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:13:21.221119 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1343/2709] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:13:21.222325 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c731512-83e0-4382-b7e6-1494aaaed184 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:21.225531 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6d4b8-9399-41ae-9584-85713c917fba admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:21.235301 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c731512-83e0-4382-b7e6-1494aaaed184 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:21.241500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6d4b8-9399-41ae-9584-85713c917fba admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:21.241660 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3decd-bb1c-48f2-924a-e06030187b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:21.242134 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3decd-bb1c-48f2-924a-e06030187b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:21.242414 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3decd-bb1c-48f2-924a-e06030187b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:21.242687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3decd-bb1c-48f2-924a-e06030187b18 admin admin] PATH_INFO: `/v3/projects/8103914990c24cbe914b12ead255ffd6/users/3c5a7ce7686a47228b7bae706f530735/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:21.243318 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5eed56-74d4-41ab-bb92-5e5b393fda8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:21.243934 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5eed56-74d4-41ab-bb92-5e5b393fda8a admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:21.244219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5eed56-74d4-41ab-bb92-5e5b393fda8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:21.244497 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5eed56-74d4-41ab-bb92-5e5b393fda8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:21.245249 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5eed56-74d4-41ab-bb92-5e5b393fda8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:21.247181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5eed56-74d4-41ab-bb92-5e5b393fda8a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:21.262998 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3decd-bb1c-48f2-924a-e06030187b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8103914990c24cbe914b12ead255ffd6, user_id=3c5a7ce7686a47228b7bae706f530735, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:21.266632 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3decd-bb1c-48f2-924a-e06030187b18 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:21.340856 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1344/2710] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:13:21 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:13:21.344920 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5eed56-74d4-41ab-bb92-5e5b393fda8a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:21.369108 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1367/2711] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:13:21 2022] PUT /identity/v3/projects/8103914990c24cbe914b12ead255ffd6/users/3c5a7ce7686a47228b7bae706f530735/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:13:21.375704 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3decd-bb1c-48f2-924a-e06030187b18 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:21.394476 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:21.410843 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5eed56-74d4-41ab-bb92-5e5b393fda8a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:21.439758 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3decd-bb1c-48f2-924a-e06030187b18 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:21.445196 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caebfb3-3518-4f70-b590-79c1d9e2b260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:21.445839 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caebfb3-3518-4f70-b590-79c1d9e2b260 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:21.446115 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caebfb3-3518-4f70-b590-79c1d9e2b260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:21.446389 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caebfb3-3518-4f70-b590-79c1d9e2b260 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:21.447072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caebfb3-3518-4f70-b590-79c1d9e2b260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:21.448661 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caebfb3-3518-4f70-b590-79c1d9e2b260 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:21.459480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1368/2712] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:13:21.463431 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caebfb3-3518-4f70-b590-79c1d9e2b260 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:21.470861 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230df1f-87c0-401f-a427-1315baae2173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:21.474122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230df1f-87c0-401f-a427-1315baae2173 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:21.474122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230df1f-87c0-401f-a427-1315baae2173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:21.474122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230df1f-87c0-401f-a427-1315baae2173 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:21.474122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230df1f-87c0-401f-a427-1315baae2173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:21.474465 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caebfb3-3518-4f70-b590-79c1d9e2b260 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:21.474893 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230df1f-87c0-401f-a427-1315baae2173 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:21.478148 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe8924-77df-41a0-b4c2-e738ad668458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:21.478882 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe8924-77df-41a0-b4c2-e738ad668458 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:21.479168 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe8924-77df-41a0-b4c2-e738ad668458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:21.479474 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe8924-77df-41a0-b4c2-e738ad668458 admin admin] PATH_INFO: `/v3/projects/8103914990c24cbe914b12ead255ffd6/users/3c5a7ce7686a47228b7bae706f530735/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:21.481462 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe8924-77df-41a0-b4c2-e738ad668458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8103914990c24cbe914b12ead255ffd6, user_id=3c5a7ce7686a47228b7bae706f530735, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:21.484433 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe8924-77df-41a0-b4c2-e738ad668458 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:21.495651 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1369/2713] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:13:21 2022] PUT /identity/v3/projects/8103914990c24cbe914b12ead255ffd6/users/3c5a7ce7686a47228b7bae706f530735/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:13:21.506924 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b768169-ba4f-4379-ac37-a4337c6b951e None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:21.507216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b768169-ba4f-4379-ac37-a4337c6b951e None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:21.507497 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b768169-ba4f-4379-ac37-a4337c6b951e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:21.535707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-7b768169-ba4f-4379-ac37-a4337c6b951e None None] MFA Rules not processed for user `3c5a7ce7686a47228b7bae706f530735`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:21.536959 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7b768169-ba4f-4379-ac37-a4337c6b951e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:21.561796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1345/2714] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:13:21 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:13:21.567259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230df1f-87c0-401f-a427-1315baae2173 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:21.577356 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230df1f-87c0-401f-a427-1315baae2173 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:21.610912 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1370/2715] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:13:21.619216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b768169-ba4f-4379-ac37-a4337c6b951e None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:21.620599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-7b768169-ba4f-4379-ac37-a4337c6b951e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:21.647256 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a37d5-0fca-4071-90ed-6df502d1618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:21.647256 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a37d5-0fca-4071-90ed-6df502d1618e admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:21.647256 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a37d5-0fca-4071-90ed-6df502d1618e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:21.647256 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a37d5-0fca-4071-90ed-6df502d1618e admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:21.647651 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a37d5-0fca-4071-90ed-6df502d1618e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:21.647651 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a37d5-0fca-4071-90ed-6df502d1618e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:21.660157 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1346/2716] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:13:21.661028 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a37d5-0fca-4071-90ed-6df502d1618e admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:21.671053 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a37d5-0fca-4071-90ed-6df502d1618e admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:21.678052 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c099dd3-bdf7-42c4-980d-4227922b2014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:21.678739 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c099dd3-bdf7-42c4-980d-4227922b2014 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:21.679075 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c099dd3-bdf7-42c4-980d-4227922b2014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:21.679352 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c099dd3-bdf7-42c4-980d-4227922b2014 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:21.680003 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c099dd3-bdf7-42c4-980d-4227922b2014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:21.681667 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c099dd3-bdf7-42c4-980d-4227922b2014 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:21.684182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b768169-ba4f-4379-ac37-a4337c6b951e None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:21.694676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b23f15-e52d-495f-a95d-824559d0cf4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:21.694676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b23f15-e52d-495f-a95d-824559d0cf4c service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:21.694676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b23f15-e52d-495f-a95d-824559d0cf4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:21.694676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b23f15-e52d-495f-a95d-824559d0cf4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:21.695139 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b0b23f15-e52d-495f-a95d-824559d0cf4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:21.695243 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1347/2717] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:13:21.697609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c099dd3-bdf7-42c4-980d-4227922b2014 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:21.708280 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c099dd3-bdf7-42c4-980d-4227922b2014 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:21.713119 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fdc4b-dcdd-44a4-827f-68258dc50cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:21.713795 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fdc4b-dcdd-44a4-827f-68258dc50cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:21.714082 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fdc4b-dcdd-44a4-827f-68258dc50cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:21.714410 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908fdc4b-dcdd-44a4-827f-68258dc50cf8 admin admin] PATH_INFO: `/v3/projects/e440480bc742499498aa572266052a00/users/d7689e65dd2349fdb63d7d243297cefd/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:21.729557 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908fdc4b-dcdd-44a4-827f-68258dc50cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e440480bc742499498aa572266052a00, user_id=d7689e65dd2349fdb63d7d243297cefd, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:21.732233 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908fdc4b-dcdd-44a4-827f-68258dc50cf8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:21.757677 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b23f15-e52d-495f-a95d-824559d0cf4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:21.759155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b23f15-e52d-495f-a95d-824559d0cf4c service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:21.768074 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1371/2718] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:13:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:13:21.819554 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1348/2719] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:13:21 2022] PUT /identity/v3/projects/e440480bc742499498aa572266052a00/users/d7689e65dd2349fdb63d7d243297cefd/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:13:21.830263 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e7cc0-a71c-4c82-bade-581b3e2de6f1 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:21.830670 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e7cc0-a71c-4c82-bade-581b3e2de6f1 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:21.831042 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e7cc0-a71c-4c82-bade-581b3e2de6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:21.860904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-097e7cc0-a71c-4c82-bade-581b3e2de6f1 None None] MFA Rules not processed for user `d7689e65dd2349fdb63d7d243297cefd`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:21.862804 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-097e7cc0-a71c-4c82-bade-581b3e2de6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:21.916763 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:21.928403 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1372/2720] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:13:21.990954 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:21.998239 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fdc4b-dcdd-44a4-827f-68258dc50cf8 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:22.000191 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-908fdc4b-dcdd-44a4-827f-68258dc50cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:22.068587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908fdc4b-dcdd-44a4-827f-68258dc50cf8 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:22.072325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330c69b-5928-495a-b9fb-490cba7840b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:22.072934 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330c69b-5928-495a-b9fb-490cba7840b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:22.073218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330c69b-5928-495a-b9fb-490cba7840b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:22.073497 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330c69b-5928-495a-b9fb-490cba7840b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:22.082219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330c69b-5928-495a-b9fb-490cba7840b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:22.083824 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330c69b-5928-495a-b9fb-490cba7840b9 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:22.092641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1349/2721] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:13:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:13:23.779311 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e7cc0-a71c-4c82-bade-581b3e2de6f1 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:23.797150 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e7cc0-a71c-4c82-bade-581b3e2de6f1 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:23.800792 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d74c3-b299-47c3-a328-f4c59441eb3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:23.801391 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d74c3-b299-47c3-a328-f4c59441eb3b service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:23.801687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d74c3-b299-47c3-a328-f4c59441eb3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:23.801938 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d74c3-b299-47c3-a328-f4c59441eb3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:23.803677 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-cd1d74c3-b299-47c3-a328-f4c59441eb3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:23.862157 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d74c3-b299-47c3-a328-f4c59441eb3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:23.863872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d74c3-b299-47c3-a328-f4c59441eb3b service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:23.872733 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1373/2722] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:13:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:13:25.308591 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330c69b-5928-495a-b9fb-490cba7840b9 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:25.317087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330c69b-5928-495a-b9fb-490cba7840b9 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:25.320709 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463665d5-0dfe-40c3-8ff0-8c9c0f29c339 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:25.321293 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463665d5-0dfe-40c3-8ff0-8c9c0f29c339 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:25.321567 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463665d5-0dfe-40c3-8ff0-8c9c0f29c339 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:25.321835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463665d5-0dfe-40c3-8ff0-8c9c0f29c339 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:25.384998 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463665d5-0dfe-40c3-8ff0-8c9c0f29c339 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:25.386374 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463665d5-0dfe-40c3-8ff0-8c9c0f29c339 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:25.396592 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1350/2723] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:13:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:13:27.589669 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d74c3-b299-47c3-a328-f4c59441eb3b service cinder] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:27.652812 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d74c3-b299-47c3-a328-f4c59441eb3b service cinder] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:27.657413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f688e-e812-4967-9d53-3eb7e6cc018b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:27.658070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f688e-e812-4967-9d53-3eb7e6cc018b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:27.658351 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f688e-e812-4967-9d53-3eb7e6cc018b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:27.658625 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f688e-e812-4967-9d53-3eb7e6cc018b admin admin] PATH_INFO: `/v3/users/d7689e65dd2349fdb63d7d243297cefd` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:27.659781 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f688e-e812-4967-9d53-3eb7e6cc018b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7689e65dd2349fdb63d7d243297cefd)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:27.661727 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f688e-e812-4967-9d53-3eb7e6cc018b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:27.668007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:27.873010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-646f688e-e812-4967-9d53-3eb7e6cc018b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7689e65dd2349fdb63d7d243297cefd'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:27.873654 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-646f688e-e812-4967-9d53-3eb7e6cc018b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7689e65dd2349fdb63d7d243297cefd'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:27.885659 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-646f688e-e812-4967-9d53-3eb7e6cc018b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7689e65dd2349fdb63d7d243297cefd'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:27.892627 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-646f688e-e812-4967-9d53-3eb7e6cc018b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7689e65dd2349fdb63d7d243297cefd'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:27.973657 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-646f688e-e812-4967-9d53-3eb7e6cc018b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7689e65dd2349fdb63d7d243297cefd'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:27.980426 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1374/2724] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:13:27 2022] DELETE /identity/v3/users/d7689e65dd2349fdb63d7d243297cefd => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:27.988926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ec6ba-61c1-4ee8-9a15-c319055d53bf None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:27.989419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ec6ba-61c1-4ee8-9a15-c319055d53bf None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:27.989522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ec6ba-61c1-4ee8-9a15-c319055d53bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:28.009800 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-451ec6ba-61c1-4ee8-9a15-c319055d53bf None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:28.011050 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-451ec6ba-61c1-4ee8-9a15-c319055d53bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:28.035534 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:28.070886 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1351/2725] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:28.080170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f688e-e812-4967-9d53-3eb7e6cc018b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:28.083935 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-646f688e-e812-4967-9d53-3eb7e6cc018b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:28.139460 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f688e-e812-4967-9d53-3eb7e6cc018b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:28.142966 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e0fd9-efab-46ad-9888-bddd0af1c5c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:28.143565 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e0fd9-efab-46ad-9888-bddd0af1c5c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:28.143844 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e0fd9-efab-46ad-9888-bddd0af1c5c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:28.144172 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e0fd9-efab-46ad-9888-bddd0af1c5c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:28.153467 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e0fd9-efab-46ad-9888-bddd0af1c5c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:28.154927 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e0fd9-efab-46ad-9888-bddd0af1c5c1 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:28.164158 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1375/2726] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:13:28.615771 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ec6ba-61c1-4ee8-9a15-c319055d53bf None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:28.617921 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-451ec6ba-61c1-4ee8-9a15-c319055d53bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:28.632266 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ec6ba-61c1-4ee8-9a15-c319055d53bf None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:28.639175 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96728e0-94b1-4c39-ada4-64ba0e6d53aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:28.639810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96728e0-94b1-4c39-ada4-64ba0e6d53aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:28.640091 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96728e0-94b1-4c39-ada4-64ba0e6d53aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:28.640358 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96728e0-94b1-4c39-ada4-64ba0e6d53aa admin admin] PATH_INFO: `/v3/projects/e440480bc742499498aa572266052a00` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:28.641521 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96728e0-94b1-4c39-ada4-64ba0e6d53aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e440480bc742499498aa572266052a00)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:28.644550 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96728e0-94b1-4c39-ada4-64ba0e6d53aa admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:28.802558 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f96728e0-94b1-4c39-ada4-64ba0e6d53aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e440480bc742499498aa572266052a00', 'request_id': 'req-f96728e0-94b1-4c39-ada4-64ba0e6d53aa'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:28.811278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f96728e0-94b1-4c39-ada4-64ba0e6d53aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e440480bc742499498aa572266052a00', 'request_id': 'req-f96728e0-94b1-4c39-ada4-64ba0e6d53aa'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:28.816851 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f96728e0-94b1-4c39-ada4-64ba0e6d53aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e440480bc742499498aa572266052a00', 'request_id': 'req-f96728e0-94b1-4c39-ada4-64ba0e6d53aa'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:28.917208 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f96728e0-94b1-4c39-ada4-64ba0e6d53aa admin admin] The token cache is being invalidate because project e440480bc742499498aa572266052a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:13:28.917437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f96728e0-94b1-4c39-ada4-64ba0e6d53aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:28.918030 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f96728e0-94b1-4c39-ada4-64ba0e6d53aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:28.919843 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1352/2727] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:13:28 2022] DELETE /identity/v3/projects/e440480bc742499498aa572266052a00 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:28.924892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92eeae-b87a-4ff0-a654-bca76e3baf12 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:28.925369 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92eeae-b87a-4ff0-a654-bca76e3baf12 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:28.925468 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92eeae-b87a-4ff0-a654-bca76e3baf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:28.945649 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-cf92eeae-b87a-4ff0-a654-bca76e3baf12 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:28.946888 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-cf92eeae-b87a-4ff0-a654-bca76e3baf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:29.010092 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1376/2728] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:29.018067 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3939d08-3966-495d-9ce6-0b2ce9bbc8ea None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:29.018622 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3939d08-3966-495d-9ce6-0b2ce9bbc8ea None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:29.018622 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3939d08-3966-495d-9ce6-0b2ce9bbc8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:29.039222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f3939d08-3966-495d-9ce6-0b2ce9bbc8ea None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:29.041440 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f3939d08-3966-495d-9ce6-0b2ce9bbc8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:29.053192 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1353/2729] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:29.067010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92eeae-b87a-4ff0-a654-bca76e3baf12 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:29.067010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92eeae-b87a-4ff0-a654-bca76e3baf12 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:29.070600 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da3097-27ca-4981-97b7-c8931d80675e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:29.071325 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da3097-27ca-4981-97b7-c8931d80675e admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:29.071697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da3097-27ca-4981-97b7-c8931d80675e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:29.072043 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da3097-27ca-4981-97b7-c8931d80675e admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:29.072748 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da3097-27ca-4981-97b7-c8931d80675e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:13:29.073056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da3097-27ca-4981-97b7-c8931d80675e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:29.074648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da3097-27ca-4981-97b7-c8931d80675e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:29.086128 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1377/2730] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:13:29.090919 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3939d08-3966-495d-9ce6-0b2ce9bbc8ea None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:29.100399 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3939d08-3966-495d-9ce6-0b2ce9bbc8ea None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:29.105789 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d075cfd-62e8-4f4b-96fc-e4faa37c2698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:29.106381 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d075cfd-62e8-4f4b-96fc-e4faa37c2698 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:29.106663 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d075cfd-62e8-4f4b-96fc-e4faa37c2698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:29.106967 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d075cfd-62e8-4f4b-96fc-e4faa37c2698 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:29.107591 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d075cfd-62e8-4f4b-96fc-e4faa37c2698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:29.109742 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d075cfd-62e8-4f4b-96fc-e4faa37c2698 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:29.238347 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1354/2731] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:13:29 2022] POST /identity/v3/projects => generated 389 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:13:29.242459 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da3097-27ca-4981-97b7-c8931d80675e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:29.252589 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da3097-27ca-4981-97b7-c8931d80675e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:29.264301 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:29.309245 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe4026-79ab-4d87-8ff0-457027fee307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:29.309914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe4026-79ab-4d87-8ff0-457027fee307 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:29.310439 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe4026-79ab-4d87-8ff0-457027fee307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:29.310949 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe4026-79ab-4d87-8ff0-457027fee307 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:29.311981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe4026-79ab-4d87-8ff0-457027fee307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:29.313925 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe4026-79ab-4d87-8ff0-457027fee307 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:29.396940 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1378/2732] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:13:29 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:13:29.401626 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d075cfd-62e8-4f4b-96fc-e4faa37c2698 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:29.411934 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d075cfd-62e8-4f4b-96fc-e4faa37c2698 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:29.417414 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2e97b-b103-4c3a-8fd6-e7de09fd58b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:29.418012 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2e97b-b103-4c3a-8fd6-e7de09fd58b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:29.418297 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2e97b-b103-4c3a-8fd6-e7de09fd58b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:29.418575 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2e97b-b103-4c3a-8fd6-e7de09fd58b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:29.419247 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2e97b-b103-4c3a-8fd6-e7de09fd58b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:29.420840 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2e97b-b103-4c3a-8fd6-e7de09fd58b4 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:29.430684 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1355/2733] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:13:29.434840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe4026-79ab-4d87-8ff0-457027fee307 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:29.445147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe4026-79ab-4d87-8ff0-457027fee307 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:29.450466 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a9fd2-fa80-4f19-8737-9d28bc9dbd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:29.451132 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a9fd2-fa80-4f19-8737-9d28bc9dbd27 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:29.451398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a9fd2-fa80-4f19-8737-9d28bc9dbd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:29.453217 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a9fd2-fa80-4f19-8737-9d28bc9dbd27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:29.453217 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a9fd2-fa80-4f19-8737-9d28bc9dbd27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:29.453996 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a9fd2-fa80-4f19-8737-9d28bc9dbd27 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:29.465306 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1379/2734] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:13:29.469286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2e97b-b103-4c3a-8fd6-e7de09fd58b4 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:29.479935 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2e97b-b103-4c3a-8fd6-e7de09fd58b4 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:29.485083 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af301502-b468-4dc5-8313-7a3175519434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:29.487196 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af301502-b468-4dc5-8313-7a3175519434 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:29.487196 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af301502-b468-4dc5-8313-7a3175519434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:29.487196 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af301502-b468-4dc5-8313-7a3175519434 admin admin] PATH_INFO: `/v3/projects/d4b75fd04632440a8c54bb0447deedba/users/69bdcdc80e0f401095cd65da8ce6190f/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:29.501629 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af301502-b468-4dc5-8313-7a3175519434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b75fd04632440a8c54bb0447deedba, user_id=69bdcdc80e0f401095cd65da8ce6190f, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:29.504358 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af301502-b468-4dc5-8313-7a3175519434 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:29.597280 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1356/2735] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:13:29 2022] PUT /identity/v3/projects/d4b75fd04632440a8c54bb0447deedba/users/69bdcdc80e0f401095cd65da8ce6190f/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:29.610471 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac8189-131e-4c46-8a3a-fa16cb738c09 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:29.610791 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac8189-131e-4c46-8a3a-fa16cb738c09 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:29.611061 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac8189-131e-4c46-8a3a-fa16cb738c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:29.642268 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-67ac8189-131e-4c46-8a3a-fa16cb738c09 None None] MFA Rules not processed for user `69bdcdc80e0f401095cd65da8ce6190f`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:29.643686 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-67ac8189-131e-4c46-8a3a-fa16cb738c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:29.710338 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1380/2736] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:29.721695 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af301502-b468-4dc5-8313-7a3175519434 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:29.723443 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-af301502-b468-4dc5-8313-7a3175519434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:29.776910 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:29.780578 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af301502-b468-4dc5-8313-7a3175519434 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:29.784272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cec33-b8bf-417d-8e52-cd034ea4150f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:29.784876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cec33-b8bf-417d-8e52-cd034ea4150f service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:29.785156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cec33-b8bf-417d-8e52-cd034ea4150f service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:29.785429 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cec33-b8bf-417d-8e52-cd034ea4150f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:29.793644 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545cec33-b8bf-417d-8e52-cd034ea4150f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:29.796033 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545cec33-b8bf-417d-8e52-cd034ea4150f service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:29.803790 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1357/2737] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:13:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:13:30.138028 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac8189-131e-4c46-8a3a-fa16cb738c09 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:30.139581 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-67ac8189-131e-4c46-8a3a-fa16cb738c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:30.205323 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac8189-131e-4c46-8a3a-fa16cb738c09 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:30.209781 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0240e-6642-4d6c-9ae3-9db03e06e462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:30.214403 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0240e-6642-4d6c-9ae3-9db03e06e462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:30.214403 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0240e-6642-4d6c-9ae3-9db03e06e462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:30.214403 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0240e-6642-4d6c-9ae3-9db03e06e462 admin admin] PATH_INFO: `/v3/users/c9306f7fdb1344768587e91fdb2ce522` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:30.214403 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0240e-6642-4d6c-9ae3-9db03e06e462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9306f7fdb1344768587e91fdb2ce522)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:30.214403 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0240e-6642-4d6c-9ae3-9db03e06e462 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:30.335098 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:30.456893 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-77c0240e-6642-4d6c-9ae3-9db03e06e462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9306f7fdb1344768587e91fdb2ce522'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:30.457554 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-77c0240e-6642-4d6c-9ae3-9db03e06e462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9306f7fdb1344768587e91fdb2ce522'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:30.469717 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-77c0240e-6642-4d6c-9ae3-9db03e06e462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9306f7fdb1344768587e91fdb2ce522'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:30.476406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-77c0240e-6642-4d6c-9ae3-9db03e06e462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9306f7fdb1344768587e91fdb2ce522'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:30.602400 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-77c0240e-6642-4d6c-9ae3-9db03e06e462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9306f7fdb1344768587e91fdb2ce522'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:30.609969 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1381/2738] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:13:30 2022] DELETE /identity/v3/users/c9306f7fdb1344768587e91fdb2ce522 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:30.614646 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c451a5b-b294-426c-a927-dc9cc356a0e6 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:30.615164 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c451a5b-b294-426c-a927-dc9cc356a0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:30.615261 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c451a5b-b294-426c-a927-dc9cc356a0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:30.634269 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8c451a5b-b294-426c-a927-dc9cc356a0e6 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:30.635568 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8c451a5b-b294-426c-a927-dc9cc356a0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:30.704596 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1358/2739] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:13:30.709936 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0240e-6642-4d6c-9ae3-9db03e06e462 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:30.711445 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-77c0240e-6642-4d6c-9ae3-9db03e06e462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:30.770794 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0240e-6642-4d6c-9ae3-9db03e06e462 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:30.775107 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786734ec-a0e3-419d-853f-72f3c96a4535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:30.778492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786734ec-a0e3-419d-853f-72f3c96a4535 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:30.778492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786734ec-a0e3-419d-853f-72f3c96a4535 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:30.778492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786734ec-a0e3-419d-853f-72f3c96a4535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:30.785746 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786734ec-a0e3-419d-853f-72f3c96a4535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:30.787223 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786734ec-a0e3-419d-853f-72f3c96a4535 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:30.798135 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1382/2740] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:13:31.346508 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c451a5b-b294-426c-a927-dc9cc356a0e6 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:31.347941 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8c451a5b-b294-426c-a927-dc9cc356a0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:31.361612 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c451a5b-b294-426c-a927-dc9cc356a0e6 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:31.366383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3511db6-c029-43a6-aac4-900271234147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:31.367081 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3511db6-c029-43a6-aac4-900271234147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:31.367366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3511db6-c029-43a6-aac4-900271234147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:31.367641 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3511db6-c029-43a6-aac4-900271234147 admin admin] PATH_INFO: `/v3/projects/67bea423cff74d52bfd157f9c9c106d3` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:31.368964 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3511db6-c029-43a6-aac4-900271234147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67bea423cff74d52bfd157f9c9c106d3)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:31.371071 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3511db6-c029-43a6-aac4-900271234147 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:31.482584 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b3511db6-c029-43a6-aac4-900271234147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67bea423cff74d52bfd157f9c9c106d3', 'request_id': 'req-b3511db6-c029-43a6-aac4-900271234147'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:31.488396 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b3511db6-c029-43a6-aac4-900271234147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67bea423cff74d52bfd157f9c9c106d3', 'request_id': 'req-b3511db6-c029-43a6-aac4-900271234147'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:31.495251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b3511db6-c029-43a6-aac4-900271234147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67bea423cff74d52bfd157f9c9c106d3', 'request_id': 'req-b3511db6-c029-43a6-aac4-900271234147'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:31.573704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b3511db6-c029-43a6-aac4-900271234147 admin admin] The token cache is being invalidate because project 67bea423cff74d52bfd157f9c9c106d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:13:31.573996 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b3511db6-c029-43a6-aac4-900271234147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:31.574630 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-b3511db6-c029-43a6-aac4-900271234147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:31.576160 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1359/2741] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:13:31 2022] DELETE /identity/v3/projects/67bea423cff74d52bfd157f9c9c106d3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:31.580260 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786734ec-a0e3-419d-853f-72f3c96a4535 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:31.589781 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786734ec-a0e3-419d-853f-72f3c96a4535 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:31.646399 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b8629-4b02-4257-a9fa-945ac46d7ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:31.647053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b8629-4b02-4257-a9fa-945ac46d7ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:31.647338 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b8629-4b02-4257-a9fa-945ac46d7ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:31.647612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b8629-4b02-4257-a9fa-945ac46d7ebc admin admin] PATH_INFO: `/v3/users/53d93555d01a461dbf0f2258615925b4` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:31.648744 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b8629-4b02-4257-a9fa-945ac46d7ebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d93555d01a461dbf0f2258615925b4)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:31.650842 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b8629-4b02-4257-a9fa-945ac46d7ebc admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:31.946965 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-770b8629-4b02-4257-a9fa-945ac46d7ebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d93555d01a461dbf0f2258615925b4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:31.947451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-770b8629-4b02-4257-a9fa-945ac46d7ebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d93555d01a461dbf0f2258615925b4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:31.948546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:31.959443 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-770b8629-4b02-4257-a9fa-945ac46d7ebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d93555d01a461dbf0f2258615925b4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:31.966312 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-770b8629-4b02-4257-a9fa-945ac46d7ebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d93555d01a461dbf0f2258615925b4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:32.065478 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-770b8629-4b02-4257-a9fa-945ac46d7ebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d93555d01a461dbf0f2258615925b4'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:32.072296 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1383/2742] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:13:31 2022] DELETE /identity/v3/users/53d93555d01a461dbf0f2258615925b4 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:32.467704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3511db6-c029-43a6-aac4-900271234147 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:32.469171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b3511db6-c029-43a6-aac4-900271234147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:32.482565 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3511db6-c029-43a6-aac4-900271234147 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:32.541407 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fafcca-c586-479d-89c0-f235b9eab87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:32.542049 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fafcca-c586-479d-89c0-f235b9eab87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:32.542334 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fafcca-c586-479d-89c0-f235b9eab87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:32.542611 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fafcca-c586-479d-89c0-f235b9eab87f admin admin] PATH_INFO: `/v3/projects/43417589cb174a2f8805fc1dc37e4941` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:32.543829 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fafcca-c586-479d-89c0-f235b9eab87f admin admin] RBAC: Authorizing `identity:delete_project(project_id=43417589cb174a2f8805fc1dc37e4941)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:32.545698 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fafcca-c586-479d-89c0-f235b9eab87f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:32.562141 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:32.718453 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f9fafcca-c586-479d-89c0-f235b9eab87f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43417589cb174a2f8805fc1dc37e4941', 'request_id': 'req-f9fafcca-c586-479d-89c0-f235b9eab87f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:32.723849 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f9fafcca-c586-479d-89c0-f235b9eab87f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43417589cb174a2f8805fc1dc37e4941', 'request_id': 'req-f9fafcca-c586-479d-89c0-f235b9eab87f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:32.730689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f9fafcca-c586-479d-89c0-f235b9eab87f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43417589cb174a2f8805fc1dc37e4941', 'request_id': 'req-f9fafcca-c586-479d-89c0-f235b9eab87f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:32.813273 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f9fafcca-c586-479d-89c0-f235b9eab87f admin admin] The token cache is being invalidate because project 43417589cb174a2f8805fc1dc37e4941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:13:32.813480 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f9fafcca-c586-479d-89c0-f235b9eab87f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:32.814147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f9fafcca-c586-479d-89c0-f235b9eab87f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:32.815729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1360/2743] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:13:32 2022] DELETE /identity/v3/projects/43417589cb174a2f8805fc1dc37e4941 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:32.819667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b8629-4b02-4257-a9fa-945ac46d7ebc admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:32.821110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-770b8629-4b02-4257-a9fa-945ac46d7ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:32.834685 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b8629-4b02-4257-a9fa-945ac46d7ebc admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:32.890138 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4032fb-53be-4241-9bd0-209a0f11d7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:32.890781 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4032fb-53be-4241-9bd0-209a0f11d7d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:32.891067 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4032fb-53be-4241-9bd0-209a0f11d7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:32.891335 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4032fb-53be-4241-9bd0-209a0f11d7d5 admin admin] PATH_INFO: `/v3/users/3c5a7ce7686a47228b7bae706f530735` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:32.892430 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4032fb-53be-4241-9bd0-209a0f11d7d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c5a7ce7686a47228b7bae706f530735)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:32.894326 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4032fb-53be-4241-9bd0-209a0f11d7d5 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:33.159045 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6c4032fb-53be-4241-9bd0-209a0f11d7d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c5a7ce7686a47228b7bae706f530735'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:33.159692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6c4032fb-53be-4241-9bd0-209a0f11d7d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c5a7ce7686a47228b7bae706f530735'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:33.171307 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6c4032fb-53be-4241-9bd0-209a0f11d7d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c5a7ce7686a47228b7bae706f530735'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:33.178395 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6c4032fb-53be-4241-9bd0-209a0f11d7d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c5a7ce7686a47228b7bae706f530735'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:33.265565 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6c4032fb-53be-4241-9bd0-209a0f11d7d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c5a7ce7686a47228b7bae706f530735'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:33.271999 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1384/2744] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:13:32 2022] DELETE /identity/v3/users/3c5a7ce7686a47228b7bae706f530735 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:33.741842 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fafcca-c586-479d-89c0-f235b9eab87f admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:33.743430 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f9fafcca-c586-479d-89c0-f235b9eab87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:33.760355 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fafcca-c586-479d-89c0-f235b9eab87f admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:33.821468 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdabbf-70d2-46d4-bfc0-41693356fa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:33.822398 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdabbf-70d2-46d4-bfc0-41693356fa1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:33.822687 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdabbf-70d2-46d4-bfc0-41693356fa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:33.822997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdabbf-70d2-46d4-bfc0-41693356fa1f admin admin] PATH_INFO: `/v3/projects/8103914990c24cbe914b12ead255ffd6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:33.824138 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bdabbf-70d2-46d4-bfc0-41693356fa1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8103914990c24cbe914b12ead255ffd6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:33.826205 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bdabbf-70d2-46d4-bfc0-41693356fa1f admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:33.969598 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-68bdabbf-70d2-46d4-bfc0-41693356fa1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8103914990c24cbe914b12ead255ffd6', 'request_id': 'req-68bdabbf-70d2-46d4-bfc0-41693356fa1f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:33.975154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-68bdabbf-70d2-46d4-bfc0-41693356fa1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8103914990c24cbe914b12ead255ffd6', 'request_id': 'req-68bdabbf-70d2-46d4-bfc0-41693356fa1f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:33.981910 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-68bdabbf-70d2-46d4-bfc0-41693356fa1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8103914990c24cbe914b12ead255ffd6', 'request_id': 'req-68bdabbf-70d2-46d4-bfc0-41693356fa1f'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:34.077697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-68bdabbf-70d2-46d4-bfc0-41693356fa1f admin admin] The token cache is being invalidate because project 8103914990c24cbe914b12ead255ffd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:13:34.077998 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-68bdabbf-70d2-46d4-bfc0-41693356fa1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:34.078638 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-68bdabbf-70d2-46d4-bfc0-41693356fa1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:34.080184 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1361/2745] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:13:33 2022] DELETE /identity/v3/projects/8103914990c24cbe914b12ead255ffd6 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:34.085887 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab1d29-9fa1-4743-abf7-43cb9298419b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:34.086339 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab1d29-9fa1-4743-abf7-43cb9298419b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:34.086434 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab1d29-9fa1-4743-abf7-43cb9298419b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:34.106898 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-99ab1d29-9fa1-4743-abf7-43cb9298419b None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:34.108094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-99ab1d29-9fa1-4743-abf7-43cb9298419b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:34.148511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:34.167879 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1385/2746] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:34.176992 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5fcca-eaca-43f5-bf2b-006aec47fdd5 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:34.177280 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5fcca-eaca-43f5-bf2b-006aec47fdd5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:34.177558 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5fcca-eaca-43f5-bf2b-006aec47fdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:34.197787 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e4d5fcca-eaca-43f5-bf2b-006aec47fdd5 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:34.199017 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e4d5fcca-eaca-43f5-bf2b-006aec47fdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:34.206922 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1362/2747] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:34.211139 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab1d29-9fa1-4743-abf7-43cb9298419b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:34.221748 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab1d29-9fa1-4743-abf7-43cb9298419b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:34.226394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b75c61-5694-4e7e-a827-da32f10bffee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:34.227016 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b75c61-5694-4e7e-a827-da32f10bffee admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:34.227299 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b75c61-5694-4e7e-a827-da32f10bffee admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:34.227710 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b75c61-5694-4e7e-a827-da32f10bffee admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:34.228500 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b75c61-5694-4e7e-a827-da32f10bffee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:13:34.228880 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b75c61-5694-4e7e-a827-da32f10bffee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:34.231383 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b75c61-5694-4e7e-a827-da32f10bffee admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:34.244767 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1386/2748] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:13:34.250939 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5fcca-eaca-43f5-bf2b-006aec47fdd5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:34.258586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5fcca-eaca-43f5-bf2b-006aec47fdd5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:34.264274 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadc9c6-c788-474e-aa9a-e05e8585c773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:34.264881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadc9c6-c788-474e-aa9a-e05e8585c773 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:34.265167 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadc9c6-c788-474e-aa9a-e05e8585c773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:34.265443 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadc9c6-c788-474e-aa9a-e05e8585c773 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:34.266074 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadc9c6-c788-474e-aa9a-e05e8585c773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:34.269372 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadc9c6-c788-474e-aa9a-e05e8585c773 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:34.341858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1363/2749] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:13:34 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:13:34.346070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b75c61-5694-4e7e-a827-da32f10bffee admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:34.355985 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b75c61-5694-4e7e-a827-da32f10bffee admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:34.411646 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49066ff3-d156-4ae9-98ab-4efb7ecf7819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:34.412260 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49066ff3-d156-4ae9-98ab-4efb7ecf7819 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:34.412537 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49066ff3-d156-4ae9-98ab-4efb7ecf7819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:34.412809 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49066ff3-d156-4ae9-98ab-4efb7ecf7819 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:34.413437 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49066ff3-d156-4ae9-98ab-4efb7ecf7819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:34.415378 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49066ff3-d156-4ae9-98ab-4efb7ecf7819 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:34.527561 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1387/2750] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:13:34 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:13:34.528786 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadc9c6-c788-474e-aa9a-e05e8585c773 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:34.539015 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadc9c6-c788-474e-aa9a-e05e8585c773 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:34.543824 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74fe14-77a5-498c-b3e8-e1c38a158e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:34.544513 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74fe14-77a5-498c-b3e8-e1c38a158e2a admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:34.544756 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74fe14-77a5-498c-b3e8-e1c38a158e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:34.545029 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74fe14-77a5-498c-b3e8-e1c38a158e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:34.545667 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74fe14-77a5-498c-b3e8-e1c38a158e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:34.547308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74fe14-77a5-498c-b3e8-e1c38a158e2a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:34.548702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:34.558906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1364/2751] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:13:34.563082 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49066ff3-d156-4ae9-98ab-4efb7ecf7819 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:34.574322 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49066ff3-d156-4ae9-98ab-4efb7ecf7819 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:34.579084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edadcd7c-5410-4c2c-8eeb-6b727feaae54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:34.581155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadcd7c-5410-4c2c-8eeb-6b727feaae54 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:34.581155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadcd7c-5410-4c2c-8eeb-6b727feaae54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:34.581155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edadcd7c-5410-4c2c-8eeb-6b727feaae54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:34.581155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadcd7c-5410-4c2c-8eeb-6b727feaae54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:34.582446 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edadcd7c-5410-4c2c-8eeb-6b727feaae54 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:34.593965 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1388/2752] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:13:34.597959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74fe14-77a5-498c-b3e8-e1c38a158e2a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:34.608703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74fe14-77a5-498c-b3e8-e1c38a158e2a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:34.620076 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed01b1c-4e24-4983-9546-8407e1f86152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:34.620076 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed01b1c-4e24-4983-9546-8407e1f86152 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:34.620076 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed01b1c-4e24-4983-9546-8407e1f86152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:34.620076 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed01b1c-4e24-4983-9546-8407e1f86152 admin admin] PATH_INFO: `/v3/projects/ffd79503dfab4c8e8195b8d5b86a4a08/users/b0f3293004ac4efbace619fee4de3bce/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:34.631185 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed01b1c-4e24-4983-9546-8407e1f86152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd79503dfab4c8e8195b8d5b86a4a08, user_id=b0f3293004ac4efbace619fee4de3bce, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:34.633837 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed01b1c-4e24-4983-9546-8407e1f86152 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:34.757289 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1365/2753] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:13:34 2022] PUT /identity/v3/projects/ffd79503dfab4c8e8195b8d5b86a4a08/users/b0f3293004ac4efbace619fee4de3bce/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:34.768249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4d01e-3099-4c1a-98a9-bf27d3451050 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:34.768537 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4d01e-3099-4c1a-98a9-bf27d3451050 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:34.768814 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4d01e-3099-4c1a-98a9-bf27d3451050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:34.797332 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-64d4d01e-3099-4c1a-98a9-bf27d3451050 None None] MFA Rules not processed for user `b0f3293004ac4efbace619fee4de3bce`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:34.798708 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-64d4d01e-3099-4c1a-98a9-bf27d3451050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:34.866139 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1389/2754] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:34.877522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed01b1c-4e24-4983-9546-8407e1f86152 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:34.879232 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2ed01b1c-4e24-4983-9546-8407e1f86152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:34.936424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed01b1c-4e24-4983-9546-8407e1f86152 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:34.940189 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee44f4d-55e6-4b28-bab7-369573241b86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:34.940793 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee44f4d-55e6-4b28-bab7-369573241b86 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:34.941076 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee44f4d-55e6-4b28-bab7-369573241b86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:34.941351 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee44f4d-55e6-4b28-bab7-369573241b86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:34.950109 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee44f4d-55e6-4b28-bab7-369573241b86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:34.951580 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee44f4d-55e6-4b28-bab7-369573241b86 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:34.960303 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1366/2755] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:13:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:13:43.596968 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4d01e-3099-4c1a-98a9-bf27d3451050 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:43.598378 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-64d4d01e-3099-4c1a-98a9-bf27d3451050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:43.648540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:43.681319 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d4d01e-3099-4c1a-98a9-bf27d3451050 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:43.686327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7514a3-a8df-4081-b6ac-e5b70d4afc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:43.687790 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7514a3-a8df-4081-b6ac-e5b70d4afc01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:43.687790 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7514a3-a8df-4081-b6ac-e5b70d4afc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:43.687790 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7514a3-a8df-4081-b6ac-e5b70d4afc01 admin admin] PATH_INFO: `/v3/users/69bdcdc80e0f401095cd65da8ce6190f` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:43.688752 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7514a3-a8df-4081-b6ac-e5b70d4afc01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69bdcdc80e0f401095cd65da8ce6190f)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:43.690687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7514a3-a8df-4081-b6ac-e5b70d4afc01 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:43.898507 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-da7514a3-a8df-4081-b6ac-e5b70d4afc01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69bdcdc80e0f401095cd65da8ce6190f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:43.899372 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-da7514a3-a8df-4081-b6ac-e5b70d4afc01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69bdcdc80e0f401095cd65da8ce6190f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:43.912805 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-da7514a3-a8df-4081-b6ac-e5b70d4afc01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69bdcdc80e0f401095cd65da8ce6190f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:43.920209 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-da7514a3-a8df-4081-b6ac-e5b70d4afc01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69bdcdc80e0f401095cd65da8ce6190f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:44.021170 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-da7514a3-a8df-4081-b6ac-e5b70d4afc01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69bdcdc80e0f401095cd65da8ce6190f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:44.029287 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1390/2756] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:13:43 2022] DELETE /identity/v3/users/69bdcdc80e0f401095cd65da8ce6190f => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:44.033942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e00c3-65f5-49a6-95d5-8c8a346fd326 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:44.034399 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e00c3-65f5-49a6-95d5-8c8a346fd326 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:44.034784 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e00c3-65f5-49a6-95d5-8c8a346fd326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:44.056971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-158e00c3-65f5-49a6-95d5-8c8a346fd326 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:44.058245 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-158e00c3-65f5-49a6-95d5-8c8a346fd326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:44.120437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1367/2757] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 11 11:13:44.130285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7514a3-a8df-4081-b6ac-e5b70d4afc01 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:44.131711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-da7514a3-a8df-4081-b6ac-e5b70d4afc01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:44.191894 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7514a3-a8df-4081-b6ac-e5b70d4afc01 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:44.195793 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d531f8-38e9-4c77-89cb-5ad6fe4dcde0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:44.196482 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d531f8-38e9-4c77-89cb-5ad6fe4dcde0 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:44.196827 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d531f8-38e9-4c77-89cb-5ad6fe4dcde0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:44.197846 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d531f8-38e9-4c77-89cb-5ad6fe4dcde0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:44.207654 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d531f8-38e9-4c77-89cb-5ad6fe4dcde0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:44.209095 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d531f8-38e9-4c77-89cb-5ad6fe4dcde0 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:44.219129 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1391/2758] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:13:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:13:44.708177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e00c3-65f5-49a6-95d5-8c8a346fd326 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:44.709577 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-158e00c3-65f5-49a6-95d5-8c8a346fd326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:44.723181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e00c3-65f5-49a6-95d5-8c8a346fd326 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:44.733264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b32065-5e3f-4fee-8499-c14aa9ad9aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:44.734089 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b32065-5e3f-4fee-8499-c14aa9ad9aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:44.734382 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b32065-5e3f-4fee-8499-c14aa9ad9aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:44.734608 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b32065-5e3f-4fee-8499-c14aa9ad9aa2 admin admin] PATH_INFO: `/v3/projects/d4b75fd04632440a8c54bb0447deedba` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:44.736027 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b32065-5e3f-4fee-8499-c14aa9ad9aa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b75fd04632440a8c54bb0447deedba)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:44.739437 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b32065-5e3f-4fee-8499-c14aa9ad9aa2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:44.907086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-80b32065-5e3f-4fee-8499-c14aa9ad9aa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b75fd04632440a8c54bb0447deedba', 'request_id': 'req-80b32065-5e3f-4fee-8499-c14aa9ad9aa2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:44.914442 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-80b32065-5e3f-4fee-8499-c14aa9ad9aa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b75fd04632440a8c54bb0447deedba', 'request_id': 'req-80b32065-5e3f-4fee-8499-c14aa9ad9aa2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:44.921989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-80b32065-5e3f-4fee-8499-c14aa9ad9aa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b75fd04632440a8c54bb0447deedba', 'request_id': 'req-80b32065-5e3f-4fee-8499-c14aa9ad9aa2'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:44.997898 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:45.003446 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-80b32065-5e3f-4fee-8499-c14aa9ad9aa2 admin admin] The token cache is being invalidate because project d4b75fd04632440a8c54bb0447deedba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:13:45.003726 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-80b32065-5e3f-4fee-8499-c14aa9ad9aa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:45.004373 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-80b32065-5e3f-4fee-8499-c14aa9ad9aa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:45.005892 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1368/2759] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:13:44 2022] DELETE /identity/v3/projects/d4b75fd04632440a8c54bb0447deedba => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:48.909221 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d531f8-38e9-4c77-89cb-5ad6fe4dcde0 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:48.910634 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e7d531f8-38e9-4c77-89cb-5ad6fe4dcde0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:48.924102 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d531f8-38e9-4c77-89cb-5ad6fe4dcde0 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:48.979779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61900b-bdbb-44ed-a0de-457f5c8ba9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:48.980387 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61900b-bdbb-44ed-a0de-457f5c8ba9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:48.980673 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61900b-bdbb-44ed-a0de-457f5c8ba9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:48.980951 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61900b-bdbb-44ed-a0de-457f5c8ba9ea admin admin] PATH_INFO: `/v3/users/b0f3293004ac4efbace619fee4de3bce` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:48.982101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61900b-bdbb-44ed-a0de-457f5c8ba9ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f3293004ac4efbace619fee4de3bce)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:48.984090 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61900b-bdbb-44ed-a0de-457f5c8ba9ea admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:48.986650 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:49.178526 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6f61900b-bdbb-44ed-a0de-457f5c8ba9ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f3293004ac4efbace619fee4de3bce'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:49.179157 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6f61900b-bdbb-44ed-a0de-457f5c8ba9ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f3293004ac4efbace619fee4de3bce'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:49.191067 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6f61900b-bdbb-44ed-a0de-457f5c8ba9ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f3293004ac4efbace619fee4de3bce'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:49.197946 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6f61900b-bdbb-44ed-a0de-457f5c8ba9ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f3293004ac4efbace619fee4de3bce'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:49.300863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-6f61900b-bdbb-44ed-a0de-457f5c8ba9ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f3293004ac4efbace619fee4de3bce'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:49.307172 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1392/2760] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:13:48 2022] DELETE /identity/v3/users/b0f3293004ac4efbace619fee4de3bce => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:49.311956 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1ac67-b907-433f-9fe4-5860070acef3 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:49.312443 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1ac67-b907-433f-9fe4-5860070acef3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:49.312549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1ac67-b907-433f-9fe4-5860070acef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:49.331514 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-93b1ac67-b907-433f-9fe4-5860070acef3 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:49.335353 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-93b1ac67-b907-433f-9fe4-5860070acef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:49.391897 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1369/2761] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:49.402192 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61900b-bdbb-44ed-a0de-457f5c8ba9ea admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:49.410005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6f61900b-bdbb-44ed-a0de-457f5c8ba9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:49.461425 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61900b-bdbb-44ed-a0de-457f5c8ba9ea admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:49.465881 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e5b2b-e2d1-437a-9ac6-bcaa3b6cc009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:49.466486 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e5b2b-e2d1-437a-9ac6-bcaa3b6cc009 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:49.466777 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e5b2b-e2d1-437a-9ac6-bcaa3b6cc009 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:49.467077 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e5b2b-e2d1-437a-9ac6-bcaa3b6cc009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:49.476101 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e5b2b-e2d1-437a-9ac6-bcaa3b6cc009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:49.477538 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e5b2b-e2d1-437a-9ac6-bcaa3b6cc009 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:49.487423 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1393/2762] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:13:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:13:49.903223 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1ac67-b907-433f-9fe4-5860070acef3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:49.904711 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-93b1ac67-b907-433f-9fe4-5860070acef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:49.920314 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1ac67-b907-433f-9fe4-5860070acef3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:49.936335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0c7f2-3eab-45ac-8c43-28c519825a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:49.936335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0c7f2-3eab-45ac-8c43-28c519825a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:49.936335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0c7f2-3eab-45ac-8c43-28c519825a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:49.936335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0c7f2-3eab-45ac-8c43-28c519825a05 admin admin] PATH_INFO: `/v3/projects/ffd79503dfab4c8e8195b8d5b86a4a08` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:49.937026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0c7f2-3eab-45ac-8c43-28c519825a05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd79503dfab4c8e8195b8d5b86a4a08)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:49.937026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0c7f2-3eab-45ac-8c43-28c519825a05 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:50.079598 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-abe0c7f2-3eab-45ac-8c43-28c519825a05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd79503dfab4c8e8195b8d5b86a4a08', 'request_id': 'req-abe0c7f2-3eab-45ac-8c43-28c519825a05'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:50.085161 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-abe0c7f2-3eab-45ac-8c43-28c519825a05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd79503dfab4c8e8195b8d5b86a4a08', 'request_id': 'req-abe0c7f2-3eab-45ac-8c43-28c519825a05'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:50.092046 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-abe0c7f2-3eab-45ac-8c43-28c519825a05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd79503dfab4c8e8195b8d5b86a4a08', 'request_id': 'req-abe0c7f2-3eab-45ac-8c43-28c519825a05'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:50.204001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-abe0c7f2-3eab-45ac-8c43-28c519825a05 admin admin] The token cache is being invalidate because project ffd79503dfab4c8e8195b8d5b86a4a08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:13:50.204292 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-abe0c7f2-3eab-45ac-8c43-28c519825a05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:50.204911 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-abe0c7f2-3eab-45ac-8c43-28c519825a05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:13:50.206402 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1370/2763] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:13:49 2022] DELETE /identity/v3/projects/ffd79503dfab4c8e8195b8d5b86a4a08 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:50.211283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a76653-7b3d-4630-b7b3-61c1717f424f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:50.211786 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a76653-7b3d-4630-b7b3-61c1717f424f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:50.211892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a76653-7b3d-4630-b7b3-61c1717f424f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:50.231658 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-22a76653-7b3d-4630-b7b3-61c1717f424f None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:50.238900 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-22a76653-7b3d-4630-b7b3-61c1717f424f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:50.289987 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1394/2764] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:50.298813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbde8d-6331-4500-8c56-9cfc958b59e5 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:50.299132 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbde8d-6331-4500-8c56-9cfc958b59e5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:50.299411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbde8d-6331-4500-8c56-9cfc958b59e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:50.319759 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-15cbde8d-6331-4500-8c56-9cfc958b59e5 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:50.320953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-15cbde8d-6331-4500-8c56-9cfc958b59e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:50.329348 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1371/2765] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:50.333549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a76653-7b3d-4630-b7b3-61c1717f424f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:50.343926 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a76653-7b3d-4630-b7b3-61c1717f424f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:50.348511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d47873-cb44-483b-8e9f-82ef6963a5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:50.349109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d47873-cb44-483b-8e9f-82ef6963a5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:50.349390 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d47873-cb44-483b-8e9f-82ef6963a5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:50.349664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d47873-cb44-483b-8e9f-82ef6963a5d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:50.350315 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d47873-cb44-483b-8e9f-82ef6963a5d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:13:50.350617 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d47873-cb44-483b-8e9f-82ef6963a5d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:50.352357 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d47873-cb44-483b-8e9f-82ef6963a5d2 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:50.364004 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1395/2766] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:13:50.368106 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbde8d-6331-4500-8c56-9cfc958b59e5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:50.377305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbde8d-6331-4500-8c56-9cfc958b59e5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:50.381905 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0adeb7-2231-44c0-80e4-7ff098bc66d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:50.382495 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0adeb7-2231-44c0-80e4-7ff098bc66d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:50.382803 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0adeb7-2231-44c0-80e4-7ff098bc66d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:50.383082 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0adeb7-2231-44c0-80e4-7ff098bc66d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:50.383703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0adeb7-2231-44c0-80e4-7ff098bc66d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:50.386171 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0adeb7-2231-44c0-80e4-7ff098bc66d1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:50.479221 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1372/2767] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:13:50 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:13:50.483292 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d47873-cb44-483b-8e9f-82ef6963a5d2 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:50.493452 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d47873-cb44-483b-8e9f-82ef6963a5d2 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:50.501455 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:50.548989 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc8b8e-2d1b-4278-8517-eef1a325c782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:50.549460 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc8b8e-2d1b-4278-8517-eef1a325c782 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:50.549736 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc8b8e-2d1b-4278-8517-eef1a325c782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:50.550007 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc8b8e-2d1b-4278-8517-eef1a325c782 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:50.550625 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc8b8e-2d1b-4278-8517-eef1a325c782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:50.552561 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc8b8e-2d1b-4278-8517-eef1a325c782 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:50.679252 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1396/2768] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:13:50 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:13:50.684130 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0adeb7-2231-44c0-80e4-7ff098bc66d1 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:50.694516 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0adeb7-2231-44c0-80e4-7ff098bc66d1 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:50.699953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c101ef5-4890-4fca-b6e4-be64b7853b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:50.700552 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c101ef5-4890-4fca-b6e4-be64b7853b15 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:50.700834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c101ef5-4890-4fca-b6e4-be64b7853b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:50.701106 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c101ef5-4890-4fca-b6e4-be64b7853b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:50.701743 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c101ef5-4890-4fca-b6e4-be64b7853b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:50.703359 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c101ef5-4890-4fca-b6e4-be64b7853b15 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:50.713835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1373/2769] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:13:50.717742 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc8b8e-2d1b-4278-8517-eef1a325c782 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:50.727762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc8b8e-2d1b-4278-8517-eef1a325c782 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:50.732481 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92be1ef-e612-4958-a1a8-9e47fb50db76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:50.733073 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92be1ef-e612-4958-a1a8-9e47fb50db76 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:50.733352 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92be1ef-e612-4958-a1a8-9e47fb50db76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:50.733623 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92be1ef-e612-4958-a1a8-9e47fb50db76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:50.734262 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92be1ef-e612-4958-a1a8-9e47fb50db76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:50.736136 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92be1ef-e612-4958-a1a8-9e47fb50db76 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:50.747036 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1397/2770] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:13:50.751102 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c101ef5-4890-4fca-b6e4-be64b7853b15 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:50.761434 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c101ef5-4890-4fca-b6e4-be64b7853b15 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:50.765851 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e8bc9-daed-46c9-b517-504953cd94ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:50.766489 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e8bc9-daed-46c9-b517-504953cd94ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:50.766784 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e8bc9-daed-46c9-b517-504953cd94ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:50.767077 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e8bc9-daed-46c9-b517-504953cd94ed admin admin] PATH_INFO: `/v3/projects/44e8541628734383819ae67e2c912ede/users/63085fef7afc4d378a26ee74ff4bb3e9/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:50.780990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e8bc9-daed-46c9-b517-504953cd94ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e8541628734383819ae67e2c912ede, user_id=63085fef7afc4d378a26ee74ff4bb3e9, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:50.784045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e8bc9-daed-46c9-b517-504953cd94ed admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:50.856025 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1374/2771] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:13:50 2022] PUT /identity/v3/projects/44e8541628734383819ae67e2c912ede/users/63085fef7afc4d378a26ee74ff4bb3e9/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:50.861441 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229c821-7771-47a4-a6c2-83eb701d8945 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:50.861732 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229c821-7771-47a4-a6c2-83eb701d8945 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:50.862005 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229c821-7771-47a4-a6c2-83eb701d8945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:50.881128 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c229c821-7771-47a4-a6c2-83eb701d8945 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:50.882323 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c229c821-7771-47a4-a6c2-83eb701d8945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:50.941229 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1398/2772] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:50.950973 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e8bc9-daed-46c9-b517-504953cd94ed admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:50.952656 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-616e8bc9-daed-46c9-b517-504953cd94ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:50.972609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:51.008940 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e8bc9-daed-46c9-b517-504953cd94ed admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:51.013100 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dca499-3193-4cab-b59e-99449bae4daa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:51.013693 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dca499-3193-4cab-b59e-99449bae4daa service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:51.013969 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dca499-3193-4cab-b59e-99449bae4daa service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:51.014236 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dca499-3193-4cab-b59e-99449bae4daa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:51.023166 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dca499-3193-4cab-b59e-99449bae4daa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:51.024669 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dca499-3193-4cab-b59e-99449bae4daa service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:51.034997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1375/2773] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:13:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:13:56.460904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8cb2f-c0cb-4791-8c4b-a89dd23c0c1b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:56.461443 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8cb2f-c0cb-4791-8c4b-a89dd23c0c1b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:56.461935 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8cb2f-c0cb-4791-8c4b-a89dd23c0c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:56.494968 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5fe8cb2f-c0cb-4791-8c4b-a89dd23c0c1b None None] MFA Rules not processed for user `63085fef7afc4d378a26ee74ff4bb3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:13:56.496203 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5fe8cb2f-c0cb-4791-8c4b-a89dd23c0c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:13:56.576152 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1399/2774] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:13:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:13:56.580695 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dca499-3193-4cab-b59e-99449bae4daa service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:56.592356 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dca499-3193-4cab-b59e-99449bae4daa service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:56.597003 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456e3c4-2323-4e48-8416-f08a99f7b431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:56.597615 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456e3c4-2323-4e48-8416-f08a99f7b431 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:56.598007 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456e3c4-2323-4e48-8416-f08a99f7b431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:56.598247 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456e3c4-2323-4e48-8416-f08a99f7b431 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:56.598915 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456e3c4-2323-4e48-8416-f08a99f7b431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:56.600828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456e3c4-2323-4e48-8416-f08a99f7b431 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:56.742472 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1376/2775] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:13:56 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:13:56.747405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8cb2f-c0cb-4791-8c4b-a89dd23c0c1b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:56.758686 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8cb2f-c0cb-4791-8c4b-a89dd23c0c1b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:56.776405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:56.817619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00abcd6-c3a7-485c-88c9-c5d2efc3ba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:56.818228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00abcd6-c3a7-485c-88c9-c5d2efc3ba47 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:56.818507 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00abcd6-c3a7-485c-88c9-c5d2efc3ba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:56.818802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00abcd6-c3a7-485c-88c9-c5d2efc3ba47 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:56.819425 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00abcd6-c3a7-485c-88c9-c5d2efc3ba47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:56.821347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00abcd6-c3a7-485c-88c9-c5d2efc3ba47 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:56.912057 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1400/2776] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:13:56 2022] POST /identity/v3/users => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:13:56.916226 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456e3c4-2323-4e48-8416-f08a99f7b431 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:56.927521 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456e3c4-2323-4e48-8416-f08a99f7b431 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:56.932774 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45025eaa-5eb0-4e49-a4d1-48f4d8a5b7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:56.933481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45025eaa-5eb0-4e49-a4d1-48f4d8a5b7fd admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:56.933767 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45025eaa-5eb0-4e49-a4d1-48f4d8a5b7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:56.934045 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45025eaa-5eb0-4e49-a4d1-48f4d8a5b7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:56.934684 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45025eaa-5eb0-4e49-a4d1-48f4d8a5b7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:56.936338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45025eaa-5eb0-4e49-a4d1-48f4d8a5b7fd admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:56.947268 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1377/2777] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:13:56.951975 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00abcd6-c3a7-485c-88c9-c5d2efc3ba47 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:56.961741 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00abcd6-c3a7-485c-88c9-c5d2efc3ba47 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:56.966388 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70060c2-44a1-4da8-9319-8644d0c518e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:56.967056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70060c2-44a1-4da8-9319-8644d0c518e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:56.967333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70060c2-44a1-4da8-9319-8644d0c518e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:56.967603 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70060c2-44a1-4da8-9319-8644d0c518e5 admin admin] PATH_INFO: `/v3/projects/78ad12dfa9764b40906bbdcccb40af45/users/6181f579ae3d4c2998eddf6122c846ce/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:56.982667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70060c2-44a1-4da8-9319-8644d0c518e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ad12dfa9764b40906bbdcccb40af45, user_id=6181f579ae3d4c2998eddf6122c846ce, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:56.985250 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70060c2-44a1-4da8-9319-8644d0c518e5 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:57.050615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1401/2778] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:13:56 2022] PUT /identity/v3/projects/78ad12dfa9764b40906bbdcccb40af45/users/6181f579ae3d4c2998eddf6122c846ce/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:13:57.054715 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45025eaa-5eb0-4e49-a4d1-48f4d8a5b7fd admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:57.065608 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45025eaa-5eb0-4e49-a4d1-48f4d8a5b7fd admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:57.123089 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e082bb7-5f81-44f2-8fbc-5ec6b5ccd093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:57.123707 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e082bb7-5f81-44f2-8fbc-5ec6b5ccd093 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:57.123992 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e082bb7-5f81-44f2-8fbc-5ec6b5ccd093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:57.124264 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e082bb7-5f81-44f2-8fbc-5ec6b5ccd093 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:57.124907 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e082bb7-5f81-44f2-8fbc-5ec6b5ccd093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:57.126490 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e082bb7-5f81-44f2-8fbc-5ec6b5ccd093 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:57.136416 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1378/2779] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:13:57.140732 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70060c2-44a1-4da8-9319-8644d0c518e5 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:13:57.150981 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70060c2-44a1-4da8-9319-8644d0c518e5 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:13:57.156267 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205859a-9f63-4fcb-8964-57c96cd8932e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:13:57.156921 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205859a-9f63-4fcb-8964-57c96cd8932e admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:13:57.157201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205859a-9f63-4fcb-8964-57c96cd8932e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:13:57.157475 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205859a-9f63-4fcb-8964-57c96cd8932e admin admin] PATH_INFO: `/v3/projects/78ad12dfa9764b40906bbdcccb40af45/users/6181f579ae3d4c2998eddf6122c846ce/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:13:57.159432 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205859a-9f63-4fcb-8964-57c96cd8932e admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ad12dfa9764b40906bbdcccb40af45, user_id=6181f579ae3d4c2998eddf6122c846ce, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:13:57.162224 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205859a-9f63-4fcb-8964-57c96cd8932e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:13:57.173373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1402/2780] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:13:57 2022] PUT /identity/v3/projects/78ad12dfa9764b40906bbdcccb40af45/users/6181f579ae3d4c2998eddf6122c846ce/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:14:03.413596 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de09ec1-320a-40eb-ad5b-5fa47d204e09 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:14:03.414147 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de09ec1-320a-40eb-ad5b-5fa47d204e09 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:14:03.414243 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de09ec1-320a-40eb-ad5b-5fa47d204e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:14:03.446005 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5de09ec1-320a-40eb-ad5b-5fa47d204e09 None None] MFA Rules not processed for user `6181f579ae3d4c2998eddf6122c846ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:14:03.447404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5de09ec1-320a-40eb-ad5b-5fa47d204e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:14:03.525157 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1379/2781] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:14:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:14:03.538675 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205859a-9f63-4fcb-8964-57c96cd8932e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:14:03.540774 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1205859a-9f63-4fcb-8964-57c96cd8932e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:14:03.612674 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205859a-9f63-4fcb-8964-57c96cd8932e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:14:03.616788 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be06a9-e9aa-40f7-aa19-73033a8d6010 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fe013f66e2452eaaf84d4b52eca489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:14:03.617523 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be06a9-e9aa-40f7-aa19-73033a8d6010 service glance] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:14:03.617886 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be06a9-e9aa-40f7-aa19-73033a8d6010 service glance] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:14:03.618109 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be06a9-e9aa-40f7-aa19-73033a8d6010 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:14:03.688072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be06a9-e9aa-40f7-aa19-73033a8d6010 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:14:03.689603 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be06a9-e9aa-40f7-aa19-73033a8d6010 service glance] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:14:03.700833 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1403/2782] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:14:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:14:04.132604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcd05c-920d-4a17-b7d4-e6f2726c4f46 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:14:04.132905 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcd05c-920d-4a17-b7d4-e6f2726c4f46 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:14:04.133268 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcd05c-920d-4a17-b7d4-e6f2726c4f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:14:04.155557 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c6dcd05c-920d-4a17-b7d4-e6f2726c4f46 None None] MFA Rules not processed for user `9751264123914c27b961009f75067660`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:14:04.156799 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c6dcd05c-920d-4a17-b7d4-e6f2726c4f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:14:04.161367 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:04.217939 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1380/2783] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Aug 11 11:14:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:14:04.382218 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be06a9-e9aa-40f7-aa19-73033a8d6010 service glance] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:14:04.383645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-42be06a9-e9aa-40f7-aa19-73033a8d6010 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:14:04.418666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:04.463968 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be06a9-e9aa-40f7-aa19-73033a8d6010 service glance] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:14:04.470163 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999b918-8644-4d7c-8ebf-a85a58ccd69a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd25d1bde0c4703b61e0edaf5b658d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:14:04.470902 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999b918-8644-4d7c-8ebf-a85a58ccd69a service swift] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:14:04.471284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999b918-8644-4d7c-8ebf-a85a58ccd69a service swift] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:14:04.471591 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999b918-8644-4d7c-8ebf-a85a58ccd69a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:14:04.481697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999b918-8644-4d7c-8ebf-a85a58ccd69a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:14:04.483767 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999b918-8644-4d7c-8ebf-a85a58ccd69a service swift] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:14:04.495377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1404/2784] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Aug 11 11:14:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 11:14:14.411100 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=21 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:14.549711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=20 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:14.754275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1a773-3253-4f1a-8769-b911ef6cd61c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:14:14.754567 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1a773-3253-4f1a-8769-b911ef6cd61c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:14:14.754873 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1a773-3253-4f1a-8769-b911ef6cd61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:14:14.775199 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7ff1a773-3253-4f1a-8769-b911ef6cd61c None None] MFA Rules not processed for user `63085fef7afc4d378a26ee74ff4bb3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:14:14.776537 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7ff1a773-3253-4f1a-8769-b911ef6cd61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:14:14.784050 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1381/2785] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:14:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:14:14.827611 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999b918-8644-4d7c-8ebf-a85a58ccd69a service swift] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:14:14.837129 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999b918-8644-4d7c-8ebf-a85a58ccd69a service swift] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:14:14.841270 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e0a22-4fd5-40ad-9d24-a93f4792b83b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fe013f66e2452eaaf84d4b52eca489', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:14:14.841885 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e0a22-4fd5-40ad-9d24-a93f4792b83b service glance] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:14:14.842166 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e0a22-4fd5-40ad-9d24-a93f4792b83b service glance] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:14:14.842437 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e0a22-4fd5-40ad-9d24-a93f4792b83b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:14:14.844280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c28e0a22-4fd5-40ad-9d24-a93f4792b83b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:14:14.921353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e0a22-4fd5-40ad-9d24-a93f4792b83b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:14:14.923131 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e0a22-4fd5-40ad-9d24-a93f4792b83b service glance] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:14:14.937235 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1405/2786] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:14:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:14:15.181698 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1a773-3253-4f1a-8769-b911ef6cd61c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:14:15.183357 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7ff1a773-3253-4f1a-8769-b911ef6cd61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:14:15.241784 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1a773-3253-4f1a-8769-b911ef6cd61c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:14:15.246436 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57feb2-4af0-432e-b38f-71576779953f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:14:15.247129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57feb2-4af0-432e-b38f-71576779953f service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:14:15.247410 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57feb2-4af0-432e-b38f-71576779953f service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:14:15.247680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57feb2-4af0-432e-b38f-71576779953f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:14:15.249569 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ae57feb2-4af0-432e-b38f-71576779953f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:14:15.260592 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57feb2-4af0-432e-b38f-71576779953f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:14:15.263292 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae57feb2-4af0-432e-b38f-71576779953f service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:14:15.272918 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1382/2787] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:14:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:14:15.773175 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e0a22-4fd5-40ad-9d24-a93f4792b83b service glance] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:14:15.773747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57feb2-4af0-432e-b38f-71576779953f service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:14:15.774115 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c28e0a22-4fd5-40ad-9d24-a93f4792b83b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:14:15.781875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57feb2-4af0-432e-b38f-71576779953f service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:14:15.786834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584dfdab-2462-4e0c-8ff5-b5febcfdc012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:14:15.787616 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584dfdab-2462-4e0c-8ff5-b5febcfdc012 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:14:15.787938 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584dfdab-2462-4e0c-8ff5-b5febcfdc012 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:14:15.788211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584dfdab-2462-4e0c-8ff5-b5febcfdc012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:14:15.790069 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-584dfdab-2462-4e0c-8ff5-b5febcfdc012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:14:15.810836 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584dfdab-2462-4e0c-8ff5-b5febcfdc012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:14:15.812538 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584dfdab-2462-4e0c-8ff5-b5febcfdc012 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:14:15.824746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1383/2788] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:14:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:14:15.847850 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e0a22-4fd5-40ad-9d24-a93f4792b83b service glance] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:14:15.852916 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20667a3f-9f72-4450-a67d-cd39c693abc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db99589bb504e8fa4068925badf3942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:14:15.853521 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20667a3f-9f72-4450-a67d-cd39c693abc9 service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:14:15.853801 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20667a3f-9f72-4450-a67d-cd39c693abc9 service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:14:15.854071 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20667a3f-9f72-4450-a67d-cd39c693abc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:14:15.856234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-20667a3f-9f72-4450-a67d-cd39c693abc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:14:15.871035 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20667a3f-9f72-4450-a67d-cd39c693abc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:14:15.873278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20667a3f-9f72-4450-a67d-cd39c693abc9 service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:14:15.883958 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1406/2789] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:14:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:14:19.457547 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a985f8b-ee3a-4180-893b-0f91702ad61a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:14:19.458052 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a985f8b-ee3a-4180-893b-0f91702ad61a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:14:19.458194 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a985f8b-ee3a-4180-893b-0f91702ad61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:14:19.510252 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7a985f8b-ee3a-4180-893b-0f91702ad61a None None] MFA Rules not processed for user `9751264123914c27b961009f75067660`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:14:19.512489 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7a985f8b-ee3a-4180-893b-0f91702ad61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:14:19.528955 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1384/2790] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Aug 11 11:14:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:14:19.541777 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20667a3f-9f72-4450-a67d-cd39c693abc9 service placement] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:14:19.562989 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20667a3f-9f72-4450-a67d-cd39c693abc9 service placement] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:14:19.567922 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02539c16-6d3a-428a-a2e1-21af167280e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd25d1bde0c4703b61e0edaf5b658d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:14:19.568509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02539c16-6d3a-428a-a2e1-21af167280e9 service swift] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:14:19.568787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02539c16-6d3a-428a-a2e1-21af167280e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:14:19.569059 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02539c16-6d3a-428a-a2e1-21af167280e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:14:19.578399 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02539c16-6d3a-428a-a2e1-21af167280e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:14:19.580050 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02539c16-6d3a-428a-a2e1-21af167280e9 service swift] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:14:19.588615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1407/2791] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Aug 11 11:14:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 11:14:29.525486 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=53 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:29.585498 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=76 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:31.903271 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a985f8b-ee3a-4180-893b-0f91702ad61a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:14:31.912824 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a985f8b-ee3a-4180-893b-0f91702ad61a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:14:31.916474 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60ed68-f736-4b8d-9b8c-be0527471078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:14:31.917074 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60ed68-f736-4b8d-9b8c-be0527471078 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:14:31.917351 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60ed68-f736-4b8d-9b8c-be0527471078 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:14:31.917626 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60ed68-f736-4b8d-9b8c-be0527471078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:14:31.919338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cd60ed68-f736-4b8d-9b8c-be0527471078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:14:31.929501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60ed68-f736-4b8d-9b8c-be0527471078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:14:31.931002 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60ed68-f736-4b8d-9b8c-be0527471078 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:14:31.939582 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1385/2792] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:14:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:14:41.935327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:49.619900 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02539c16-6d3a-428a-a2e1-21af167280e9 service swift] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:14:49.630198 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02539c16-6d3a-428a-a2e1-21af167280e9 service swift] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:14:49.633859 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da3c94-76cd-4dde-be41-19943275b10e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:14:49.634456 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da3c94-76cd-4dde-be41-19943275b10e service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:14:49.634809 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da3c94-76cd-4dde-be41-19943275b10e service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:14:49.635091 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da3c94-76cd-4dde-be41-19943275b10e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:14:49.644871 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da3c94-76cd-4dde-be41-19943275b10e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:14:49.646299 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da3c94-76cd-4dde-be41-19943275b10e service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:14:49.655965 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1408/2793] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:14:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:14:54.964571 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60ed68-f736-4b8d-9b8c-be0527471078 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:14:54.966819 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cd60ed68-f736-4b8d-9b8c-be0527471078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:14:55.010969 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60ed68-f736-4b8d-9b8c-be0527471078 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:14:55.019161 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2768a8-3bfe-4230-935b-20d22f5e3f1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:14:55.024878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2768a8-3bfe-4230-935b-20d22f5e3f1b service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:14:55.025404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2768a8-3bfe-4230-935b-20d22f5e3f1b service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:14:55.026113 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2768a8-3bfe-4230-935b-20d22f5e3f1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:14:55.028629 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4d2768a8-3bfe-4230-935b-20d22f5e3f1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:14:55.049288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2768a8-3bfe-4230-935b-20d22f5e3f1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:14:55.052484 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2768a8-3bfe-4230-935b-20d22f5e3f1b service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:14:55.069067 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1386/2794] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:14:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:14:59.651528 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=6 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:15:05.059704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:16:10.659648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da3c94-76cd-4dde-be41-19943275b10e service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:16:10.673027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da3c94-76cd-4dde-be41-19943275b10e service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:16:10.679053 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f25443-cdc9-4a98-ae46-5c13e5d87f38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:16:10.679782 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f25443-cdc9-4a98-ae46-5c13e5d87f38 service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:16:10.680133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f25443-cdc9-4a98-ae46-5c13e5d87f38 service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:16:10.680479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f25443-cdc9-4a98-ae46-5c13e5d87f38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:16:10.682337 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e2f25443-cdc9-4a98-ae46-5c13e5d87f38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:16:10.696417 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f25443-cdc9-4a98-ae46-5c13e5d87f38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:16:10.698029 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f25443-cdc9-4a98-ae46-5c13e5d87f38 service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:16:10.711144 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1409/2795] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:16:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:16:15.822945 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d92682-9d2a-414e-8f96-8b011cb7f5bb None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:16:15.823463 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d92682-9d2a-414e-8f96-8b011cb7f5bb None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:16:15.823559 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d92682-9d2a-414e-8f96-8b011cb7f5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:16:15.842156 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f1d92682-9d2a-414e-8f96-8b011cb7f5bb None None] MFA Rules not processed for user `39a12126a08341089f09877ad8e31484`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:16:15.843364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f1d92682-9d2a-414e-8f96-8b011cb7f5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:16:15.898360 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1387/2796] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:16:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:16:16.201460 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f25443-cdc9-4a98-ae46-5c13e5d87f38 service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:16:16.211280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f25443-cdc9-4a98-ae46-5c13e5d87f38 service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:16:16.214901 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d99346-efb6-47e3-9098-251e1ec345b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:16:16.215489 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d99346-efb6-47e3-9098-251e1ec345b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:16:16.215770 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d99346-efb6-47e3-9098-251e1ec345b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:16:16.216044 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d99346-efb6-47e3-9098-251e1ec345b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:16:16.217759 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-86d99346-efb6-47e3-9098-251e1ec345b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:16:16.227861 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d99346-efb6-47e3-9098-251e1ec345b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:16:16.229291 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d99346-efb6-47e3-9098-251e1ec345b6 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:16:16.237096 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1410/2797] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:16:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:16:25.891554 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=25 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:16:26.233836 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=12 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:16:28.144256 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d92682-9d2a-414e-8f96-8b011cb7f5bb None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:16:28.145858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f1d92682-9d2a-414e-8f96-8b011cb7f5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:16:28.161987 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d92682-9d2a-414e-8f96-8b011cb7f5bb None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:16:28.167335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31498247-7a8f-4b5d-ac53-8916cdfb070f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:16:28.167934 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31498247-7a8f-4b5d-ac53-8916cdfb070f service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:16:28.168211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31498247-7a8f-4b5d-ac53-8916cdfb070f service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:16:28.168481 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31498247-7a8f-4b5d-ac53-8916cdfb070f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:16:28.170119 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-31498247-7a8f-4b5d-ac53-8916cdfb070f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:16:28.182163 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31498247-7a8f-4b5d-ac53-8916cdfb070f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:16:28.183697 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31498247-7a8f-4b5d-ac53-8916cdfb070f service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:16:28.194628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1388/2798] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:16:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:16:38.189557 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:17:24.714492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf08dc5-eda1-453b-80ab-b3d27177da3c None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:24.714998 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf08dc5-eda1-453b-80ab-b3d27177da3c None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:24.715104 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf08dc5-eda1-453b-80ab-b3d27177da3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:24.734832 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-fdf08dc5-eda1-453b-80ab-b3d27177da3c None None] MFA Rules not processed for user `9751264123914c27b961009f75067660`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:17:24.736076 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fdf08dc5-eda1-453b-80ab-b3d27177da3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:17:24.743366 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1411/2799] 10.222.0.43 () {58 vars in 967 bytes} [Thu Aug 11 11:17:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:17:24.783859 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31498247-7a8f-4b5d-ac53-8916cdfb070f service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:24.797042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31498247-7a8f-4b5d-ac53-8916cdfb070f service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:24.802177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650986b3-9fec-4424-b7eb-f7e1b4a7ef49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbd25d1bde0c4703b61e0edaf5b658d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:24.802801 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650986b3-9fec-4424-b7eb-f7e1b4a7ef49 service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:24.803089 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650986b3-9fec-4424-b7eb-f7e1b4a7ef49 service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:24.803362 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650986b3-9fec-4424-b7eb-f7e1b4a7ef49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:24.812434 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650986b3-9fec-4424-b7eb-f7e1b4a7ef49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:24.813946 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650986b3-9fec-4424-b7eb-f7e1b4a7ef49 service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:24.822016 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1389/2800] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Aug 11 11:17:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 11 11:17:29.084682 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf08dc5-eda1-453b-80ab-b3d27177da3c None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:29.086088 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fdf08dc5-eda1-453b-80ab-b3d27177da3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:17:29.100945 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf08dc5-eda1-453b-80ab-b3d27177da3c None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:29.106411 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ede44-47d9-4add-a99c-0e1963693985 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db99589bb504e8fa4068925badf3942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:29.107141 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ede44-47d9-4add-a99c-0e1963693985 service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:29.107486 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ede44-47d9-4add-a99c-0e1963693985 service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:29.108809 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ede44-47d9-4add-a99c-0e1963693985 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:29.111492 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-173ede44-47d9-4add-a99c-0e1963693985 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:17:29.124477 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ede44-47d9-4add-a99c-0e1963693985 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:29.126084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ede44-47d9-4add-a99c-0e1963693985 service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:29.137859 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1412/2801] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:17:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:17:32.792058 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650986b3-9fec-4424-b7eb-f7e1b4a7ef49 service swift] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:32.804551 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650986b3-9fec-4424-b7eb-f7e1b4a7ef49 service swift] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:32.809693 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229900df-7269-4e29-886c-21f188cb8990 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db99589bb504e8fa4068925badf3942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:32.810330 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229900df-7269-4e29-886c-21f188cb8990 service placement] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:32.810615 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229900df-7269-4e29-886c-21f188cb8990 service placement] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:32.811727 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229900df-7269-4e29-886c-21f188cb8990 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:32.813698 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-229900df-7269-4e29-886c-21f188cb8990 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:17:32.826980 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229900df-7269-4e29-886c-21f188cb8990 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:32.828742 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229900df-7269-4e29-886c-21f188cb8990 service placement] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:32.839851 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1390/2802] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:17:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:17:32.936863 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ede44-47d9-4add-a99c-0e1963693985 service placement] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:32.997532 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ede44-47d9-4add-a99c-0e1963693985 service placement] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:33.003026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d4ef5-40b8-464e-bd29-6e7ef0d526c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:33.003649 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d4ef5-40b8-464e-bd29-6e7ef0d526c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:33.003971 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d4ef5-40b8-464e-bd29-6e7ef0d526c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:33.004244 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d4ef5-40b8-464e-bd29-6e7ef0d526c6 admin admin] PATH_INFO: `/v3/users/63085fef7afc4d378a26ee74ff4bb3e9` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:33.005361 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d4ef5-40b8-464e-bd29-6e7ef0d526c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63085fef7afc4d378a26ee74ff4bb3e9)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:33.007311 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d4ef5-40b8-464e-bd29-6e7ef0d526c6 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:33.184934 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-144d4ef5-40b8-464e-bd29-6e7ef0d526c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63085fef7afc4d378a26ee74ff4bb3e9'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:17:33.185520 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-144d4ef5-40b8-464e-bd29-6e7ef0d526c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63085fef7afc4d378a26ee74ff4bb3e9'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:17:33.197651 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-144d4ef5-40b8-464e-bd29-6e7ef0d526c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63085fef7afc4d378a26ee74ff4bb3e9'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:17:33.204428 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-144d4ef5-40b8-464e-bd29-6e7ef0d526c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63085fef7afc4d378a26ee74ff4bb3e9'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:17:33.288004 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-144d4ef5-40b8-464e-bd29-6e7ef0d526c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63085fef7afc4d378a26ee74ff4bb3e9'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:17:33.294357 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1413/2803] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:17:32 2022] DELETE /identity/v3/users/63085fef7afc4d378a26ee74ff4bb3e9 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:17:33.536063 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229900df-7269-4e29-886c-21f188cb8990 service placement] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:33.549384 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229900df-7269-4e29-886c-21f188cb8990 service placement] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:33.610219 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde491e7-3538-4ee8-8086-70ebb7a9d504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:33.610881 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde491e7-3538-4ee8-8086-70ebb7a9d504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:33.611184 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde491e7-3538-4ee8-8086-70ebb7a9d504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:33.611445 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde491e7-3538-4ee8-8086-70ebb7a9d504 admin admin] PATH_INFO: `/v3/projects/44e8541628734383819ae67e2c912ede` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:33.612573 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde491e7-3538-4ee8-8086-70ebb7a9d504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44e8541628734383819ae67e2c912ede)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:33.614471 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde491e7-3538-4ee8-8086-70ebb7a9d504 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:33.723373 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-bde491e7-3538-4ee8-8086-70ebb7a9d504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44e8541628734383819ae67e2c912ede', 'request_id': 'req-bde491e7-3538-4ee8-8086-70ebb7a9d504'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:17:33.728818 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-bde491e7-3538-4ee8-8086-70ebb7a9d504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44e8541628734383819ae67e2c912ede', 'request_id': 'req-bde491e7-3538-4ee8-8086-70ebb7a9d504'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:17:33.735409 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-bde491e7-3538-4ee8-8086-70ebb7a9d504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44e8541628734383819ae67e2c912ede', 'request_id': 'req-bde491e7-3538-4ee8-8086-70ebb7a9d504'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:17:33.801601 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-bde491e7-3538-4ee8-8086-70ebb7a9d504 admin admin] The token cache is being invalidate because project 44e8541628734383819ae67e2c912ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:17:33.802246 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-bde491e7-3538-4ee8-8086-70ebb7a9d504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:17:33.802439 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-bde491e7-3538-4ee8-8086-70ebb7a9d504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:17:33.803985 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1391/2804] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:17:33 2022] DELETE /identity/v3/projects/44e8541628734383819ae67e2c912ede => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:17:33.808004 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d4ef5-40b8-464e-bd29-6e7ef0d526c6 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:33.809520 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-144d4ef5-40b8-464e-bd29-6e7ef0d526c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:17:33.825066 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d4ef5-40b8-464e-bd29-6e7ef0d526c6 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:33.882456 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c86cfd-adbd-4f94-b2d0-17eb20eee6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:33.883115 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c86cfd-adbd-4f94-b2d0-17eb20eee6c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:33.883394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c86cfd-adbd-4f94-b2d0-17eb20eee6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:33.883664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c86cfd-adbd-4f94-b2d0-17eb20eee6c0 admin admin] PATH_INFO: `/v3/users/6181f579ae3d4c2998eddf6122c846ce` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:33.885070 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c86cfd-adbd-4f94-b2d0-17eb20eee6c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6181f579ae3d4c2998eddf6122c846ce)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:33.887083 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c86cfd-adbd-4f94-b2d0-17eb20eee6c0 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:33.888717 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:17:34.072367 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-73c86cfd-adbd-4f94-b2d0-17eb20eee6c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6181f579ae3d4c2998eddf6122c846ce'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:17:34.072955 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-73c86cfd-adbd-4f94-b2d0-17eb20eee6c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6181f579ae3d4c2998eddf6122c846ce'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:17:34.085648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-73c86cfd-adbd-4f94-b2d0-17eb20eee6c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6181f579ae3d4c2998eddf6122c846ce'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:17:34.092612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-73c86cfd-adbd-4f94-b2d0-17eb20eee6c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6181f579ae3d4c2998eddf6122c846ce'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:17:34.173221 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-73c86cfd-adbd-4f94-b2d0-17eb20eee6c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6181f579ae3d4c2998eddf6122c846ce'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:17:34.183567 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1414/2805] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:17:33 2022] DELETE /identity/v3/users/6181f579ae3d4c2998eddf6122c846ce => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:17:34.431911 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde491e7-3538-4ee8-8086-70ebb7a9d504 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:34.433329 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bde491e7-3538-4ee8-8086-70ebb7a9d504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:17:34.447148 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde491e7-3538-4ee8-8086-70ebb7a9d504 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:34.506576 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328eeef-bbc8-4816-aa68-3f48bd94c102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:34.507240 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328eeef-bbc8-4816-aa68-3f48bd94c102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:34.507526 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328eeef-bbc8-4816-aa68-3f48bd94c102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:34.507802 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328eeef-bbc8-4816-aa68-3f48bd94c102 admin admin] PATH_INFO: `/v3/projects/78ad12dfa9764b40906bbdcccb40af45` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:34.508913 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328eeef-bbc8-4816-aa68-3f48bd94c102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78ad12dfa9764b40906bbdcccb40af45)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:34.510861 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328eeef-bbc8-4816-aa68-3f48bd94c102 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:34.517459 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:17:34.634061 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f328eeef-bbc8-4816-aa68-3f48bd94c102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78ad12dfa9764b40906bbdcccb40af45', 'request_id': 'req-f328eeef-bbc8-4816-aa68-3f48bd94c102'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:17:34.639589 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f328eeef-bbc8-4816-aa68-3f48bd94c102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78ad12dfa9764b40906bbdcccb40af45', 'request_id': 'req-f328eeef-bbc8-4816-aa68-3f48bd94c102'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:17:34.645831 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f328eeef-bbc8-4816-aa68-3f48bd94c102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78ad12dfa9764b40906bbdcccb40af45', 'request_id': 'req-f328eeef-bbc8-4816-aa68-3f48bd94c102'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:17:34.756161 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f328eeef-bbc8-4816-aa68-3f48bd94c102 admin admin] The token cache is being invalidate because project 78ad12dfa9764b40906bbdcccb40af45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:17:34.756561 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f328eeef-bbc8-4816-aa68-3f48bd94c102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:17:34.757310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-f328eeef-bbc8-4816-aa68-3f48bd94c102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:17:34.759299 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1392/2806] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:17:34 2022] DELETE /identity/v3/projects/78ad12dfa9764b40906bbdcccb40af45 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:17:34.764340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fd439-3cd2-41b9-ac79-02e3b18fa992 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:34.764629 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fd439-3cd2-41b9-ac79-02e3b18fa992 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:34.764901 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fd439-3cd2-41b9-ac79-02e3b18fa992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:34.784520 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-438fd439-3cd2-41b9-ac79-02e3b18fa992 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:17:34.785745 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-438fd439-3cd2-41b9-ac79-02e3b18fa992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:17:34.845751 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1415/2807] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:17:34.854728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc7ed4-4e3a-4cf1-b8f4-cee9851f73bf None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:34.855251 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc7ed4-4e3a-4cf1-b8f4-cee9851f73bf None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:34.855346 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc7ed4-4e3a-4cf1-b8f4-cee9851f73bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:34.876625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4bbc7ed4-4e3a-4cf1-b8f4-cee9851f73bf None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:17:34.877862 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4bbc7ed4-4e3a-4cf1-b8f4-cee9851f73bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:17:34.886038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1393/2808] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:17:34.890453 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fd439-3cd2-41b9-ac79-02e3b18fa992 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:34.899867 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fd439-3cd2-41b9-ac79-02e3b18fa992 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:34.904324 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef4818-5473-4649-a26c-68be04e1255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:34.912503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef4818-5473-4649-a26c-68be04e1255a admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:34.912503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef4818-5473-4649-a26c-68be04e1255a admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:34.912503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef4818-5473-4649-a26c-68be04e1255a admin admin] PATH_INFO: `/v3/domains` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:34.912503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef4818-5473-4649-a26c-68be04e1255a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81639) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:17:34.912503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef4818-5473-4649-a26c-68be04e1255a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:34.912503 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef4818-5473-4649-a26c-68be04e1255a admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:34.920085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1416/2809] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 11 11:17:34.925839 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc7ed4-4e3a-4cf1-b8f4-cee9851f73bf None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:34.935308 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc7ed4-4e3a-4cf1-b8f4-cee9851f73bf None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:34.940580 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea2d51-b8b5-4738-809e-84ce11fb1293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:34.941179 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea2d51-b8b5-4738-809e-84ce11fb1293 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:34.941462 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea2d51-b8b5-4738-809e-84ce11fb1293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:34.941734 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea2d51-b8b5-4738-809e-84ce11fb1293 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:34.942363 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea2d51-b8b5-4738-809e-84ce11fb1293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:34.944296 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea2d51-b8b5-4738-809e-84ce11fb1293 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:35.055489 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1394/2810] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:17:34 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:17:35.059821 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef4818-5473-4649-a26c-68be04e1255a admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:35.069827 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef4818-5473-4649-a26c-68be04e1255a admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:35.124580 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b022da3-a53a-4d9b-8b83-b35ee0dd7c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:35.125201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b022da3-a53a-4d9b-8b83-b35ee0dd7c6c admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:35.125445 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b022da3-a53a-4d9b-8b83-b35ee0dd7c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:35.125963 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b022da3-a53a-4d9b-8b83-b35ee0dd7c6c admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:35.126592 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b022da3-a53a-4d9b-8b83-b35ee0dd7c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:35.128519 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b022da3-a53a-4d9b-8b83-b35ee0dd7c6c admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:35.139902 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:17:35.366166 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1417/2811] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:17:35 2022] POST /identity/v3/users => generated 287 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:17:35.370551 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea2d51-b8b5-4738-809e-84ce11fb1293 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:35.382524 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea2d51-b8b5-4738-809e-84ce11fb1293 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:35.387375 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6344a4-834a-4f68-9e19-83d509786240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:35.387978 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6344a4-834a-4f68-9e19-83d509786240 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:35.388256 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6344a4-834a-4f68-9e19-83d509786240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:35.388527 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6344a4-834a-4f68-9e19-83d509786240 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:35.389753 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6344a4-834a-4f68-9e19-83d509786240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:35.391371 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6344a4-834a-4f68-9e19-83d509786240 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:35.401353 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1395/2812] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:17:35.405597 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b022da3-a53a-4d9b-8b83-b35ee0dd7c6c admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:35.415283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b022da3-a53a-4d9b-8b83-b35ee0dd7c6c admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:35.419910 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f8c82-71ba-467a-8059-8b38231bdc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:35.427383 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f8c82-71ba-467a-8059-8b38231bdc0e admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:35.427383 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f8c82-71ba-467a-8059-8b38231bdc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:35.427383 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f8c82-71ba-467a-8059-8b38231bdc0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:35.427383 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f8c82-71ba-467a-8059-8b38231bdc0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:35.427383 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f8c82-71ba-467a-8059-8b38231bdc0e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:35.433710 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1418/2813] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:17:35.438227 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6344a4-834a-4f68-9e19-83d509786240 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:35.448008 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6344a4-834a-4f68-9e19-83d509786240 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:35.456970 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc8b68-a213-414f-bd7f-920d6f5b21df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:35.456970 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc8b68-a213-414f-bd7f-920d6f5b21df admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:35.456970 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc8b68-a213-414f-bd7f-920d6f5b21df admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:35.456970 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc8b68-a213-414f-bd7f-920d6f5b21df admin admin] PATH_INFO: `/v3/projects/a5ebe74aa39b4300b141256c250eec01/users/2aa12a300ae44ed192df3303d6f1e0a8/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:35.469043 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc8b68-a213-414f-bd7f-920d6f5b21df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ebe74aa39b4300b141256c250eec01, user_id=2aa12a300ae44ed192df3303d6f1e0a8, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:35.471801 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc8b68-a213-414f-bd7f-920d6f5b21df admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:35.568366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1396/2814] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:17:35 2022] PUT /identity/v3/projects/a5ebe74aa39b4300b141256c250eec01/users/2aa12a300ae44ed192df3303d6f1e0a8/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:17:35.573633 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf770de1-2b69-4644-9d4b-907362ac7f38 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:35.573917 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf770de1-2b69-4644-9d4b-907362ac7f38 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:35.574185 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf770de1-2b69-4644-9d4b-907362ac7f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:35.593825 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-cf770de1-2b69-4644-9d4b-907362ac7f38 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:17:35.595121 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-cf770de1-2b69-4644-9d4b-907362ac7f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:17:35.653151 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1419/2815] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:17:35.662807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc8b68-a213-414f-bd7f-920d6f5b21df admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:35.664500 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f8fc8b68-a213-414f-bd7f-920d6f5b21df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:17:35.725727 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc8b68-a213-414f-bd7f-920d6f5b21df admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:35.729370 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756624c-f765-41a9-a4b2-c156d7683da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:35.729976 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756624c-f765-41a9-a4b2-c156d7683da7 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:35.730254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756624c-f765-41a9-a4b2-c156d7683da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:35.730526 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756624c-f765-41a9-a4b2-c156d7683da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:35.740193 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756624c-f765-41a9-a4b2-c156d7683da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:35.741622 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756624c-f765-41a9-a4b2-c156d7683da7 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:35.751801 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1397/2816] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:17:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:17:40.912285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a447f-ee5c-4f26-9509-b1644aeb94b9 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:40.912766 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a447f-ee5c-4f26-9509-b1644aeb94b9 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:40.912867 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a447f-ee5c-4f26-9509-b1644aeb94b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:40.943409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a03a447f-ee5c-4f26-9509-b1644aeb94b9 None None] MFA Rules not processed for user `2aa12a300ae44ed192df3303d6f1e0a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:17:40.944679 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a03a447f-ee5c-4f26-9509-b1644aeb94b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:17:41.012250 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1420/2817] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:17:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:17:41.016965 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756624c-f765-41a9-a4b2-c156d7683da7 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:41.028375 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756624c-f765-41a9-a4b2-c156d7683da7 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:41.033763 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aaf6c9-c783-44bc-ac53-aff23101221e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:41.034373 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aaf6c9-c783-44bc-ac53-aff23101221e admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:41.034655 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aaf6c9-c783-44bc-ac53-aff23101221e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:41.034953 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aaf6c9-c783-44bc-ac53-aff23101221e admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:41.035586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aaf6c9-c783-44bc-ac53-aff23101221e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:41.037545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aaf6c9-c783-44bc-ac53-aff23101221e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:41.130997 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1398/2818] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:17:41 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:17:41.135188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a447f-ee5c-4f26-9509-b1644aeb94b9 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:41.146297 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a447f-ee5c-4f26-9509-b1644aeb94b9 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:41.201463 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57faba89-5104-42c0-afb9-09540a37efc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:41.202067 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faba89-5104-42c0-afb9-09540a37efc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:41.202346 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faba89-5104-42c0-afb9-09540a37efc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:41.202619 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faba89-5104-42c0-afb9-09540a37efc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:41.203267 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57faba89-5104-42c0-afb9-09540a37efc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:41.206081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57faba89-5104-42c0-afb9-09540a37efc1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:41.303413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1421/2819] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:17:41 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:17:41.307469 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aaf6c9-c783-44bc-ac53-aff23101221e admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:41.318455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aaf6c9-c783-44bc-ac53-aff23101221e admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:41.322995 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8824e-b706-4914-9794-776eafb32737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:41.323595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8824e-b706-4914-9794-776eafb32737 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:41.323861 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8824e-b706-4914-9794-776eafb32737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:41.324129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8824e-b706-4914-9794-776eafb32737 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:41.324768 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8824e-b706-4914-9794-776eafb32737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:41.326366 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8824e-b706-4914-9794-776eafb32737 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:41.332241 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:17:41.338064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1399/2820] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:17:41.342252 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57faba89-5104-42c0-afb9-09540a37efc1 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:41.349021 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:17:41.352718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57faba89-5104-42c0-afb9-09540a37efc1 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:41.357359 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d124d-c95b-4b6c-a74c-5242649cef74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:41.363461 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d124d-c95b-4b6c-a74c-5242649cef74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:41.363461 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d124d-c95b-4b6c-a74c-5242649cef74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:41.363461 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d124d-c95b-4b6c-a74c-5242649cef74 admin admin] PATH_INFO: `/v3/projects/4861d903ef694d25af92cb31040ac131/users/39f354b3c42940388ccf1c7868b8e70d/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:41.373289 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d124d-c95b-4b6c-a74c-5242649cef74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4861d903ef694d25af92cb31040ac131, user_id=39f354b3c42940388ccf1c7868b8e70d, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:41.375977 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d124d-c95b-4b6c-a74c-5242649cef74 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:41.446455 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1422/2821] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:17:41 2022] PUT /identity/v3/projects/4861d903ef694d25af92cb31040ac131/users/39f354b3c42940388ccf1c7868b8e70d/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:17:41.450387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8824e-b706-4914-9794-776eafb32737 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:41.460813 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8824e-b706-4914-9794-776eafb32737 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:41.517128 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e5401-a40d-43e8-8a17-2a46d67206ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:41.518443 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e5401-a40d-43e8-8a17-2a46d67206ca admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:41.518731 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e5401-a40d-43e8-8a17-2a46d67206ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:41.519027 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e5401-a40d-43e8-8a17-2a46d67206ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:41.519778 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e5401-a40d-43e8-8a17-2a46d67206ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:41.521278 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e5401-a40d-43e8-8a17-2a46d67206ca admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:41.532075 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1400/2822] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:17:41.536319 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d124d-c95b-4b6c-a74c-5242649cef74 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:41.547529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d124d-c95b-4b6c-a74c-5242649cef74 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:41.552390 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e5738-2115-4ffa-bef9-dc77f77d4eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:41.553080 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e5738-2115-4ffa-bef9-dc77f77d4eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:41.553386 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e5738-2115-4ffa-bef9-dc77f77d4eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:41.553660 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e5738-2115-4ffa-bef9-dc77f77d4eb1 admin admin] PATH_INFO: `/v3/projects/4861d903ef694d25af92cb31040ac131/users/39f354b3c42940388ccf1c7868b8e70d/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:41.555678 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e5738-2115-4ffa-bef9-dc77f77d4eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4861d903ef694d25af92cb31040ac131, user_id=39f354b3c42940388ccf1c7868b8e70d, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:41.558319 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e5738-2115-4ffa-bef9-dc77f77d4eb1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:41.569031 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1423/2823] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:17:41 2022] PUT /identity/v3/projects/4861d903ef694d25af92cb31040ac131/users/39f354b3c42940388ccf1c7868b8e70d/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:17:46.921089 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e5401-a40d-43e8-8a17-2a46d67206ca admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:46.923010 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-809e5401-a40d-43e8-8a17-2a46d67206ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:17:47.027001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e5401-a40d-43e8-8a17-2a46d67206ca admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:47.140826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3ee52-f081-4721-9b97-16865972522a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:47.140826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3ee52-f081-4721-9b97-16865972522a service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:47.140826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3ee52-f081-4721-9b97-16865972522a service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:47.140826 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3ee52-f081-4721-9b97-16865972522a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:47.149851 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab6910-9b82-4923-aa34-24c5102beecb None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:47.150384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab6910-9b82-4923-aa34-24c5102beecb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:47.150384 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab6910-9b82-4923-aa34-24c5102beecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:47.162100 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-75a3ee52-f081-4721-9b97-16865972522a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:17:47.187104 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a6ab6910-9b82-4923-aa34-24c5102beecb None None] MFA Rules not processed for user `39f354b3c42940388ccf1c7868b8e70d`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:17:47.188321 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a6ab6910-9b82-4923-aa34-24c5102beecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:17:47.209989 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:17:47.245252 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3ee52-f081-4721-9b97-16865972522a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:47.246910 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3ee52-f081-4721-9b97-16865972522a service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:47.259534 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1401/2824] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:17:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:17:47.282314 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1424/2825] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:17:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:17:47.300256 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3ee52-f081-4721-9b97-16865972522a service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:17:47.302475 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-75a3ee52-f081-4721-9b97-16865972522a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:17:47.318995 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3ee52-f081-4721-9b97-16865972522a service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:17:47.325025 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab49b4-ce98-4a05-9209-bde295e7a5bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:17:47.331024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab49b4-ce98-4a05-9209-bde295e7a5bf service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:47.331024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab49b4-ce98-4a05-9209-bde295e7a5bf service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:47.331024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab49b4-ce98-4a05-9209-bde295e7a5bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:47.390834 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab49b4-ce98-4a05-9209-bde295e7a5bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:17:47.393334 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab49b4-ce98-4a05-9209-bde295e7a5bf service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:17:47.403533 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1402/2826] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:17:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:17:49.974987 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbcd9e-86a6-4424-8b1c-44d0ad62cb73 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:17:49.976557 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbcd9e-86a6-4424-8b1c-44d0ad62cb73 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:17:49.976557 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbcd9e-86a6-4424-8b1c-44d0ad62cb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:17:49.995396 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-c4bbcd9e-86a6-4424-8b1c-44d0ad62cb73 None None] MFA Rules not processed for user `2aa12a300ae44ed192df3303d6f1e0a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:17:49.996596 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c4bbcd9e-86a6-4424-8b1c-44d0ad62cb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:17:50.004857 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1425/2827] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:17:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:17:57.399611 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=41 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:17:59.989427 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:04.553114 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab49b4-ce98-4a05-9209-bde295e7a5bf service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:04.554512 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6bab49b4-ce98-4a05-9209-bde295e7a5bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:04.626639 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab49b4-ce98-4a05-9209-bde295e7a5bf service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:04.632824 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6b81f-3f77-4d4e-b305-d5c82d98e1a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db99589bb504e8fa4068925badf3942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:04.633438 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6b81f-3f77-4d4e-b305-d5c82d98e1a9 service placement] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:04.633719 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6b81f-3f77-4d4e-b305-d5c82d98e1a9 service placement] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:04.634479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6b81f-3f77-4d4e-b305-d5c82d98e1a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:04.636991 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6ef6b81f-3f77-4d4e-b305-d5c82d98e1a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:04.650004 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6b81f-3f77-4d4e-b305-d5c82d98e1a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:04.652334 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6b81f-3f77-4d4e-b305-d5c82d98e1a9 service placement] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:04.663456 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1403/2828] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:18:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:18:14.658088 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=32 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:15.910903 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbcd9e-86a6-4424-8b1c-44d0ad62cb73 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:15.912283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-c4bbcd9e-86a6-4424-8b1c-44d0ad62cb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:15.968784 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbcd9e-86a6-4424-8b1c-44d0ad62cb73 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:15.972328 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb77cc-35ae-4376-a9eb-64cba5ed6c53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:15.972918 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb77cc-35ae-4376-a9eb-64cba5ed6c53 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:15.973192 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb77cc-35ae-4376-a9eb-64cba5ed6c53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:15.973457 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb77cc-35ae-4376-a9eb-64cba5ed6c53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:15.975201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-32fb77cc-35ae-4376-a9eb-64cba5ed6c53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:16.039680 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb77cc-35ae-4376-a9eb-64cba5ed6c53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:16.041755 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb77cc-35ae-4376-a9eb-64cba5ed6c53 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:16.051745 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1426/2829] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:18:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:18:19.878504 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6b81f-3f77-4d4e-b305-d5c82d98e1a9 service placement] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:19.879544 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6ef6b81f-3f77-4d4e-b305-d5c82d98e1a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:19.896761 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6b81f-3f77-4d4e-b305-d5c82d98e1a9 service placement] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:19.901623 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72358bba-b4ec-4d75-bced-f0902eeae79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:19.902340 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72358bba-b4ec-4d75-bced-f0902eeae79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:19.906970 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72358bba-b4ec-4d75-bced-f0902eeae79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:19.906970 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72358bba-b4ec-4d75-bced-f0902eeae79c admin admin] PATH_INFO: `/v3/users/39a12126a08341089f09877ad8e31484` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:19.906970 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72358bba-b4ec-4d75-bced-f0902eeae79c admin admin] RBAC: Authorizing `identity:delete_user(user_id=39a12126a08341089f09877ad8e31484)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:19.906970 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72358bba-b4ec-4d75-bced-f0902eeae79c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:20.110097 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-72358bba-b4ec-4d75-bced-f0902eeae79c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39a12126a08341089f09877ad8e31484'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:20.123924 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-72358bba-b4ec-4d75-bced-f0902eeae79c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39a12126a08341089f09877ad8e31484'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:20.124661 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-72358bba-b4ec-4d75-bced-f0902eeae79c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39a12126a08341089f09877ad8e31484'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:20.169086 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-72358bba-b4ec-4d75-bced-f0902eeae79c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39a12126a08341089f09877ad8e31484'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:20.176910 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-72358bba-b4ec-4d75-bced-f0902eeae79c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39a12126a08341089f09877ad8e31484'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:20.183766 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1404/2830] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:18:19 2022] DELETE /identity/v3/users/39a12126a08341089f09877ad8e31484 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:20.454002 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb77cc-35ae-4376-a9eb-64cba5ed6c53 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:20.470177 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb77cc-35ae-4376-a9eb-64cba5ed6c53 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:20.526182 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183b0f6-dfc1-4331-ac1c-4b905176ab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:20.526825 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183b0f6-dfc1-4331-ac1c-4b905176ab7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:20.527106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183b0f6-dfc1-4331-ac1c-4b905176ab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:20.527377 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183b0f6-dfc1-4331-ac1c-4b905176ab7f admin admin] PATH_INFO: `/v3/projects/a717713f93744790b021bb6b6440d86c` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:20.528479 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183b0f6-dfc1-4331-ac1c-4b905176ab7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a717713f93744790b021bb6b6440d86c)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:20.530380 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183b0f6-dfc1-4331-ac1c-4b905176ab7f admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:20.639435 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e183b0f6-dfc1-4331-ac1c-4b905176ab7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a717713f93744790b021bb6b6440d86c', 'request_id': 'req-e183b0f6-dfc1-4331-ac1c-4b905176ab7f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:20.641939 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:20.646264 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e183b0f6-dfc1-4331-ac1c-4b905176ab7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a717713f93744790b021bb6b6440d86c', 'request_id': 'req-e183b0f6-dfc1-4331-ac1c-4b905176ab7f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:20.714889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e183b0f6-dfc1-4331-ac1c-4b905176ab7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a717713f93744790b021bb6b6440d86c', 'request_id': 'req-e183b0f6-dfc1-4331-ac1c-4b905176ab7f'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:20.726595 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e183b0f6-dfc1-4331-ac1c-4b905176ab7f admin admin] The token cache is being invalidate because project a717713f93744790b021bb6b6440d86c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:18:20.726923 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e183b0f6-dfc1-4331-ac1c-4b905176ab7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:20.727738 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-e183b0f6-dfc1-4331-ac1c-4b905176ab7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:20.733780 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1427/2831] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:18:20 2022] DELETE /identity/v3/projects/a717713f93744790b021bb6b6440d86c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:20.735682 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f57ce4-313a-4fc7-a6c6-2134e3539e13 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:20.736059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f57ce4-313a-4fc7-a6c6-2134e3539e13 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:20.736399 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f57ce4-313a-4fc7-a6c6-2134e3539e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:20.761920 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a5f57ce4-313a-4fc7-a6c6-2134e3539e13 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:18:20.763654 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a5f57ce4-313a-4fc7-a6c6-2134e3539e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:20.825801 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1405/2832] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:18:20.833967 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4191385-9cae-4925-8117-4c489d758a1b None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:20.834257 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4191385-9cae-4925-8117-4c489d758a1b None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:20.834537 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4191385-9cae-4925-8117-4c489d758a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:20.855265 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a4191385-9cae-4925-8117-4c489d758a1b None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:18:20.856480 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a4191385-9cae-4925-8117-4c489d758a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:20.864945 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1428/2833] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:18:20.868878 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f57ce4-313a-4fc7-a6c6-2134e3539e13 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:20.879123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f57ce4-313a-4fc7-a6c6-2134e3539e13 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:20.883758 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7690f4-7acc-4205-af3c-7cc0cc2aaaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:20.884364 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7690f4-7acc-4205-af3c-7cc0cc2aaaf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:20.885211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7690f4-7acc-4205-af3c-7cc0cc2aaaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:20.885504 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7690f4-7acc-4205-af3c-7cc0cc2aaaf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:20.886145 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7690f4-7acc-4205-af3c-7cc0cc2aaaf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:18:20.886436 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7690f4-7acc-4205-af3c-7cc0cc2aaaf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:20.888067 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7690f4-7acc-4205-af3c-7cc0cc2aaaf0 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:20.899526 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1406/2834] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:18:20.908149 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4191385-9cae-4925-8117-4c489d758a1b None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:20.918077 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4191385-9cae-4925-8117-4c489d758a1b None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:20.922893 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc5a65-0ec3-4b70-93d1-5d4a7a11c410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:20.923522 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc5a65-0ec3-4b70-93d1-5d4a7a11c410 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:20.923805 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc5a65-0ec3-4b70-93d1-5d4a7a11c410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:20.924104 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc5a65-0ec3-4b70-93d1-5d4a7a11c410 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:20.924752 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc5a65-0ec3-4b70-93d1-5d4a7a11c410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:20.926662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc5a65-0ec3-4b70-93d1-5d4a7a11c410 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:21.002051 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1429/2835] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:18:20 2022] POST /identity/v3/projects => generated 369 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:18:21.006591 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7690f4-7acc-4205-af3c-7cc0cc2aaaf0 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:21.017626 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7690f4-7acc-4205-af3c-7cc0cc2aaaf0 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:21.077844 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f814c12-b25b-4fc2-91cb-a191dafaf284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:21.078457 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f814c12-b25b-4fc2-91cb-a191dafaf284 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:21.078739 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f814c12-b25b-4fc2-91cb-a191dafaf284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:21.079051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f814c12-b25b-4fc2-91cb-a191dafaf284 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:21.079689 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f814c12-b25b-4fc2-91cb-a191dafaf284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:21.081612 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f814c12-b25b-4fc2-91cb-a191dafaf284 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:21.090419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:21.192858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1407/2836] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:18:21 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:18:21.197849 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc5a65-0ec3-4b70-93d1-5d4a7a11c410 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:21.209124 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc5a65-0ec3-4b70-93d1-5d4a7a11c410 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:21.214278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f074f-9c8d-4d89-bef0-47191c23fff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:21.214835 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f074f-9c8d-4d89-bef0-47191c23fff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:21.215216 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f074f-9c8d-4d89-bef0-47191c23fff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:21.215489 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f074f-9c8d-4d89-bef0-47191c23fff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:21.216198 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f074f-9c8d-4d89-bef0-47191c23fff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:21.217789 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f074f-9c8d-4d89-bef0-47191c23fff4 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:21.229733 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1430/2837] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:18:21.234058 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f814c12-b25b-4fc2-91cb-a191dafaf284 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:21.244496 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f814c12-b25b-4fc2-91cb-a191dafaf284 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:21.249712 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619df8f3-6d84-4c4f-9c36-99af6352d4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:21.250317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619df8f3-6d84-4c4f-9c36-99af6352d4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:21.250988 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619df8f3-6d84-4c4f-9c36-99af6352d4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:21.251324 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619df8f3-6d84-4c4f-9c36-99af6352d4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:21.251977 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619df8f3-6d84-4c4f-9c36-99af6352d4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:21.253914 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619df8f3-6d84-4c4f-9c36-99af6352d4c7 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:21.269034 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1408/2838] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 11 11:18:21.270204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f074f-9c8d-4d89-bef0-47191c23fff4 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:21.280950 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f074f-9c8d-4d89-bef0-47191c23fff4 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:21.285704 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f528ae7-3944-49dc-846a-9415b2d30fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:21.286365 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f528ae7-3944-49dc-846a-9415b2d30fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:21.286648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f528ae7-3944-49dc-846a-9415b2d30fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:21.289715 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f528ae7-3944-49dc-846a-9415b2d30fcb admin admin] PATH_INFO: `/v3/projects/80562bfc25f84508869bb372b3b8bb49/users/935900561e9a420d864bc46fd1f45371/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:21.303853 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f528ae7-3944-49dc-846a-9415b2d30fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=80562bfc25f84508869bb372b3b8bb49, user_id=935900561e9a420d864bc46fd1f45371, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:21.309776 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f528ae7-3944-49dc-846a-9415b2d30fcb admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:21.429375 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1431/2839] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:18:21 2022] PUT /identity/v3/projects/80562bfc25f84508869bb372b3b8bb49/users/935900561e9a420d864bc46fd1f45371/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:21.440111 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9060248-f9e2-4c85-8e25-16271a3e2f71 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:21.444496 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9060248-f9e2-4c85-8e25-16271a3e2f71 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:21.444496 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9060248-f9e2-4c85-8e25-16271a3e2f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:21.468798 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d9060248-f9e2-4c85-8e25-16271a3e2f71 None None] MFA Rules not processed for user `935900561e9a420d864bc46fd1f45371`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:18:21.470020 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d9060248-f9e2-4c85-8e25-16271a3e2f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:21.543002 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1409/2840] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:18:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:18:21.547330 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f528ae7-3944-49dc-846a-9415b2d30fcb admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:21.616551 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f528ae7-3944-49dc-846a-9415b2d30fcb admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:21.622340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095273b-a303-4186-956e-5a6e20dd65a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:21.622972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095273b-a303-4186-956e-5a6e20dd65a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:21.623258 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095273b-a303-4186-956e-5a6e20dd65a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:21.623794 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095273b-a303-4186-956e-5a6e20dd65a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:21.624438 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095273b-a303-4186-956e-5a6e20dd65a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:21.626352 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095273b-a303-4186-956e-5a6e20dd65a5 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:21.723916 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1432/2841] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:18:21 2022] POST /identity/v3/projects => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:18:21.728021 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9060248-f9e2-4c85-8e25-16271a3e2f71 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:21.739369 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9060248-f9e2-4c85-8e25-16271a3e2f71 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:21.794615 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51f5b7-fd98-47d7-978a-7d5026b86345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:21.795173 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51f5b7-fd98-47d7-978a-7d5026b86345 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:21.795452 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51f5b7-fd98-47d7-978a-7d5026b86345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:21.795722 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51f5b7-fd98-47d7-978a-7d5026b86345 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:21.796335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51f5b7-fd98-47d7-978a-7d5026b86345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:21.798222 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51f5b7-fd98-47d7-978a-7d5026b86345 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:21.921587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1410/2842] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:18:21 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:18:21.925729 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095273b-a303-4186-956e-5a6e20dd65a5 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:21.937133 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095273b-a303-4186-956e-5a6e20dd65a5 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:21.941709 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f22aa-bbb2-4754-81ca-7580376b462d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:21.942312 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f22aa-bbb2-4754-81ca-7580376b462d admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:21.942590 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f22aa-bbb2-4754-81ca-7580376b462d admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:21.942895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f22aa-bbb2-4754-81ca-7580376b462d admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:21.943536 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f22aa-bbb2-4754-81ca-7580376b462d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:21.945158 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f22aa-bbb2-4754-81ca-7580376b462d admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:21.955972 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1433/2843] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:18:21.960159 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51f5b7-fd98-47d7-978a-7d5026b86345 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:21.970449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51f5b7-fd98-47d7-978a-7d5026b86345 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:21.975027 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345b14b-8a6a-4608-8dd9-6019735a031c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:21.975662 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345b14b-8a6a-4608-8dd9-6019735a031c admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:21.975940 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345b14b-8a6a-4608-8dd9-6019735a031c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:21.976214 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345b14b-8a6a-4608-8dd9-6019735a031c admin admin] PATH_INFO: `/v3/projects/463b782b6df14c6e863dcf873cac4878/users/ab7fac6218314fda826f889e0ccd3927/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:21.990936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345b14b-8a6a-4608-8dd9-6019735a031c admin admin] RBAC: Authorizing `identity:create_grant(project_id=463b782b6df14c6e863dcf873cac4878, user_id=ab7fac6218314fda826f889e0ccd3927, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:21.993549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345b14b-8a6a-4608-8dd9-6019735a031c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:22.054706 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1411/2844] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:18:21 2022] PUT /identity/v3/projects/463b782b6df14c6e863dcf873cac4878/users/ab7fac6218314fda826f889e0ccd3927/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 11 11:18:22.058926 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f22aa-bbb2-4754-81ca-7580376b462d admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:22.068838 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f22aa-bbb2-4754-81ca-7580376b462d admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:22.113971 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:22.123554 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0486e-579a-4cf3-baf8-c45a525acb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:22.124153 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0486e-579a-4cf3-baf8-c45a525acb63 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:22.124469 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0486e-579a-4cf3-baf8-c45a525acb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:22.125977 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0486e-579a-4cf3-baf8-c45a525acb63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:22.125977 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0486e-579a-4cf3-baf8-c45a525acb63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:22.127004 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0486e-579a-4cf3-baf8-c45a525acb63 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:22.136694 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1434/2845] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:18:22.140852 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345b14b-8a6a-4608-8dd9-6019735a031c admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:22.152163 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345b14b-8a6a-4608-8dd9-6019735a031c admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:22.156954 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb160b7-c897-4b04-a145-a00d00fa1b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:22.158539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb160b7-c897-4b04-a145-a00d00fa1b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:22.158539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb160b7-c897-4b04-a145-a00d00fa1b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:22.158539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb160b7-c897-4b04-a145-a00d00fa1b02 admin admin] PATH_INFO: `/v3/projects/463b782b6df14c6e863dcf873cac4878/users/ab7fac6218314fda826f889e0ccd3927/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:22.160124 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb160b7-c897-4b04-a145-a00d00fa1b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=463b782b6df14c6e863dcf873cac4878, user_id=ab7fac6218314fda826f889e0ccd3927, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:22.162751 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb160b7-c897-4b04-a145-a00d00fa1b02 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:22.173419 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1412/2846] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:18:22 2022] PUT /identity/v3/projects/463b782b6df14c6e863dcf873cac4878/users/ab7fac6218314fda826f889e0ccd3927/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:22.185481 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ab75e-a7fe-412f-860b-678505abbeab None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:22.185767 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ab75e-a7fe-412f-860b-678505abbeab None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:22.186040 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ab75e-a7fe-412f-860b-678505abbeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:22.215206 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-5b2ab75e-a7fe-412f-860b-678505abbeab None None] MFA Rules not processed for user `ab7fac6218314fda826f889e0ccd3927`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:18:22.218204 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5b2ab75e-a7fe-412f-860b-678505abbeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:22.285022 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1435/2847] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:18:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:18:22.296432 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb160b7-c897-4b04-a145-a00d00fa1b02 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:22.298100 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7cb160b7-c897-4b04-a145-a00d00fa1b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:22.321404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:22.357363 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb160b7-c897-4b04-a145-a00d00fa1b02 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:22.361029 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfaae3-c33f-48b7-a753-038960ed9066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:22.361629 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfaae3-c33f-48b7-a753-038960ed9066 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:22.361908 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfaae3-c33f-48b7-a753-038960ed9066 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:22.362181 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfaae3-c33f-48b7-a753-038960ed9066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:22.372257 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfaae3-c33f-48b7-a753-038960ed9066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:22.373684 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dfaae3-c33f-48b7-a753-038960ed9066 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:22.384112 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1413/2848] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:18:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:18:23.914827 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ab75e-a7fe-412f-860b-678505abbeab None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:23.916284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-5b2ab75e-a7fe-412f-860b-678505abbeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:23.980603 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ab75e-a7fe-412f-860b-678505abbeab None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:23.984156 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae647c-ecf7-46aa-ad82-e3105e33c1d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:23.984758 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae647c-ecf7-46aa-ad82-e3105e33c1d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:23.987990 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae647c-ecf7-46aa-ad82-e3105e33c1d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:23.987990 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae647c-ecf7-46aa-ad82-e3105e33c1d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:23.987990 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-fdae647c-ecf7-46aa-ad82-e3105e33c1d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:24.051531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae647c-ecf7-46aa-ad82-e3105e33c1d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:24.052990 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae647c-ecf7-46aa-ad82-e3105e33c1d7 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:24.063984 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1436/2849] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:18:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:18:25.271501 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfaae3-c33f-48b7-a753-038960ed9066 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:25.387271 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dfaae3-c33f-48b7-a753-038960ed9066 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:25.391652 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a485ca6-0f44-46d0-a117-e47fbeaaa8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:25.392277 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485ca6-0f44-46d0-a117-e47fbeaaa8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:25.392556 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485ca6-0f44-46d0-a117-e47fbeaaa8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:25.392836 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485ca6-0f44-46d0-a117-e47fbeaaa8a0 admin admin] PATH_INFO: `/v3/users/935900561e9a420d864bc46fd1f45371` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:25.393936 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a485ca6-0f44-46d0-a117-e47fbeaaa8a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=935900561e9a420d864bc46fd1f45371)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:25.395880 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a485ca6-0f44-46d0-a117-e47fbeaaa8a0 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:25.587190 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2a485ca6-0f44-46d0-a117-e47fbeaaa8a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '935900561e9a420d864bc46fd1f45371'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:25.599990 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2a485ca6-0f44-46d0-a117-e47fbeaaa8a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '935900561e9a420d864bc46fd1f45371'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:25.600679 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2a485ca6-0f44-46d0-a117-e47fbeaaa8a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '935900561e9a420d864bc46fd1f45371'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:25.686729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2a485ca6-0f44-46d0-a117-e47fbeaaa8a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '935900561e9a420d864bc46fd1f45371'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:25.694680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2a485ca6-0f44-46d0-a117-e47fbeaaa8a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '935900561e9a420d864bc46fd1f45371'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:25.701169 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1414/2850] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:18:25 2022] DELETE /identity/v3/users/935900561e9a420d864bc46fd1f45371 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:25.705707 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224a3ff-cdb4-4435-9d07-045006e7748a None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:25.706228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224a3ff-cdb4-4435-9d07-045006e7748a None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:25.706228 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224a3ff-cdb4-4435-9d07-045006e7748a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:25.725989 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-1224a3ff-cdb4-4435-9d07-045006e7748a None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:18:25.727394 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1224a3ff-cdb4-4435-9d07-045006e7748a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:25.745614 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:25.788637 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1437/2851] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:18:25.800310 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a485ca6-0f44-46d0-a117-e47fbeaaa8a0 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:25.801882 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2a485ca6-0f44-46d0-a117-e47fbeaaa8a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:25.849123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:25.861770 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a485ca6-0f44-46d0-a117-e47fbeaaa8a0 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:25.866001 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d84b0-4206-4ea2-9786-92e6ff902741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:25.866609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d84b0-4206-4ea2-9786-92e6ff902741 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:25.867095 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d84b0-4206-4ea2-9786-92e6ff902741 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:25.867404 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d84b0-4206-4ea2-9786-92e6ff902741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:25.877536 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d84b0-4206-4ea2-9786-92e6ff902741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:25.879303 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d84b0-4206-4ea2-9786-92e6ff902741 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:25.890480 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1415/2852] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:18:26.359886 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224a3ff-cdb4-4435-9d07-045006e7748a None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:26.361390 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1224a3ff-cdb4-4435-9d07-045006e7748a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:26.375010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224a3ff-cdb4-4435-9d07-045006e7748a None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:26.410029 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7878610-021e-400e-bb43-273ef0ad96b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:26.410648 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7878610-021e-400e-bb43-273ef0ad96b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:26.411047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7878610-021e-400e-bb43-273ef0ad96b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:26.411357 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7878610-021e-400e-bb43-273ef0ad96b9 admin admin] PATH_INFO: `/v3/projects/80562bfc25f84508869bb372b3b8bb49` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:26.413716 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7878610-021e-400e-bb43-273ef0ad96b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80562bfc25f84508869bb372b3b8bb49)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:26.415711 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7878610-021e-400e-bb43-273ef0ad96b9 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:26.545895 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b7878610-021e-400e-bb43-273ef0ad96b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80562bfc25f84508869bb372b3b8bb49', 'request_id': 'req-b7878610-021e-400e-bb43-273ef0ad96b9'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:26.553176 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b7878610-021e-400e-bb43-273ef0ad96b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80562bfc25f84508869bb372b3b8bb49', 'request_id': 'req-b7878610-021e-400e-bb43-273ef0ad96b9'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:26.623722 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b7878610-021e-400e-bb43-273ef0ad96b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80562bfc25f84508869bb372b3b8bb49', 'request_id': 'req-b7878610-021e-400e-bb43-273ef0ad96b9'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:26.636719 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b7878610-021e-400e-bb43-273ef0ad96b9 admin admin] The token cache is being invalidate because project 80562bfc25f84508869bb372b3b8bb49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:18:26.637045 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b7878610-021e-400e-bb43-273ef0ad96b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:26.637802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-b7878610-021e-400e-bb43-273ef0ad96b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:26.639405 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1438/2853] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:18:26 2022] DELETE /identity/v3/projects/80562bfc25f84508869bb372b3b8bb49 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:26.643543 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d84b0-4206-4ea2-9786-92e6ff902741 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:26.655663 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d84b0-4206-4ea2-9786-92e6ff902741 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:26.725676 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd8ee2-cf61-4e6e-9ce0-08781a72023b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:26.726476 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd8ee2-cf61-4e6e-9ce0-08781a72023b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:26.726861 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd8ee2-cf61-4e6e-9ce0-08781a72023b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:26.727205 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd8ee2-cf61-4e6e-9ce0-08781a72023b admin admin] PATH_INFO: `/v3/users/ab7fac6218314fda826f889e0ccd3927` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:26.728955 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd8ee2-cf61-4e6e-9ce0-08781a72023b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab7fac6218314fda826f889e0ccd3927)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:26.731688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd8ee2-cf61-4e6e-9ce0-08781a72023b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:26.921064 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d9fd8ee2-cf61-4e6e-9ce0-08781a72023b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab7fac6218314fda826f889e0ccd3927'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:26.935790 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d9fd8ee2-cf61-4e6e-9ce0-08781a72023b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab7fac6218314fda826f889e0ccd3927'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:26.936539 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d9fd8ee2-cf61-4e6e-9ce0-08781a72023b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab7fac6218314fda826f889e0ccd3927'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:27.023874 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d9fd8ee2-cf61-4e6e-9ce0-08781a72023b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab7fac6218314fda826f889e0ccd3927'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:27.030098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-d9fd8ee2-cf61-4e6e-9ce0-08781a72023b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab7fac6218314fda826f889e0ccd3927'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:27.038655 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1416/2854] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:18:26 2022] DELETE /identity/v3/users/ab7fac6218314fda826f889e0ccd3927 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:27.483689 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7878610-021e-400e-bb43-273ef0ad96b9 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:27.490000 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-b7878610-021e-400e-bb43-273ef0ad96b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:27.499140 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7878610-021e-400e-bb43-273ef0ad96b9 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:27.555621 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02c1a4-13ba-4fcb-a78a-4b96aa6df63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:27.556248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02c1a4-13ba-4fcb-a78a-4b96aa6df63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:27.556528 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02c1a4-13ba-4fcb-a78a-4b96aa6df63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:27.556802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02c1a4-13ba-4fcb-a78a-4b96aa6df63b admin admin] PATH_INFO: `/v3/projects/463b782b6df14c6e863dcf873cac4878` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:27.558144 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02c1a4-13ba-4fcb-a78a-4b96aa6df63b admin admin] RBAC: Authorizing `identity:delete_project(project_id=463b782b6df14c6e863dcf873cac4878)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:27.560094 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02c1a4-13ba-4fcb-a78a-4b96aa6df63b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:27.665414 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:27.666730 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fe02c1a4-13ba-4fcb-a78a-4b96aa6df63b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '463b782b6df14c6e863dcf873cac4878', 'request_id': 'req-fe02c1a4-13ba-4fcb-a78a-4b96aa6df63b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:27.672211 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fe02c1a4-13ba-4fcb-a78a-4b96aa6df63b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '463b782b6df14c6e863dcf873cac4878', 'request_id': 'req-fe02c1a4-13ba-4fcb-a78a-4b96aa6df63b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:27.771656 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fe02c1a4-13ba-4fcb-a78a-4b96aa6df63b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '463b782b6df14c6e863dcf873cac4878', 'request_id': 'req-fe02c1a4-13ba-4fcb-a78a-4b96aa6df63b'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:27.783520 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fe02c1a4-13ba-4fcb-a78a-4b96aa6df63b admin admin] The token cache is being invalidate because project 463b782b6df14c6e863dcf873cac4878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:18:27.783815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fe02c1a4-13ba-4fcb-a78a-4b96aa6df63b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:27.784449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-fe02c1a4-13ba-4fcb-a78a-4b96aa6df63b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:27.785921 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1439/2855] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:18:27 2022] DELETE /identity/v3/projects/463b782b6df14c6e863dcf873cac4878 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:27.791036 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53b56d-1b6c-400d-aeed-117143ab044b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:27.791518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53b56d-1b6c-400d-aeed-117143ab044b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:27.791644 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb53b56d-1b6c-400d-aeed-117143ab044b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:27.811087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-cb53b56d-1b6c-400d-aeed-117143ab044b None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:18:27.812291 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cb53b56d-1b6c-400d-aeed-117143ab044b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:27.869958 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1417/2856] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:18:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:18:27.878372 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f75bf6-e1c1-4ecc-97ac-393d13eefc26 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:27.878656 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f75bf6-e1c1-4ecc-97ac-393d13eefc26 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:27.878968 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f75bf6-e1c1-4ecc-97ac-393d13eefc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:27.899521 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-92f75bf6-e1c1-4ecc-97ac-393d13eefc26 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:18:27.900720 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-92f75bf6-e1c1-4ecc-97ac-393d13eefc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:27.908723 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1440/2857] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:18:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:18:27.912971 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53b56d-1b6c-400d-aeed-117143ab044b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:27.919149 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:27.922858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb53b56d-1b6c-400d-aeed-117143ab044b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:27.927337 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465632ae-dc33-49cc-b685-92f65b5cded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:27.927932 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465632ae-dc33-49cc-b685-92f65b5cded3 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:27.928220 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465632ae-dc33-49cc-b685-92f65b5cded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:27.928491 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465632ae-dc33-49cc-b685-92f65b5cded3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:27.929160 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465632ae-dc33-49cc-b685-92f65b5cded3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:18:27.929461 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465632ae-dc33-49cc-b685-92f65b5cded3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:27.931083 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465632ae-dc33-49cc-b685-92f65b5cded3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:27.942906 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1418/2858] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:18:27.947154 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f75bf6-e1c1-4ecc-97ac-393d13eefc26 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:27.959189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f75bf6-e1c1-4ecc-97ac-393d13eefc26 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:27.964576 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4213227-9482-4761-a5f7-e2d45f2c0e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:27.965174 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4213227-9482-4761-a5f7-e2d45f2c0e83 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:27.965456 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4213227-9482-4761-a5f7-e2d45f2c0e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:27.965730 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4213227-9482-4761-a5f7-e2d45f2c0e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:27.966353 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4213227-9482-4761-a5f7-e2d45f2c0e83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:27.968309 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4213227-9482-4761-a5f7-e2d45f2c0e83 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:28.041889 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1441/2859] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:18:27 2022] POST /identity/v3/projects => generated 407 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:18:28.049635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465632ae-dc33-49cc-b685-92f65b5cded3 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:28.056390 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465632ae-dc33-49cc-b685-92f65b5cded3 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:28.113000 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b59a5-e1b6-4e94-bcdf-62158a06fdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:28.113604 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b59a5-e1b6-4e94-bcdf-62158a06fdb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:28.113888 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b59a5-e1b6-4e94-bcdf-62158a06fdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:28.114163 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b59a5-e1b6-4e94-bcdf-62158a06fdb2 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:28.114808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b59a5-e1b6-4e94-bcdf-62158a06fdb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:28.116729 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b59a5-e1b6-4e94-bcdf-62158a06fdb2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:28.224335 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1419/2860] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:18:28 2022] POST /identity/v3/users => generated 304 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:18:28.228785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4213227-9482-4761-a5f7-e2d45f2c0e83 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:28.239779 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4213227-9482-4761-a5f7-e2d45f2c0e83 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:28.244434 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318a140-c9c4-4858-a16e-bcb4642b3bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:28.245177 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318a140-c9c4-4858-a16e-bcb4642b3bdd admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:28.245461 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318a140-c9c4-4858-a16e-bcb4642b3bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:28.246342 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318a140-c9c4-4858-a16e-bcb4642b3bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:28.247085 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318a140-c9c4-4858-a16e-bcb4642b3bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:28.248699 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318a140-c9c4-4858-a16e-bcb4642b3bdd admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:28.259108 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1442/2861] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:18:28.263749 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b59a5-e1b6-4e94-bcdf-62158a06fdb2 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:28.273816 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b59a5-e1b6-4e94-bcdf-62158a06fdb2 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:28.278424 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418d78c-19f4-4a8f-bf5d-17625caf745c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:28.279042 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418d78c-19f4-4a8f-bf5d-17625caf745c admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:28.279322 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418d78c-19f4-4a8f-bf5d-17625caf745c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:28.279594 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418d78c-19f4-4a8f-bf5d-17625caf745c admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:28.280254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418d78c-19f4-4a8f-bf5d-17625caf745c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:28.281828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8418d78c-19f4-4a8f-bf5d-17625caf745c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:28.293136 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1420/2862] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:18:28.297247 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318a140-c9c4-4858-a16e-bcb4642b3bdd admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:28.307047 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318a140-c9c4-4858-a16e-bcb4642b3bdd admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:28.312395 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d3742-73db-4b1f-91f2-04f9f4547154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:28.313056 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d3742-73db-4b1f-91f2-04f9f4547154 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:28.313332 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d3742-73db-4b1f-91f2-04f9f4547154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:28.313666 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d3742-73db-4b1f-91f2-04f9f4547154 admin admin] PATH_INFO: `/v3/projects/8a2c8c2e9a5a4230a9fc2b8a1925d965/users/fa865d2ec225433499434fa12dc6a1f6/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:28.327874 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d3742-73db-4b1f-91f2-04f9f4547154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a2c8c2e9a5a4230a9fc2b8a1925d965, user_id=fa865d2ec225433499434fa12dc6a1f6, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:28.330537 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d3742-73db-4b1f-91f2-04f9f4547154 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:28.428816 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1443/2863] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:18:28 2022] PUT /identity/v3/projects/8a2c8c2e9a5a4230a9fc2b8a1925d965/users/fa865d2ec225433499434fa12dc6a1f6/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:28.441105 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002845b3-4f7a-4c16-931f-c6253f29cde4 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:28.444461 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002845b3-4f7a-4c16-931f-c6253f29cde4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:28.444461 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002845b3-4f7a-4c16-931f-c6253f29cde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:28.468706 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-002845b3-4f7a-4c16-931f-c6253f29cde4 None None] MFA Rules not processed for user `fa865d2ec225433499434fa12dc6a1f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:18:28.469926 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-002845b3-4f7a-4c16-931f-c6253f29cde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:28.532293 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1421/2864] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:18:28 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:18:28.536805 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d3742-73db-4b1f-91f2-04f9f4547154 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:28.596256 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d3742-73db-4b1f-91f2-04f9f4547154 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:28.600841 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f571634-704a-474e-a559-15f83ab8f0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:28.601431 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f571634-704a-474e-a559-15f83ab8f0ca admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:28.601710 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f571634-704a-474e-a559-15f83ab8f0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:28.601980 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f571634-704a-474e-a559-15f83ab8f0ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:28.602593 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f571634-704a-474e-a559-15f83ab8f0ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:28.604529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f571634-704a-474e-a559-15f83ab8f0ca admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:28.688052 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1444/2865] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:18:28 2022] POST /identity/v3/projects => generated 409 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:18:28.692059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002845b3-4f7a-4c16-931f-c6253f29cde4 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:28.702896 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002845b3-4f7a-4c16-931f-c6253f29cde4 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:28.762628 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aa784-395a-4bc4-9e9c-47c9035398bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:28.763280 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aa784-395a-4bc4-9e9c-47c9035398bd admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:28.763564 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aa784-395a-4bc4-9e9c-47c9035398bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:28.763841 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aa784-395a-4bc4-9e9c-47c9035398bd admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:28.764461 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0aa784-395a-4bc4-9e9c-47c9035398bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:28.766455 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0aa784-395a-4bc4-9e9c-47c9035398bd admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:28.774347 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:28.869109 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1422/2866] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:18:28 2022] POST /identity/v3/users => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:18:28.873018 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f571634-704a-474e-a559-15f83ab8f0ca admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:28.883280 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f571634-704a-474e-a559-15f83ab8f0ca admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:28.888202 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f6c77-2260-406b-bf13-0b418d23b01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:28.888799 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f6c77-2260-406b-bf13-0b418d23b01a admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:28.889081 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f6c77-2260-406b-bf13-0b418d23b01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:28.889354 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f6c77-2260-406b-bf13-0b418d23b01a admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:28.889998 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f6c77-2260-406b-bf13-0b418d23b01a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:28.891632 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f6c77-2260-406b-bf13-0b418d23b01a admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:28.902886 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1445/2867] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:18:28.906935 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aa784-395a-4bc4-9e9c-47c9035398bd admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:28.917131 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aa784-395a-4bc4-9e9c-47c9035398bd admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:28.922569 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29786c36-9991-4507-ba59-2d2c759f09db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:28.923259 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29786c36-9991-4507-ba59-2d2c759f09db admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:28.923569 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29786c36-9991-4507-ba59-2d2c759f09db admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:28.923846 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29786c36-9991-4507-ba59-2d2c759f09db admin admin] PATH_INFO: `/v3/projects/be6786a6ad054e05bfd3af764842b50f/users/bb87a19267864015b1747cc2594cf403/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:28.938479 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29786c36-9991-4507-ba59-2d2c759f09db admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6786a6ad054e05bfd3af764842b50f, user_id=bb87a19267864015b1747cc2594cf403, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:28.941182 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29786c36-9991-4507-ba59-2d2c759f09db admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:29.015257 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1423/2868] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:18:28 2022] PUT /identity/v3/projects/be6786a6ad054e05bfd3af764842b50f/users/bb87a19267864015b1747cc2594cf403/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:29.019365 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f6c77-2260-406b-bf13-0b418d23b01a admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:29.030272 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f6c77-2260-406b-bf13-0b418d23b01a admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:29.076185 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:29.124695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79aced-3330-4264-aa31-798aef235cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:29.124695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79aced-3330-4264-aa31-798aef235cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:29.124695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79aced-3330-4264-aa31-798aef235cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:29.124695 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79aced-3330-4264-aa31-798aef235cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:29.125136 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79aced-3330-4264-aa31-798aef235cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:29.125136 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79aced-3330-4264-aa31-798aef235cc1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:29.125136 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1446/2869] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:18:29.125393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29786c36-9991-4507-ba59-2d2c759f09db admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:29.125393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29786c36-9991-4507-ba59-2d2c759f09db admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:29.125393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf666d-87ef-45d0-9e75-108051c92228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:29.125393 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf666d-87ef-45d0-9e75-108051c92228 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:29.125766 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf666d-87ef-45d0-9e75-108051c92228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:29.125766 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf666d-87ef-45d0-9e75-108051c92228 admin admin] PATH_INFO: `/v3/projects/be6786a6ad054e05bfd3af764842b50f/users/bb87a19267864015b1747cc2594cf403/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:29.125766 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf666d-87ef-45d0-9e75-108051c92228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6786a6ad054e05bfd3af764842b50f, user_id=bb87a19267864015b1747cc2594cf403, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:29.127553 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf666d-87ef-45d0-9e75-108051c92228 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:29.138547 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1424/2870] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:18:29 2022] PUT /identity/v3/projects/be6786a6ad054e05bfd3af764842b50f/users/bb87a19267864015b1747cc2594cf403/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:29.201839 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7fb8e-876d-4061-baf4-2cac451e37bb None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:29.202124 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7fb8e-876d-4061-baf4-2cac451e37bb None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:29.202401 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7fb8e-876d-4061-baf4-2cac451e37bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:29.230631 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-27a7fb8e-876d-4061-baf4-2cac451e37bb None None] MFA Rules not processed for user `bb87a19267864015b1747cc2594cf403`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:18:29.232627 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-27a7fb8e-876d-4061-baf4-2cac451e37bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:29.299617 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1447/2871] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:18:29 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:18:29.310773 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf666d-87ef-45d0-9e75-108051c92228 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:29.312502 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2fcf666d-87ef-45d0-9e75-108051c92228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:29.369518 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf666d-87ef-45d0-9e75-108051c92228 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:29.373717 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2da31-6b22-401f-aac4-29ccc5371656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:29.374320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2da31-6b22-401f-aac4-29ccc5371656 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:29.374599 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2da31-6b22-401f-aac4-29ccc5371656 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:29.374959 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2da31-6b22-401f-aac4-29ccc5371656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:29.384125 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2da31-6b22-401f-aac4-29ccc5371656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:29.385542 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2da31-6b22-401f-aac4-29ccc5371656 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:29.395675 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1425/2872] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:18:29 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:18:29.721529 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7fb8e-876d-4061-baf4-2cac451e37bb None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:29.730861 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7fb8e-876d-4061-baf4-2cac451e37bb None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:29.735039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09147e90-e9e5-403f-87ec-4d8a84b81b39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:29.735630 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09147e90-e9e5-403f-87ec-4d8a84b81b39 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:29.735905 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09147e90-e9e5-403f-87ec-4d8a84b81b39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:29.736174 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09147e90-e9e5-403f-87ec-4d8a84b81b39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:29.791599 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09147e90-e9e5-403f-87ec-4d8a84b81b39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:29.793026 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09147e90-e9e5-403f-87ec-4d8a84b81b39 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:29.802311 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1448/2873] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:18:29 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:18:36.566523 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2da31-6b22-401f-aac4-29ccc5371656 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:36.627797 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2da31-6b22-401f-aac4-29ccc5371656 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:36.632559 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda0719-6dcf-4f26-8b17-b7b2ab9568a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:36.633180 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda0719-6dcf-4f26-8b17-b7b2ab9568a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:36.633461 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda0719-6dcf-4f26-8b17-b7b2ab9568a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:36.633736 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda0719-6dcf-4f26-8b17-b7b2ab9568a7 admin admin] PATH_INFO: `/v3/users/fa865d2ec225433499434fa12dc6a1f6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:36.634860 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda0719-6dcf-4f26-8b17-b7b2ab9568a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa865d2ec225433499434fa12dc6a1f6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:36.636772 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda0719-6dcf-4f26-8b17-b7b2ab9568a7 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:36.883897 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0bda0719-6dcf-4f26-8b17-b7b2ab9568a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa865d2ec225433499434fa12dc6a1f6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:36.891973 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:36.897326 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0bda0719-6dcf-4f26-8b17-b7b2ab9568a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa865d2ec225433499434fa12dc6a1f6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:36.898002 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0bda0719-6dcf-4f26-8b17-b7b2ab9568a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa865d2ec225433499434fa12dc6a1f6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:37.166331 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0bda0719-6dcf-4f26-8b17-b7b2ab9568a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa865d2ec225433499434fa12dc6a1f6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:37.174230 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-0bda0719-6dcf-4f26-8b17-b7b2ab9568a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa865d2ec225433499434fa12dc6a1f6'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:37.180451 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1426/2874] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:18:36 2022] DELETE /identity/v3/users/fa865d2ec225433499434fa12dc6a1f6 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:37.184869 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cb2f0-6257-4083-8bdf-aa359af382bd None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:37.188174 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cb2f0-6257-4083-8bdf-aa359af382bd None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:37.188174 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963cb2f0-6257-4083-8bdf-aa359af382bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:37.205423 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-963cb2f0-6257-4083-8bdf-aa359af382bd None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:18:37.206883 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-963cb2f0-6257-4083-8bdf-aa359af382bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:37.266248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1449/2875] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:18:37.276120 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda0719-6dcf-4f26-8b17-b7b2ab9568a7 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:37.277532 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0bda0719-6dcf-4f26-8b17-b7b2ab9568a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:37.335558 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda0719-6dcf-4f26-8b17-b7b2ab9568a7 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:37.339311 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562ef6b-b608-4236-a98e-0fcc88f68137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:37.340012 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562ef6b-b608-4236-a98e-0fcc88f68137 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:37.340296 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562ef6b-b608-4236-a98e-0fcc88f68137 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:37.340574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562ef6b-b608-4236-a98e-0fcc88f68137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:37.349674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562ef6b-b608-4236-a98e-0fcc88f68137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:37.351177 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562ef6b-b608-4236-a98e-0fcc88f68137 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:37.361378 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1427/2876] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:18:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:18:37.752938 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963cb2f0-6257-4083-8bdf-aa359af382bd None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:37.754626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-963cb2f0-6257-4083-8bdf-aa359af382bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:37.766678 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963cb2f0-6257-4083-8bdf-aa359af382bd None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:37.771847 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f569be-9891-465e-8d17-240c6890cc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:37.772489 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f569be-9891-465e-8d17-240c6890cc87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:37.772772 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f569be-9891-465e-8d17-240c6890cc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:37.773048 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f569be-9891-465e-8d17-240c6890cc87 admin admin] PATH_INFO: `/v3/projects/8a2c8c2e9a5a4230a9fc2b8a1925d965` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:37.774185 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f569be-9891-465e-8d17-240c6890cc87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a2c8c2e9a5a4230a9fc2b8a1925d965)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:37.776193 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f569be-9891-465e-8d17-240c6890cc87 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:37.777948 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:37.875949 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-49f569be-9891-465e-8d17-240c6890cc87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a2c8c2e9a5a4230a9fc2b8a1925d965', 'request_id': 'req-49f569be-9891-465e-8d17-240c6890cc87'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:37.881620 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-49f569be-9891-465e-8d17-240c6890cc87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a2c8c2e9a5a4230a9fc2b8a1925d965', 'request_id': 'req-49f569be-9891-465e-8d17-240c6890cc87'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:37.983560 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-49f569be-9891-465e-8d17-240c6890cc87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a2c8c2e9a5a4230a9fc2b8a1925d965', 'request_id': 'req-49f569be-9891-465e-8d17-240c6890cc87'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:37.995312 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-49f569be-9891-465e-8d17-240c6890cc87 admin admin] The token cache is being invalidate because project 8a2c8c2e9a5a4230a9fc2b8a1925d965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:18:37.995657 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-49f569be-9891-465e-8d17-240c6890cc87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:37.996232 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-49f569be-9891-465e-8d17-240c6890cc87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:37.997802 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1450/2877] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:18:37 2022] DELETE /identity/v3/projects/8a2c8c2e9a5a4230a9fc2b8a1925d965 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:38.001807 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562ef6b-b608-4236-a98e-0fcc88f68137 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:38.011699 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562ef6b-b608-4236-a98e-0fcc88f68137 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:38.069211 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549a690-9dde-487d-90e3-4ad2e63c4c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:38.069842 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549a690-9dde-487d-90e3-4ad2e63c4c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:38.070125 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549a690-9dde-487d-90e3-4ad2e63c4c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:38.070397 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549a690-9dde-487d-90e3-4ad2e63c4c25 admin admin] PATH_INFO: `/v3/users/bb87a19267864015b1747cc2594cf403` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:38.071556 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549a690-9dde-487d-90e3-4ad2e63c4c25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb87a19267864015b1747cc2594cf403)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:38.073477 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549a690-9dde-487d-90e3-4ad2e63c4c25 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:38.273531 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3549a690-9dde-487d-90e3-4ad2e63c4c25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb87a19267864015b1747cc2594cf403'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:38.285828 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3549a690-9dde-487d-90e3-4ad2e63c4c25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb87a19267864015b1747cc2594cf403'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:38.286495 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3549a690-9dde-487d-90e3-4ad2e63c4c25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb87a19267864015b1747cc2594cf403'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:38.377805 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3549a690-9dde-487d-90e3-4ad2e63c4c25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb87a19267864015b1747cc2594cf403'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:38.383634 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:38.385551 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-3549a690-9dde-487d-90e3-4ad2e63c4c25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb87a19267864015b1747cc2594cf403'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:38.392013 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1428/2878] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:18:38 2022] DELETE /identity/v3/users/bb87a19267864015b1747cc2594cf403 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:38.817254 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f569be-9891-465e-8d17-240c6890cc87 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:38.818806 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-49f569be-9891-465e-8d17-240c6890cc87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:38.837313 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f569be-9891-465e-8d17-240c6890cc87 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:38.892742 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef950026-24fa-4938-b109-ffdce8cf74ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:38.893357 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef950026-24fa-4938-b109-ffdce8cf74ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:38.893633 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef950026-24fa-4938-b109-ffdce8cf74ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:38.893903 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef950026-24fa-4938-b109-ffdce8cf74ce admin admin] PATH_INFO: `/v3/projects/be6786a6ad054e05bfd3af764842b50f` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:38.895034 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef950026-24fa-4938-b109-ffdce8cf74ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=be6786a6ad054e05bfd3af764842b50f)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:38.896970 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef950026-24fa-4938-b109-ffdce8cf74ce admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:38.996712 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ef950026-24fa-4938-b109-ffdce8cf74ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be6786a6ad054e05bfd3af764842b50f', 'request_id': 'req-ef950026-24fa-4938-b109-ffdce8cf74ce'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:39.002606 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ef950026-24fa-4938-b109-ffdce8cf74ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be6786a6ad054e05bfd3af764842b50f', 'request_id': 'req-ef950026-24fa-4938-b109-ffdce8cf74ce'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:39.095211 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ef950026-24fa-4938-b109-ffdce8cf74ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be6786a6ad054e05bfd3af764842b50f', 'request_id': 'req-ef950026-24fa-4938-b109-ffdce8cf74ce'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:39.106966 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ef950026-24fa-4938-b109-ffdce8cf74ce admin admin] The token cache is being invalidate because project be6786a6ad054e05bfd3af764842b50f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:18:39.107343 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ef950026-24fa-4938-b109-ffdce8cf74ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:39.107955 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-ef950026-24fa-4938-b109-ffdce8cf74ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:39.110226 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1451/2879] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:18:38 2022] DELETE /identity/v3/projects/be6786a6ad054e05bfd3af764842b50f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:39.115933 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e7841-31b4-458f-b406-749a1029c445 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:39.116440 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e7841-31b4-458f-b406-749a1029c445 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:39.116554 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e7841-31b4-458f-b406-749a1029c445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:39.136866 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-390e7841-31b4-458f-b406-749a1029c445 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:18:39.139223 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-390e7841-31b4-458f-b406-749a1029c445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:39.197542 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1429/2880] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:18:39.205422 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f2183-d904-44ea-b4db-65e5d90654b4 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:39.205701 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f2183-d904-44ea-b4db-65e5d90654b4 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:39.205995 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f2183-d904-44ea-b4db-65e5d90654b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:39.226010 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-509f2183-d904-44ea-b4db-65e5d90654b4 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:18:39.227265 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-509f2183-d904-44ea-b4db-65e5d90654b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:39.236123 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1452/2881] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:18:39.240659 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e7841-31b4-458f-b406-749a1029c445 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:39.251024 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e7841-31b4-458f-b406-749a1029c445 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:39.255916 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e05ee2-8b4e-4a6c-9eed-b045b2341814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:39.259706 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e05ee2-8b4e-4a6c-9eed-b045b2341814 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:39.259706 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e05ee2-8b4e-4a6c-9eed-b045b2341814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:39.259706 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e05ee2-8b4e-4a6c-9eed-b045b2341814 admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:39.259706 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e05ee2-8b4e-4a6c-9eed-b045b2341814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:18:39.259706 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e05ee2-8b4e-4a6c-9eed-b045b2341814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:39.259706 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e05ee2-8b4e-4a6c-9eed-b045b2341814 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:39.271470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1430/2882] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:18:39.275892 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f2183-d904-44ea-b4db-65e5d90654b4 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:39.285406 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f2183-d904-44ea-b4db-65e5d90654b4 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:39.290040 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478e824-1533-4cf9-a905-c60399428e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:39.290626 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478e824-1533-4cf9-a905-c60399428e5b admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:39.290940 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478e824-1533-4cf9-a905-c60399428e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:39.291212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478e824-1533-4cf9-a905-c60399428e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:39.291826 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478e824-1533-4cf9-a905-c60399428e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:39.293705 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478e824-1533-4cf9-a905-c60399428e5b admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:39.305171 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:39.361904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1453/2883] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:18:39 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 11 11:18:39.366927 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e05ee2-8b4e-4a6c-9eed-b045b2341814 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:39.378968 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e05ee2-8b4e-4a6c-9eed-b045b2341814 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:39.436087 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d86db5-13ab-4f22-86cf-9ab3ba1f0de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:39.436827 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d86db5-13ab-4f22-86cf-9ab3ba1f0de7 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:39.437123 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d86db5-13ab-4f22-86cf-9ab3ba1f0de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:39.437582 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d86db5-13ab-4f22-86cf-9ab3ba1f0de7 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:39.438229 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d86db5-13ab-4f22-86cf-9ab3ba1f0de7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:39.440173 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d86db5-13ab-4f22-86cf-9ab3ba1f0de7 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:39.528962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1431/2884] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:18:39 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:18:39.533667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478e824-1533-4cf9-a905-c60399428e5b admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:39.544254 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478e824-1533-4cf9-a905-c60399428e5b admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:39.549159 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646274d0-b1c6-4cf6-baec-62575f165237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:39.549757 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646274d0-b1c6-4cf6-baec-62575f165237 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:39.550038 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646274d0-b1c6-4cf6-baec-62575f165237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:39.550314 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646274d0-b1c6-4cf6-baec-62575f165237 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:39.550986 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646274d0-b1c6-4cf6-baec-62575f165237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:39.552584 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646274d0-b1c6-4cf6-baec-62575f165237 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:39.562543 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1454/2885] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:18:39.566587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d86db5-13ab-4f22-86cf-9ab3ba1f0de7 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:39.576392 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d86db5-13ab-4f22-86cf-9ab3ba1f0de7 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:39.581560 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c87be9-cd03-4969-b599-01319762e473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:39.582144 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c87be9-cd03-4969-b599-01319762e473 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:39.582426 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c87be9-cd03-4969-b599-01319762e473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:39.582702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c87be9-cd03-4969-b599-01319762e473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:39.583365 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c87be9-cd03-4969-b599-01319762e473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:39.584942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c87be9-cd03-4969-b599-01319762e473 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:39.596297 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1432/2886] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:18:39.600323 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646274d0-b1c6-4cf6-baec-62575f165237 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:39.610385 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646274d0-b1c6-4cf6-baec-62575f165237 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:39.615084 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd8bcd-bc91-40d0-a926-0f8c99099a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:39.615662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd8bcd-bc91-40d0-a926-0f8c99099a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:39.615941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd8bcd-bc91-40d0-a926-0f8c99099a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:39.616214 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd8bcd-bc91-40d0-a926-0f8c99099a74 admin admin] PATH_INFO: `/v3/projects/cbffa074e1b34278bdca803b26113b10/users/893b144f33404b1dbd197ae31ed502b5/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:39.631654 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd8bcd-bc91-40d0-a926-0f8c99099a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbffa074e1b34278bdca803b26113b10, user_id=893b144f33404b1dbd197ae31ed502b5, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:39.634259 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd8bcd-bc91-40d0-a926-0f8c99099a74 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:39.726357 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1455/2887] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:18:39 2022] PUT /identity/v3/projects/cbffa074e1b34278bdca803b26113b10/users/893b144f33404b1dbd197ae31ed502b5/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:39.737924 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f312cc-7e76-4942-9fb3-d9485c150c98 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:39.738218 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f312cc-7e76-4942-9fb3-d9485c150c98 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:39.738496 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f312cc-7e76-4942-9fb3-d9485c150c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:39.766129 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-89f312cc-7e76-4942-9fb3-d9485c150c98 None None] MFA Rules not processed for user `893b144f33404b1dbd197ae31ed502b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:18:39.767387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-89f312cc-7e76-4942-9fb3-d9485c150c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:39.813535 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:39.830281 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1433/2888] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:18:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:18:39.834697 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd8bcd-bc91-40d0-a926-0f8c99099a74 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:39.896097 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd8bcd-bc91-40d0-a926-0f8c99099a74 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:39.900855 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c42d3-08fa-40ef-b602-d533161919e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:39.901461 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c42d3-08fa-40ef-b602-d533161919e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:39.901746 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c42d3-08fa-40ef-b602-d533161919e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:39.902024 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c42d3-08fa-40ef-b602-d533161919e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:39.902662 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c42d3-08fa-40ef-b602-d533161919e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:39.904602 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c42d3-08fa-40ef-b602-d533161919e1 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:39.987312 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1456/2889] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:18:39 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:18:39.991389 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f312cc-7e76-4942-9fb3-d9485c150c98 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:40.003098 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f312cc-7e76-4942-9fb3-d9485c150c98 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:40.064940 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb379908-0aa1-4c06-a080-6694c22b1b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:40.065570 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb379908-0aa1-4c06-a080-6694c22b1b13 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:40.065836 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb379908-0aa1-4c06-a080-6694c22b1b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:40.066110 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb379908-0aa1-4c06-a080-6694c22b1b13 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:40.066720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb379908-0aa1-4c06-a080-6694c22b1b13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:40.068674 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb379908-0aa1-4c06-a080-6694c22b1b13 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:40.157566 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1434/2890] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:18:39 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:18:40.161285 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c42d3-08fa-40ef-b602-d533161919e1 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:40.171856 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c42d3-08fa-40ef-b602-d533161919e1 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:40.176535 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7880e52-bc79-46a2-9804-ef8ee3025e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:40.177120 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7880e52-bc79-46a2-9804-ef8ee3025e16 admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:40.177397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7880e52-bc79-46a2-9804-ef8ee3025e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:40.177667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7880e52-bc79-46a2-9804-ef8ee3025e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:40.178301 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7880e52-bc79-46a2-9804-ef8ee3025e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:40.179910 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7880e52-bc79-46a2-9804-ef8ee3025e16 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:40.190960 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1457/2891] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:18:40.195036 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb379908-0aa1-4c06-a080-6694c22b1b13 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:40.205624 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb379908-0aa1-4c06-a080-6694c22b1b13 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:40.210610 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566fc02-da20-458c-8557-8a9d399eb528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:40.211305 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566fc02-da20-458c-8557-8a9d399eb528 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:40.211591 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566fc02-da20-458c-8557-8a9d399eb528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:40.211869 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566fc02-da20-458c-8557-8a9d399eb528 admin admin] PATH_INFO: `/v3/projects/e7fb63ba4fd64678b9e80eda93775958/users/c82d3961efc94bb39aa02b98a046c5dc/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:40.227224 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566fc02-da20-458c-8557-8a9d399eb528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7fb63ba4fd64678b9e80eda93775958, user_id=c82d3961efc94bb39aa02b98a046c5dc, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:40.229876 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c566fc02-da20-458c-8557-8a9d399eb528 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:40.323254 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1435/2892] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:18:40 2022] PUT /identity/v3/projects/e7fb63ba4fd64678b9e80eda93775958/users/c82d3961efc94bb39aa02b98a046c5dc/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:40.327309 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7880e52-bc79-46a2-9804-ef8ee3025e16 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:40.337511 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7880e52-bc79-46a2-9804-ef8ee3025e16 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:40.393899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbf385-a195-4aab-9842-ce68695255ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:40.394531 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbf385-a195-4aab-9842-ce68695255ca admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:40.394908 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbf385-a195-4aab-9842-ce68695255ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:40.395187 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbf385-a195-4aab-9842-ce68695255ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:40.395845 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbf385-a195-4aab-9842-ce68695255ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:40.397423 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbf385-a195-4aab-9842-ce68695255ca admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:40.407121 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1458/2893] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:18:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:18:40.411542 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566fc02-da20-458c-8557-8a9d399eb528 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:40.422336 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566fc02-da20-458c-8557-8a9d399eb528 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:40.426942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0ec61-cd1a-4c3c-be29-32784ba0dcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:40.427586 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0ec61-cd1a-4c3c-be29-32784ba0dcc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:40.427868 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0ec61-cd1a-4c3c-be29-32784ba0dcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:40.428142 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0ec61-cd1a-4c3c-be29-32784ba0dcc3 admin admin] PATH_INFO: `/v3/projects/e7fb63ba4fd64678b9e80eda93775958/users/c82d3961efc94bb39aa02b98a046c5dc/roles/00c6de5dd6cd4267ba05941ddb91e6ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:40.430217 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0ec61-cd1a-4c3c-be29-32784ba0dcc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7fb63ba4fd64678b9e80eda93775958, user_id=c82d3961efc94bb39aa02b98a046c5dc, role_id=00c6de5dd6cd4267ba05941ddb91e6ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:40.432900 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0ec61-cd1a-4c3c-be29-32784ba0dcc3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:40.443552 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1436/2894] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:18:40 2022] PUT /identity/v3/projects/e7fb63ba4fd64678b9e80eda93775958/users/c82d3961efc94bb39aa02b98a046c5dc/roles/00c6de5dd6cd4267ba05941ddb91e6ad => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:40.453874 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebcacb-1d14-459d-a6aa-fe8cc6ae1b4f None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:40.454168 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebcacb-1d14-459d-a6aa-fe8cc6ae1b4f None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:40.454451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebcacb-1d14-459d-a6aa-fe8cc6ae1b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:40.481300 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-f6ebcacb-1d14-459d-a6aa-fe8cc6ae1b4f None None] MFA Rules not processed for user `c82d3961efc94bb39aa02b98a046c5dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:18:40.482502 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-f6ebcacb-1d14-459d-a6aa-fe8cc6ae1b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:40.495409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:40.550926 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1459/2895] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:18:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:18:40.561655 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0ec61-cd1a-4c3c-be29-32784ba0dcc3 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:40.563456 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b6a0ec61-cd1a-4c3c-be29-32784ba0dcc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:40.622015 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0ec61-cd1a-4c3c-be29-32784ba0dcc3 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:40.625783 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21b910-35cc-428b-ab0d-c6c69969e353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:40.626383 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21b910-35cc-428b-ab0d-c6c69969e353 service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:40.626660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21b910-35cc-428b-ab0d-c6c69969e353 service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:40.626962 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21b910-35cc-428b-ab0d-c6c69969e353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:40.683875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21b910-35cc-428b-ab0d-c6c69969e353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:40.685248 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21b910-35cc-428b-ab0d-c6c69969e353 service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:40.688908 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:40.694786 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1437/2896] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:18:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:18:47.167768 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebcacb-1d14-459d-a6aa-fe8cc6ae1b4f None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:47.178014 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebcacb-1d14-459d-a6aa-fe8cc6ae1b4f None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:47.181608 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1828de75-d757-44a2-ba24-a0292ed793c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:47.182229 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828de75-d757-44a2-ba24-a0292ed793c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:47.182507 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828de75-d757-44a2-ba24-a0292ed793c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:47.182804 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1828de75-d757-44a2-ba24-a0292ed793c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:47.192249 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828de75-d757-44a2-ba24-a0292ed793c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:47.193762 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1828de75-d757-44a2-ba24-a0292ed793c5 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:47.203231 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1460/2897] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:18:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:18:50.739889 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:53.102449 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21b910-35cc-428b-ab0d-c6c69969e353 service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:53.175867 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21b910-35cc-428b-ab0d-c6c69969e353 service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:53.180730 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642f1e3-375f-406f-be82-c067267c1da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:53.181371 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642f1e3-375f-406f-be82-c067267c1da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:53.181655 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642f1e3-375f-406f-be82-c067267c1da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:53.181931 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642f1e3-375f-406f-be82-c067267c1da8 admin admin] PATH_INFO: `/v3/users/893b144f33404b1dbd197ae31ed502b5` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:53.183096 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642f1e3-375f-406f-be82-c067267c1da8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=893b144f33404b1dbd197ae31ed502b5)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:53.185044 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642f1e3-375f-406f-be82-c067267c1da8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:53.397043 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2642f1e3-375f-406f-be82-c067267c1da8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '893b144f33404b1dbd197ae31ed502b5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:53.412051 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2642f1e3-375f-406f-be82-c067267c1da8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '893b144f33404b1dbd197ae31ed502b5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:53.421792 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2642f1e3-375f-406f-be82-c067267c1da8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '893b144f33404b1dbd197ae31ed502b5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:53.495210 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2642f1e3-375f-406f-be82-c067267c1da8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '893b144f33404b1dbd197ae31ed502b5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:53.503320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-2642f1e3-375f-406f-be82-c067267c1da8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '893b144f33404b1dbd197ae31ed502b5'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:53.516823 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1438/2898] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:18:53 2022] DELETE /identity/v3/users/893b144f33404b1dbd197ae31ed502b5 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:53.521549 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17974182-604b-4bd9-97bc-7f90fcba2bcf None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:53.522018 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17974182-604b-4bd9-97bc-7f90fcba2bcf None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:53.522116 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17974182-604b-4bd9-97bc-7f90fcba2bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:53.541189 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-17974182-604b-4bd9-97bc-7f90fcba2bcf None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:18:53.542386 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-17974182-604b-4bd9-97bc-7f90fcba2bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:53.599783 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1461/2899] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:18:53.610022 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642f1e3-375f-406f-be82-c067267c1da8 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:53.611522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2642f1e3-375f-406f-be82-c067267c1da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:53.668541 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642f1e3-375f-406f-be82-c067267c1da8 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:53.672716 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2fb79-4dc2-4861-b196-e1b1e6cac18e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:53.673317 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2fb79-4dc2-4861-b196-e1b1e6cac18e service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:53.673595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2fb79-4dc2-4861-b196-e1b1e6cac18e service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:53.673863 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2fb79-4dc2-4861-b196-e1b1e6cac18e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:53.682768 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2fb79-4dc2-4861-b196-e1b1e6cac18e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:53.684274 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d2fb79-4dc2-4861-b196-e1b1e6cac18e service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:53.693746 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1439/2900] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:18:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:18:54.093804 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17974182-604b-4bd9-97bc-7f90fcba2bcf None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:54.095332 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-17974182-604b-4bd9-97bc-7f90fcba2bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:54.107836 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17974182-604b-4bd9-97bc-7f90fcba2bcf None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:54.112904 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6729e94-e06c-4ac3-97f5-f576106b64b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:54.114628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6729e94-e06c-4ac3-97f5-f576106b64b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:54.114628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6729e94-e06c-4ac3-97f5-f576106b64b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:54.114628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6729e94-e06c-4ac3-97f5-f576106b64b3 admin admin] PATH_INFO: `/v3/projects/cbffa074e1b34278bdca803b26113b10` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:54.115644 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6729e94-e06c-4ac3-97f5-f576106b64b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbffa074e1b34278bdca803b26113b10)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:54.117664 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6729e94-e06c-4ac3-97f5-f576106b64b3 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:54.219376 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d6729e94-e06c-4ac3-97f5-f576106b64b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbffa074e1b34278bdca803b26113b10', 'request_id': 'req-d6729e94-e06c-4ac3-97f5-f576106b64b3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:54.225062 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d6729e94-e06c-4ac3-97f5-f576106b64b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbffa074e1b34278bdca803b26113b10', 'request_id': 'req-d6729e94-e06c-4ac3-97f5-f576106b64b3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:54.323212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d6729e94-e06c-4ac3-97f5-f576106b64b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbffa074e1b34278bdca803b26113b10', 'request_id': 'req-d6729e94-e06c-4ac3-97f5-f576106b64b3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:54.335628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d6729e94-e06c-4ac3-97f5-f576106b64b3 admin admin] The token cache is being invalidate because project cbffa074e1b34278bdca803b26113b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:18:54.335922 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d6729e94-e06c-4ac3-97f5-f576106b64b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:54.336582 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-d6729e94-e06c-4ac3-97f5-f576106b64b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:54.338106 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1462/2901] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:18:54 2022] DELETE /identity/v3/projects/cbffa074e1b34278bdca803b26113b10 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:54.342075 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2fb79-4dc2-4861-b196-e1b1e6cac18e service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:54.351978 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2fb79-4dc2-4861-b196-e1b1e6cac18e service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:54.370815 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:54.409406 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36e555-5bc1-4bff-86bc-56f595111e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:54.410032 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36e555-5bc1-4bff-86bc-56f595111e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:54.410320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36e555-5bc1-4bff-86bc-56f595111e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:54.410595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36e555-5bc1-4bff-86bc-56f595111e51 admin admin] PATH_INFO: `/v3/users/c82d3961efc94bb39aa02b98a046c5dc` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:54.411741 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36e555-5bc1-4bff-86bc-56f595111e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c82d3961efc94bb39aa02b98a046c5dc)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:54.413742 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36e555-5bc1-4bff-86bc-56f595111e51 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:54.719538 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7b36e555-5bc1-4bff-86bc-56f595111e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c82d3961efc94bb39aa02b98a046c5dc'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:54.731533 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7b36e555-5bc1-4bff-86bc-56f595111e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c82d3961efc94bb39aa02b98a046c5dc'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:54.732206 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7b36e555-5bc1-4bff-86bc-56f595111e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c82d3961efc94bb39aa02b98a046c5dc'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:54.838842 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7b36e555-5bc1-4bff-86bc-56f595111e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c82d3961efc94bb39aa02b98a046c5dc'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:54.849154 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-7b36e555-5bc1-4bff-86bc-56f595111e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c82d3961efc94bb39aa02b98a046c5dc'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:54.855076 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1440/2902] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:18:54 2022] DELETE /identity/v3/users/c82d3961efc94bb39aa02b98a046c5dc => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:55.274284 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6729e94-e06c-4ac3-97f5-f576106b64b3 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:55.277676 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-d6729e94-e06c-4ac3-97f5-f576106b64b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:55.291488 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6729e94-e06c-4ac3-97f5-f576106b64b3 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:55.311808 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:55.349718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e191f-b2bc-4643-bfac-d00619c695c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:55.350355 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e191f-b2bc-4643-bfac-d00619c695c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:55.350685 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e191f-b2bc-4643-bfac-d00619c695c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:55.350993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e191f-b2bc-4643-bfac-d00619c695c7 admin admin] PATH_INFO: `/v3/projects/e7fb63ba4fd64678b9e80eda93775958` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:55.352441 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e191f-b2bc-4643-bfac-d00619c695c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7fb63ba4fd64678b9e80eda93775958)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:55.354822 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e191f-b2bc-4643-bfac-d00619c695c7 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:55.463558 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f61e191f-b2bc-4643-bfac-d00619c695c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7fb63ba4fd64678b9e80eda93775958', 'request_id': 'req-f61e191f-b2bc-4643-bfac-d00619c695c7'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:55.468878 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f61e191f-b2bc-4643-bfac-d00619c695c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7fb63ba4fd64678b9e80eda93775958', 'request_id': 'req-f61e191f-b2bc-4643-bfac-d00619c695c7'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:55.574659 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f61e191f-b2bc-4643-bfac-d00619c695c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7fb63ba4fd64678b9e80eda93775958', 'request_id': 'req-f61e191f-b2bc-4643-bfac-d00619c695c7'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:55.586959 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f61e191f-b2bc-4643-bfac-d00619c695c7 admin admin] The token cache is being invalidate because project e7fb63ba4fd64678b9e80eda93775958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:18:55.587248 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f61e191f-b2bc-4643-bfac-d00619c695c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:55.587872 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-f61e191f-b2bc-4643-bfac-d00619c695c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:55.589329 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1463/2903] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:18:55 2022] DELETE /identity/v3/projects/e7fb63ba4fd64678b9e80eda93775958 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:55.596059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955e3f6-bce7-4f06-98af-0c7d2b54d90a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:55.596714 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955e3f6-bce7-4f06-98af-0c7d2b54d90a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:55.597038 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955e3f6-bce7-4f06-98af-0c7d2b54d90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:55.624476 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4955e3f6-bce7-4f06-98af-0c7d2b54d90a None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:18:55.626337 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4955e3f6-bce7-4f06-98af-0c7d2b54d90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:55.684379 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1441/2904] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:18:55.693161 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dfa6a-f8e9-4291-a74a-d3a9760c26b0 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:55.693445 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dfa6a-f8e9-4291-a74a-d3a9760c26b0 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:55.693717 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59dfa6a-f8e9-4291-a74a-d3a9760c26b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:55.714467 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-a59dfa6a-f8e9-4291-a74a-d3a9760c26b0 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:18:55.715686 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a59dfa6a-f8e9-4291-a74a-d3a9760c26b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:55.723612 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1464/2905] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:18:55.727638 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955e3f6-bce7-4f06-98af-0c7d2b54d90a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:55.737095 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955e3f6-bce7-4f06-98af-0c7d2b54d90a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:55.741567 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc9c76-48c4-4f1c-bada-8acee938e74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:55.742155 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc9c76-48c4-4f1c-bada-8acee938e74c admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:55.742433 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc9c76-48c4-4f1c-bada-8acee938e74c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:55.742704 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc9c76-48c4-4f1c-bada-8acee938e74c admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:55.743397 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc9c76-48c4-4f1c-bada-8acee938e74c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 11 11:18:55.743677 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc9c76-48c4-4f1c-bada-8acee938e74c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:55.745255 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc9c76-48c4-4f1c-bada-8acee938e74c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:55.757286 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1442/2906] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Aug 11 11:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 11 11:18:55.761536 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59dfa6a-f8e9-4291-a74a-d3a9760c26b0 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:55.771391 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59dfa6a-f8e9-4291-a74a-d3a9760c26b0 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:55.775949 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8340a6c-a647-43fc-b99f-78431f872e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:55.776533 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8340a6c-a647-43fc-b99f-78431f872e12 admin admin] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:55.776806 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8340a6c-a647-43fc-b99f-78431f872e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:55.777072 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8340a6c-a647-43fc-b99f-78431f872e12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:55.777692 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8340a6c-a647-43fc-b99f-78431f872e12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:55.779610 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8340a6c-a647-43fc-b99f-78431f872e12 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:55.861966 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1465/2907] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Aug 11 11:18:55 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:18:55.866198 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc9c76-48c4-4f1c-bada-8acee938e74c admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:55.877135 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc9c76-48c4-4f1c-bada-8acee938e74c admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:55.903948 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:55.934804 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05748a31-ec96-4117-a1e4-147023043c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:55.935415 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05748a31-ec96-4117-a1e4-147023043c38 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:55.935698 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05748a31-ec96-4117-a1e4-147023043c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:55.935973 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05748a31-ec96-4117-a1e4-147023043c38 admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:55.936588 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05748a31-ec96-4117-a1e4-147023043c38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:55.939349 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05748a31-ec96-4117-a1e4-147023043c38 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:56.072553 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1443/2908] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Aug 11 11:18:55 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 11 11:18:56.076694 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8340a6c-a647-43fc-b99f-78431f872e12 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:56.087540 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8340a6c-a647-43fc-b99f-78431f872e12 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:56.092074 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab64a0d-1448-4245-922b-3438b3bfcd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:56.092667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab64a0d-1448-4245-922b-3438b3bfcd0e admin admin] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:56.092951 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab64a0d-1448-4245-922b-3438b3bfcd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:56.093227 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab64a0d-1448-4245-922b-3438b3bfcd0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:56.093871 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab64a0d-1448-4245-922b-3438b3bfcd0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:56.095546 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab64a0d-1448-4245-922b-3438b3bfcd0e admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:56.106373 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1466/2909] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:18:56.110660 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05748a31-ec96-4117-a1e4-147023043c38 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:56.121579 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05748a31-ec96-4117-a1e4-147023043c38 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:56.126175 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc8cc7-24fd-484b-bd0c-b0307ce6395e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:56.127527 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc8cc7-24fd-484b-bd0c-b0307ce6395e admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:56.127835 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc8cc7-24fd-484b-bd0c-b0307ce6395e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:56.128145 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc8cc7-24fd-484b-bd0c-b0307ce6395e admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:56.128775 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc8cc7-24fd-484b-bd0c-b0307ce6395e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:56.130614 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc8cc7-24fd-484b-bd0c-b0307ce6395e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:56.140619 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1444/2910] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Aug 11 11:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 11 11:18:56.144858 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab64a0d-1448-4245-922b-3438b3bfcd0e admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:56.154953 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab64a0d-1448-4245-922b-3438b3bfcd0e admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:56.159661 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d6e7c-badd-4ba1-8e7e-743bfc472c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:56.160301 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d6e7c-badd-4ba1-8e7e-743bfc472c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:56.160575 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d6e7c-badd-4ba1-8e7e-743bfc472c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:56.160848 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d6e7c-badd-4ba1-8e7e-743bfc472c7a admin admin] PATH_INFO: `/v3/projects/938ef532880a435699dc4c81d757600a/users/e85d6acffe684b8ca6dc330f60b985bf/roles/ea851d0cf29e44a1884d7c23431a7481` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:56.175797 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d6e7c-badd-4ba1-8e7e-743bfc472c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=938ef532880a435699dc4c81d757600a, user_id=e85d6acffe684b8ca6dc330f60b985bf, role_id=ea851d0cf29e44a1884d7c23431a7481)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:56.178424 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d6e7c-badd-4ba1-8e7e-743bfc472c7a admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:56.275397 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1467/2911] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Aug 11 11:18:56 2022] PUT /identity/v3/projects/938ef532880a435699dc4c81d757600a/users/e85d6acffe684b8ca6dc330f60b985bf/roles/ea851d0cf29e44a1884d7c23431a7481 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:56.295275 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55c366-17a7-4b42-a4f9-b9dfeee3a695 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:56.295572 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55c366-17a7-4b42-a4f9-b9dfeee3a695 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:56.295875 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55c366-17a7-4b42-a4f9-b9dfeee3a695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:56.325103 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5d55c366-17a7-4b42-a4f9-b9dfeee3a695 None None] MFA Rules not processed for user `e85d6acffe684b8ca6dc330f60b985bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:18:56.326325 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5d55c366-17a7-4b42-a4f9-b9dfeee3a695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:56.389609 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1445/2912] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:18:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:18:56.400936 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d6e7c-badd-4ba1-8e7e-743bfc472c7a admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:56.402807 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-a14d6e7c-badd-4ba1-8e7e-743bfc472c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:56.454887 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:56.458545 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d6e7c-badd-4ba1-8e7e-743bfc472c7a admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:56.462876 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902a0f1-1839-45a0-a968-dcb11b35f561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85551eadb87f496f882c4d6e984144c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:56.467716 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902a0f1-1839-45a0-a968-dcb11b35f561 service cinder] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:56.467716 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902a0f1-1839-45a0-a968-dcb11b35f561 service cinder] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:56.467716 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902a0f1-1839-45a0-a968-dcb11b35f561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:56.472660 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902a0f1-1839-45a0-a968-dcb11b35f561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:56.474242 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902a0f1-1839-45a0-a968-dcb11b35f561 service cinder] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:56.482780 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1468/2913] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:18:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:18:56.503708 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55c366-17a7-4b42-a4f9-b9dfeee3a695 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:56.565002 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55c366-17a7-4b42-a4f9-b9dfeee3a695 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:56.569791 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540eeda-6f96-4319-8628-e4b63405e378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:56.570411 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540eeda-6f96-4319-8628-e4b63405e378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:56.570693 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540eeda-6f96-4319-8628-e4b63405e378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:56.570995 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540eeda-6f96-4319-8628-e4b63405e378 admin admin] PATH_INFO: `/v3/users/e85d6acffe684b8ca6dc330f60b985bf` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:56.572119 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540eeda-6f96-4319-8628-e4b63405e378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e85d6acffe684b8ca6dc330f60b985bf)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:56.574035 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540eeda-6f96-4319-8628-e4b63405e378 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:56.763522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:18:56.769924 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e540eeda-6f96-4319-8628-e4b63405e378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e85d6acffe684b8ca6dc330f60b985bf'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:56.781786 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e540eeda-6f96-4319-8628-e4b63405e378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e85d6acffe684b8ca6dc330f60b985bf'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:56.782678 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e540eeda-6f96-4319-8628-e4b63405e378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e85d6acffe684b8ca6dc330f60b985bf'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:56.874955 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e540eeda-6f96-4319-8628-e4b63405e378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e85d6acffe684b8ca6dc330f60b985bf'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:56.882545 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-e540eeda-6f96-4319-8628-e4b63405e378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e85d6acffe684b8ca6dc330f60b985bf'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:56.888728 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1446/2914] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:18:56 2022] DELETE /identity/v3/users/e85d6acffe684b8ca6dc330f60b985bf => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:18:56.893238 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492118a-c43d-4a30-90ce-2e2752472706 None None] REQUEST_METHOD: `POST` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:56.893542 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492118a-c43d-4a30-90ce-2e2752472706 None None] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:56.893815 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492118a-c43d-4a30-90ce-2e2752472706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:56.913993 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.auth.core [None req-4492118a-c43d-4a30-90ce-2e2752472706 None None] MFA Rules not processed for user `94631e4d22874dba849ec3d0cdff5210`. Rule list: `[]` (Enabled: `True`). {{(pid=81639) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 11 11:18:56.915234 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4492118a-c43d-4a30-90ce-2e2752472706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:56.973024 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1469/2915] 10.222.0.43 () {58 vars in 958 bytes} [Thu Aug 11 11:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 11 11:18:56.982653 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540eeda-6f96-4319-8628-e4b63405e378 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:56.984131 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e540eeda-6f96-4319-8628-e4b63405e378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:57.041270 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540eeda-6f96-4319-8628-e4b63405e378 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:57.044947 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082f5e7-1811-4535-8b17-a173937b0e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:57.045528 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082f5e7-1811-4535-8b17-a173937b0e32 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:57.045808 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082f5e7-1811-4535-8b17-a173937b0e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:57.046080 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082f5e7-1811-4535-8b17-a173937b0e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:57.055447 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082f5e7-1811-4535-8b17-a173937b0e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:57.056874 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082f5e7-1811-4535-8b17-a173937b0e32 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:57.066261 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1447/2916] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:18:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 11 11:18:57.468212 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492118a-c43d-4a30-90ce-2e2752472706 None None] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:18:57.469677 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-4492118a-c43d-4a30-90ce-2e2752472706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:18:57.482115 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4492118a-c43d-4a30-90ce-2e2752472706 None None] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:18:57.487144 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b4590-2f68-48cf-bf46-231f044f8fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:18:57.487811 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b4590-2f68-48cf-bf46-231f044f8fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:18:57.488553 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b4590-2f68-48cf-bf46-231f044f8fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:18:57.488835 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b4590-2f68-48cf-bf46-231f044f8fa3 admin admin] PATH_INFO: `/v3/projects/938ef532880a435699dc4c81d757600a` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:18:57.490739 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b4590-2f68-48cf-bf46-231f044f8fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=938ef532880a435699dc4c81d757600a)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:18:57.492831 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b4590-2f68-48cf-bf46-231f044f8fa3 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:18:57.594785 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-704b4590-2f68-48cf-bf46-231f044f8fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938ef532880a435699dc4c81d757600a', 'request_id': 'req-704b4590-2f68-48cf-bf46-231f044f8fa3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:57.600900 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-704b4590-2f68-48cf-bf46-231f044f8fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938ef532880a435699dc4c81d757600a', 'request_id': 'req-704b4590-2f68-48cf-bf46-231f044f8fa3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:57.663670 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-704b4590-2f68-48cf-bf46-231f044f8fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938ef532880a435699dc4c81d757600a', 'request_id': 'req-704b4590-2f68-48cf-bf46-231f044f8fa3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:57.674962 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-704b4590-2f68-48cf-bf46-231f044f8fa3 admin admin] The token cache is being invalidate because project 938ef532880a435699dc4c81d757600a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:18:57.678137 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-704b4590-2f68-48cf-bf46-231f044f8fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:57.678137 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-704b4590-2f68-48cf-bf46-231f044f8fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:18:57.678137 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1470/2917] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:18:57 2022] DELETE /identity/v3/projects/938ef532880a435699dc4c81d757600a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:19:07.062026 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:DELETE=5,keystone:SELECT=40,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:19:07.671933 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:20:07.185603 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082f5e7-1811-4535-8b17-a173937b0e32 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:20:07.194418 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082f5e7-1811-4535-8b17-a173937b0e32 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:20:07.242940 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722836d-62e9-4828-8a0d-62b22730ac84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:20:07.243696 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722836d-62e9-4828-8a0d-62b22730ac84 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:20:07.243982 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722836d-62e9-4828-8a0d-62b22730ac84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:20:07.244256 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722836d-62e9-4828-8a0d-62b22730ac84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:20:07.245995 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2722836d-62e9-4828-8a0d-62b22730ac84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:20:07.255556 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722836d-62e9-4828-8a0d-62b22730ac84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:20:07.257233 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722836d-62e9-4828-8a0d-62b22730ac84 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:20:07.265283 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1448/2918] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:20:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:20:17.261741 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=26 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:20:51.331787 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b4590-2f68-48cf-bf46-231f044f8fa3 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:20:51.333201 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-704b4590-2f68-48cf-bf46-231f044f8fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:20:51.400971 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b4590-2f68-48cf-bf46-231f044f8fa3 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:20:51.404994 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf0602-1478-4cea-b760-94b32be70230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:20:51.405634 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf0602-1478-4cea-b760-94b32be70230 service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:20:51.405915 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf0602-1478-4cea-b760-94b32be70230 service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:20:51.406188 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf0602-1478-4cea-b760-94b32be70230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:20:51.407953 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-bacf0602-1478-4cea-b760-94b32be70230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:20:51.496718 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf0602-1478-4cea-b760-94b32be70230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:20:51.498155 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf0602-1478-4cea-b760-94b32be70230 service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:20:51.509905 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1471/2919] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:20:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:20:52.691949 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722836d-62e9-4828-8a0d-62b22730ac84 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:20:52.693355 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2722836d-62e9-4828-8a0d-62b22730ac84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:20:52.754752 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722836d-62e9-4828-8a0d-62b22730ac84 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:20:52.758713 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73e5f5-73ee-43a2-9718-493a3319fd25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:20:52.759349 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73e5f5-73ee-43a2-9718-493a3319fd25 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:20:52.759635 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73e5f5-73ee-43a2-9718-493a3319fd25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:20:52.759910 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73e5f5-73ee-43a2-9718-493a3319fd25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:20:52.761688 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8a73e5f5-73ee-43a2-9718-493a3319fd25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:20:52.776153 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73e5f5-73ee-43a2-9718-493a3319fd25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:20:52.777579 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73e5f5-73ee-43a2-9718-493a3319fd25 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:20:52.789428 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1449/2920] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:20:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:21:01.504694 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=65 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:21:02.785288 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=28 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:21:05.182210 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf0602-1478-4cea-b760-94b32be70230 service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:21:05.191039 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf0602-1478-4cea-b760-94b32be70230 service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:21:05.195552 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46495b-0732-4ac9-8a77-9084078a2dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:21:05.196333 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46495b-0732-4ac9-8a77-9084078a2dfa service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:21:05.196615 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46495b-0732-4ac9-8a77-9084078a2dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:21:05.196888 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46495b-0732-4ac9-8a77-9084078a2dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:21:05.198652 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1f46495b-0732-4ac9-8a77-9084078a2dfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:21:05.209476 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46495b-0732-4ac9-8a77-9084078a2dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:21:05.210943 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46495b-0732-4ac9-8a77-9084078a2dfa service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:21:05.219746 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1472/2921] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:21:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:21:05.312040 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73e5f5-73ee-43a2-9718-493a3319fd25 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:21:05.321942 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73e5f5-73ee-43a2-9718-493a3319fd25 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:21:05.325620 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8719822-e3c6-4cd4-98e5-e8d30d9667ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:21:05.326216 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8719822-e3c6-4cd4-98e5-e8d30d9667ad service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:21:05.326492 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8719822-e3c6-4cd4-98e5-e8d30d9667ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:21:05.326810 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8719822-e3c6-4cd4-98e5-e8d30d9667ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:21:05.328502 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c8719822-e3c6-4cd4-98e5-e8d30d9667ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:21:05.342236 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8719822-e3c6-4cd4-98e5-e8d30d9667ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:21:05.343702 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8719822-e3c6-4cd4-98e5-e8d30d9667ad service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:21:05.354381 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1450/2922] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:21:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:21:05.414255 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46495b-0732-4ac9-8a77-9084078a2dfa service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:21:05.415688 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-1f46495b-0732-4ac9-8a77-9084078a2dfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:21:05.481886 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46495b-0732-4ac9-8a77-9084078a2dfa service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:21:05.486811 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54c0a9-e1a6-4cf1-a7ca-d89f6eab801f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db99589bb504e8fa4068925badf3942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:21:05.487398 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54c0a9-e1a6-4cf1-a7ca-d89f6eab801f service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:21:05.487667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54c0a9-e1a6-4cf1-a7ca-d89f6eab801f service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:21:05.487941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54c0a9-e1a6-4cf1-a7ca-d89f6eab801f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:21:05.490110 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6b54c0a9-e1a6-4cf1-a7ca-d89f6eab801f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:21:05.501027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54c0a9-e1a6-4cf1-a7ca-d89f6eab801f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:21:05.502580 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54c0a9-e1a6-4cf1-a7ca-d89f6eab801f service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:21:05.512986 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1473/2923] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:21:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:21:15.349703 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:21:15.508909 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=38 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:22:51.158512 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8719822-e3c6-4cd4-98e5-e8d30d9667ad service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:22:51.167217 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8719822-e3c6-4cd4-98e5-e8d30d9667ad service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:22:51.170803 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5a0d5-1a11-4189-9b93-236ddda979bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:22:51.171416 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5a0d5-1a11-4189-9b93-236ddda979bb service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:22:51.171695 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5a0d5-1a11-4189-9b93-236ddda979bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:22:51.171972 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5a0d5-1a11-4189-9b93-236ddda979bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:22:51.173657 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-97d5a0d5-1a11-4189-9b93-236ddda979bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:22:51.232063 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5a0d5-1a11-4189-9b93-236ddda979bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:22:51.233901 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5a0d5-1a11-4189-9b93-236ddda979bb service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:22:51.242858 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1451/2924] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:22:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:22:52.178935 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54c0a9-e1a6-4cf1-a7ca-d89f6eab801f service placement] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:22:52.180347 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-6b54c0a9-e1a6-4cf1-a7ca-d89f6eab801f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:22:52.231628 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54c0a9-e1a6-4cf1-a7ca-d89f6eab801f service placement] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:22:52.237745 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ce97a-c66a-4c51-9e58-e085accfce3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:22:52.238364 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ce97a-c66a-4c51-9e58-e085accfce3f service nova] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:22:52.238645 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ce97a-c66a-4c51-9e58-e085accfce3f service nova] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:22:52.238951 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ce97a-c66a-4c51-9e58-e085accfce3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:22:52.240743 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-8f7ce97a-c66a-4c51-9e58-e085accfce3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:22:52.254625 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ce97a-c66a-4c51-9e58-e085accfce3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:22:52.256243 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ce97a-c66a-4c51-9e58-e085accfce3f service nova] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:22:52.268408 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1474/2925] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:22:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:22:55.069184 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5a0d5-1a11-4189-9b93-236ddda979bb service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:22:55.070747 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-97d5a0d5-1a11-4189-9b93-236ddda979bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:22:55.086664 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5a0d5-1a11-4189-9b93-236ddda979bb service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:22:55.092131 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19a7f0-7f89-42a0-8e13-655279acd7c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9267752ac6724013bc1edcdecff48dd7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:22:55.092720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19a7f0-7f89-42a0-8e13-655279acd7c6 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:22:55.092998 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19a7f0-7f89-42a0-8e13-655279acd7c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:22:55.093272 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19a7f0-7f89-42a0-8e13-655279acd7c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:22:55.095595 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6c19a7f0-7f89-42a0-8e13-655279acd7c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:22:55.107476 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19a7f0-7f89-42a0-8e13-655279acd7c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:22:55.109047 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19a7f0-7f89-42a0-8e13-655279acd7c6 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:22:55.120173 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1452/2926] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:22:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:22:57.566460 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ce97a-c66a-4c51-9e58-e085accfce3f service nova] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:22:57.575793 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ce97a-c66a-4c51-9e58-e085accfce3f service nova] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:22:57.579556 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab2fb6-3754-44d9-b258-2cfb1a03d23a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6302b1f98544470a8986055a68bcd948', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:22:57.580147 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab2fb6-3754-44d9-b258-2cfb1a03d23a service neutron] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:22:57.580422 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab2fb6-3754-44d9-b258-2cfb1a03d23a service neutron] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:22:57.580690 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab2fb6-3754-44d9-b258-2cfb1a03d23a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:22:57.582417 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-9dab2fb6-3754-44d9-b258-2cfb1a03d23a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:22:57.669112 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab2fb6-3754-44d9-b258-2cfb1a03d23a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:22:57.670635 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab2fb6-3754-44d9-b258-2cfb1a03d23a service neutron] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:22:57.690742 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1475/2927] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:23:01.333467 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19a7f0-7f89-42a0-8e13-655279acd7c6 service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:23:01.334911 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6c19a7f0-7f89-42a0-8e13-655279acd7c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:23:01.371772 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19a7f0-7f89-42a0-8e13-655279acd7c6 service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:23:01.378057 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da76ee-db62-47fb-979b-cdd3f9a411fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db99589bb504e8fa4068925badf3942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:23:01.378669 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da76ee-db62-47fb-979b-cdd3f9a411fb service placement] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:23:01.392549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da76ee-db62-47fb-979b-cdd3f9a411fb service placement] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:23:01.392549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da76ee-db62-47fb-979b-cdd3f9a411fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:23:01.392549 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-44da76ee-db62-47fb-979b-cdd3f9a411fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:23:01.393587 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da76ee-db62-47fb-979b-cdd3f9a411fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:23:01.395188 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da76ee-db62-47fb-979b-cdd3f9a411fb service placement] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:23:01.405223 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1453/2928] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:23:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:23:04.752061 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab2fb6-3754-44d9-b258-2cfb1a03d23a service neutron] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:23:04.765274 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab2fb6-3754-44d9-b258-2cfb1a03d23a service neutron] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:23:04.770842 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d5315-70a2-41dc-b5f1-d3c42b45ebfb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db99589bb504e8fa4068925badf3942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:23:04.779257 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d5315-70a2-41dc-b5f1-d3c42b45ebfb service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:23:04.779257 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d5315-70a2-41dc-b5f1-d3c42b45ebfb service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:23:04.779257 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d5315-70a2-41dc-b5f1-d3c42b45ebfb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:23:04.779257 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-e70d5315-70a2-41dc-b5f1-d3c42b45ebfb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:23:04.786278 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d5315-70a2-41dc-b5f1-d3c42b45ebfb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:23:04.788206 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d5315-70a2-41dc-b5f1-d3c42b45ebfb service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:23:04.799509 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1476/2929] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:23:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:23:04.893574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da76ee-db62-47fb-979b-cdd3f9a411fb service placement] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:23:04.893574 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-44da76ee-db62-47fb-979b-cdd3f9a411fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:23:04.902033 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da76ee-db62-47fb-979b-cdd3f9a411fb service placement] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:23:04.907059 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a2fc3-c08f-498c-bbff-d56ba725b0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:23:04.907766 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a2fc3-c08f-498c-bbff-d56ba725b0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:23:04.908052 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a2fc3-c08f-498c-bbff-d56ba725b0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:23:04.908327 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a2fc3-c08f-498c-bbff-d56ba725b0a2 admin admin] PATH_INFO: `/v3/users/2aa12a300ae44ed192df3303d6f1e0a8` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:23:04.909444 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a2fc3-c08f-498c-bbff-d56ba725b0a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aa12a300ae44ed192df3303d6f1e0a8)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:23:04.911387 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a2fc3-c08f-498c-bbff-d56ba725b0a2 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:23:05.105344 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-da1a2fc3-c08f-498c-bbff-d56ba725b0a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aa12a300ae44ed192df3303d6f1e0a8'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:23:05.117680 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-da1a2fc3-c08f-498c-bbff-d56ba725b0a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aa12a300ae44ed192df3303d6f1e0a8'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:23:05.118338 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-da1a2fc3-c08f-498c-bbff-d56ba725b0a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aa12a300ae44ed192df3303d6f1e0a8'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:23:05.205122 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-da1a2fc3-c08f-498c-bbff-d56ba725b0a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aa12a300ae44ed192df3303d6f1e0a8'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:23:05.212294 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-da1a2fc3-c08f-498c-bbff-d56ba725b0a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aa12a300ae44ed192df3303d6f1e0a8'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:23:05.218198 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1454/2930] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:23:04 2022] DELETE /identity/v3/users/2aa12a300ae44ed192df3303d6f1e0a8 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:23:05.467840 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d5315-70a2-41dc-b5f1-d3c42b45ebfb service placement] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:23:05.479713 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d5315-70a2-41dc-b5f1-d3c42b45ebfb service placement] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:23:05.535374 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70589f86-f06f-499f-b983-260f9b160b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:23:05.535998 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70589f86-f06f-499f-b983-260f9b160b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:23:05.536276 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70589f86-f06f-499f-b983-260f9b160b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:23:05.536548 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70589f86-f06f-499f-b983-260f9b160b71 admin admin] PATH_INFO: `/v3/projects/a5ebe74aa39b4300b141256c250eec01` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:23:05.537667 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70589f86-f06f-499f-b983-260f9b160b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ebe74aa39b4300b141256c250eec01)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:23:05.539669 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70589f86-f06f-499f-b983-260f9b160b71 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:23:05.555568 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=100 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:23:05.652764 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-70589f86-f06f-499f-b983-260f9b160b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ebe74aa39b4300b141256c250eec01', 'request_id': 'req-70589f86-f06f-499f-b983-260f9b160b71'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:23:05.658286 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-70589f86-f06f-499f-b983-260f9b160b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ebe74aa39b4300b141256c250eec01', 'request_id': 'req-70589f86-f06f-499f-b983-260f9b160b71'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:23:05.725104 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-70589f86-f06f-499f-b983-260f9b160b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ebe74aa39b4300b141256c250eec01', 'request_id': 'req-70589f86-f06f-499f-b983-260f9b160b71'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:23:05.736752 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-70589f86-f06f-499f-b983-260f9b160b71 admin admin] The token cache is being invalidate because project a5ebe74aa39b4300b141256c250eec01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:23:05.737060 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-70589f86-f06f-499f-b983-260f9b160b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:23:05.737687 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-70589f86-f06f-499f-b983-260f9b160b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:23:05.739194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1477/2931] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:23:05 2022] DELETE /identity/v3/projects/a5ebe74aa39b4300b141256c250eec01 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:23:05.743214 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a2fc3-c08f-498c-bbff-d56ba725b0a2 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:23:05.744756 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-da1a2fc3-c08f-498c-bbff-d56ba725b0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:23:05.759140 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a2fc3-c08f-498c-bbff-d56ba725b0a2 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:23:05.780144 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:23:05.818121 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c4583-575c-4999-80a0-d0e6db836b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:23:05.818750 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c4583-575c-4999-80a0-d0e6db836b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:23:05.819065 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c4583-575c-4999-80a0-d0e6db836b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:23:05.819345 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c4583-575c-4999-80a0-d0e6db836b03 admin admin] PATH_INFO: `/v3/users/39f354b3c42940388ccf1c7868b8e70d` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:23:05.820495 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c4583-575c-4999-80a0-d0e6db836b03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39f354b3c42940388ccf1c7868b8e70d)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:23:05.822470 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c4583-575c-4999-80a0-d0e6db836b03 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:23:06.001603 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-373c4583-575c-4999-80a0-d0e6db836b03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39f354b3c42940388ccf1c7868b8e70d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:23:06.013296 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-373c4583-575c-4999-80a0-d0e6db836b03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39f354b3c42940388ccf1c7868b8e70d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:23:06.014014 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-373c4583-575c-4999-80a0-d0e6db836b03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39f354b3c42940388ccf1c7868b8e70d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:23:06.094806 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-373c4583-575c-4999-80a0-d0e6db836b03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39f354b3c42940388ccf1c7868b8e70d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:23:06.102625 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-373c4583-575c-4999-80a0-d0e6db836b03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39f354b3c42940388ccf1c7868b8e70d'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:23:06.108833 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1455/2932] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Aug 11 11:23:05 2022] DELETE /identity/v3/users/39f354b3c42940388ccf1c7868b8e70d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:23:06.407134 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70589f86-f06f-499f-b983-260f9b160b71 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:23:06.408586 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-70589f86-f06f-499f-b983-260f9b160b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:23:06.421899 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70589f86-f06f-499f-b983-260f9b160b71 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:23:06.480178 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a777e3-025b-4d04-95c2-8e2252919ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94631e4d22874dba849ec3d0cdff5210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6947801fa7c4cca9da48801b7ffc014', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:23:06.480805 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a777e3-025b-4d04-95c2-8e2252919ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:23:06.481194 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a777e3-025b-4d04-95c2-8e2252919ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:23:06.481475 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a777e3-025b-4d04-95c2-8e2252919ca3 admin admin] PATH_INFO: `/v3/projects/4861d903ef694d25af92cb31040ac131` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:23:06.482659 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a777e3-025b-4d04-95c2-8e2252919ca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4861d903ef694d25af92cb31040ac131)` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:23:06.485327 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a777e3-025b-4d04-95c2-8e2252919ca3 admin admin] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:23:06.589340 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-98a777e3-025b-4d04-95c2-8e2252919ca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4861d903ef694d25af92cb31040ac131', 'request_id': 'req-98a777e3-025b-4d04-95c2-8e2252919ca3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:23:06.595449 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-98a777e3-025b-4d04-95c2-8e2252919ca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4861d903ef694d25af92cb31040ac131', 'request_id': 'req-98a777e3-025b-4d04-95c2-8e2252919ca3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:23:06.685151 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-98a777e3-025b-4d04-95c2-8e2252919ca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4861d903ef694d25af92cb31040ac131', 'request_id': 'req-98a777e3-025b-4d04-95c2-8e2252919ca3'} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:23:06.696448 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-98a777e3-025b-4d04-95c2-8e2252919ca3 admin admin] The token cache is being invalidate because project 4861d903ef694d25af92cb31040ac131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81639) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 11 11:23:06.696774 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-98a777e3-025b-4d04-95c2-8e2252919ca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:23:06.697413 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.notifications [None req-98a777e3-025b-4d04-95c2-8e2252919ca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81639) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 11 11:23:06.698914 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1478/2933] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Aug 11 11:23:06 2022] DELETE /identity/v3/projects/4861d903ef694d25af92cb31040ac131 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 11 11:23:06.860685 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c4583-575c-4999-80a0-d0e6db836b03 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:23:06.862661 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-373c4583-575c-4999-80a0-d0e6db836b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:23:06.941796 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c4583-575c-4999-80a0-d0e6db836b03 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:23:06.991320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:23:07.007666 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a3fed-7c1e-43aa-91b1-056735369506 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db99589bb504e8fa4068925badf3942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:23:07.008320 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a3fed-7c1e-43aa-91b1-056735369506 service placement] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:23:07.008554 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a3fed-7c1e-43aa-91b1-056735369506 service placement] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:23:07.008848 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a3fed-7c1e-43aa-91b1-056735369506 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:23:07.010917 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-128a3fed-7c1e-43aa-91b1-056735369506 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:23:07.027091 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a3fed-7c1e-43aa-91b1-056735369506 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:23:07.028720 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a3fed-7c1e-43aa-91b1-056735369506 service placement] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:23:07.039667 dv-cinder-820027-17-smb devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1456/2934] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:23:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 11 11:23:16.693283 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG dbcounter [-] [81639] Writing DB stats keystone:SELECT=69,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81639) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:23:17.100522 dv-cinder-820027-17-smb devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=11 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:28:08.887268 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a777e3-025b-4d04-95c2-8e2252919ca3 admin admin] Authenticating user token {{(pid=81639) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 11 11:28:08.888941 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.fernet_utils [None req-98a777e3-025b-4d04-95c2-8e2252919ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81639) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 11 11:28:08.904583 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a777e3-025b-4d04-95c2-8e2252919ca3 admin admin] Validating token access rules against request {{(pid=81639) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 11 11:28:08.909790 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbd7a0-e54e-4567-a3ca-a25dcff6db1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4db99589bb504e8fa4068925badf3942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb12c96bf3a84df0b86967fbe93d1c17', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81639) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 11 11:28:08.910409 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbd7a0-e54e-4567-a3ca-a25dcff6db1c service placement] REQUEST_METHOD: `GET` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 11 11:28:08.910691 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbd7a0-e54e-4567-a3ca-a25dcff6db1c service placement] SCRIPT_NAME: `/identity` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 11 11:28:08.910992 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbd7a0-e54e-4567-a3ca-a25dcff6db1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81639) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 11 11:28:08.919451 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbd7a0-e54e-4567-a3ca-a25dcff6db1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 11 11:28:08.921027 dv-cinder-820027-17-smb devstack@keystone.service[81639]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbd7a0-e54e-4567-a3ca-a25dcff6db1c service placement] RBAC: Authorization granted {{(pid=81639) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 11 11:28:08.930778 dv-cinder-820027-17-smb devstack@keystone.service[81639]: [pid: 81639|app: 0|req: 1479/2935] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Aug 11 11:28:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)